Aug 22 02:48:25 user nova-compute[73469]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 22 02:48:28 user nova-compute[73469]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73469) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73469) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73469) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 22 02:48:28 user nova-compute[73469]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:48:28 user nova-compute[73469]: INFO nova.virt.driver [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 22 02:48:28 user nova-compute[73469]: INFO nova.compute.provider_config [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] Acquiring lock "singleton_lock" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] Acquired lock "singleton_lock" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] Releasing lock "singleton_lock" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] Full set of CONF: {{(pid=73469) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ******************************************************************************** {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] Configuration options gathered from: {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ================================================================================ {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] allow_resize_to_same_host      = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] arq_binding_timeout            = 300 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] backdoor_port                  = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] backdoor_socket                = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] block_device_allocate_retries  = 300 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] block_device_allocate_retries_interval = 5 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cert                           = self.pem {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] compute_monitors               = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] config_dir                     = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] config_drive_format            = iso9660 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] config_source                  = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] console_host                   = user {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] control_exchange               = nova {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cpu_allocation_ratio           = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] daemon                         = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] debug                          = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] default_access_ip_network_name = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] default_availability_zone      = nova {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] default_ephemeral_format       = ext4 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] default_schedule_zone          = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] disk_allocation_ratio          = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] enable_new_services            = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] enabled_apis                   = ['osapi_compute'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] enabled_ssl_apis               = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] flat_injected                  = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] force_config_drive             = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] force_raw_images               = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] graceful_shutdown_timeout      = 5 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] heal_instance_info_cache_interval = 60 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] host                           = user {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] instance_build_timeout         = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] instance_delete_interval       = 300 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] instance_format                = [instance: %(uuid)s]  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] instance_name_template         = instance-%08x {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] instance_usage_audit           = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] instance_usage_audit_period    = month {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] internal_service_availability_zone = internal {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] key                            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] live_migration_retry_count     = 30 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] log_config_append              = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] log_dir                        = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] log_file                       = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] log_options                    = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] log_rotate_interval            = 1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] log_rotate_interval_type       = days {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] log_rotation_type              = none {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] long_rpc_timeout               = 1800 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] max_concurrent_builds          = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] max_concurrent_live_migrations = 1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] max_concurrent_snapshots       = 5 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] max_local_block_devices        = 3 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] max_logfile_count              = 30 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] max_logfile_size_mb            = 200 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] maximum_instance_delete_attempts = 5 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] metadata_listen                = 0.0.0.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] metadata_listen_port           = 8775 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] metadata_workers               = 3 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] migrate_max_retries            = -1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] mkisofs_cmd                    = genisoimage {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] my_ip                          = 10.0.0.210 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] network_allocate_retries       = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] osapi_compute_listen_port      = 8774 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] osapi_compute_unique_server_name_scope =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] osapi_compute_workers          = 3 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] password_length                = 12 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] periodic_enable                = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] periodic_fuzzy_delay           = 60 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] pointer_model                  = ps2mouse {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] preallocate_images             = none {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] publish_errors                 = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] pybasedir                      = /opt/stack/nova {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ram_allocation_ratio           = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] rate_limit_burst               = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] rate_limit_except_level        = CRITICAL {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] rate_limit_interval            = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] reboot_timeout                 = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] reclaim_instance_interval      = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] record                         = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] reimage_timeout_per_gb         = 60 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] report_interval                = 120 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] rescue_timeout                 = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] reserved_host_cpus             = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] reserved_host_disk_mb          = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] reserved_host_memory_mb        = 512 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] reserved_huge_pages            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] resize_confirm_window          = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] resize_fs_using_block_device   = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] resume_guests_state_on_host_boot = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] rpc_response_timeout           = 60 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] run_external_periodic_tasks    = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] running_deleted_instance_action = reap {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] running_deleted_instance_poll_interval = 1800 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] running_deleted_instance_timeout = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] scheduler_instance_sync_interval = 120 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] service_down_time              = 720 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] servicegroup_driver            = db {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] shelved_offload_time           = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] shelved_poll_interval          = 3600 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] shutdown_timeout               = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] source_is_ipv6                 = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ssl_only                       = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] state_path                     = /opt/stack/data/nova {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] sync_power_state_interval      = 600 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] sync_power_state_pool_size     = 1000 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] syslog_log_facility            = LOG_USER {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] tempdir                        = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] timeout_nbd                    = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] transport_url                  = **** {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] update_resources_interval      = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] use_cow_images                 = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] use_eventlog                   = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] use_journal                    = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] use_json                       = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] use_rootwrap_daemon            = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] use_stderr                     = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] use_syslog                     = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vcpu_pin_set                   = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vif_plugging_is_fatal          = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vif_plugging_timeout           = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] virt_mkfs                      = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] volume_usage_poll_interval     = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] watch_log_file                 = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] web                            = /usr/share/spice-html5 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_concurrency.disable_process_locking = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.auth_strategy              = keystone {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.compute_link_prefix        = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.dhcp_domain                = novalocal {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.enable_instance_password   = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.glance_link_prefix         = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.instance_list_per_project_cells = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.list_records_by_skipping_down_cells = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.local_metadata_per_cell    = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.max_limit                  = 1000 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.metadata_cache_expiration  = 15 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.neutron_default_tenant_id  = default {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.use_forwarded_for          = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.use_neutron_default_nets   = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.vendordata_dynamic_targets = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.vendordata_jsonfile_path   = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.backend                  = dogpile.cache.memcached {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.backend_argument         = **** {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.config_prefix            = cache.oslo {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.dead_timeout             = 60.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.debug_cache_backend      = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.enable_retry_client      = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.enable_socket_keepalive  = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.enabled                  = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.expiration_time          = 600 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.hashclient_retry_attempts = 2 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.memcache_dead_retry      = 300 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.memcache_password        =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.memcache_pool_maxsize    = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.memcache_sasl_enabled    = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.memcache_username        =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.proxies                  = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.retry_attempts           = 2 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.retry_delay              = 0.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.socket_keepalive_count   = 1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.socket_keepalive_idle    = 1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.socket_keepalive_interval = 1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.tls_allowed_ciphers      = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.tls_cafile               = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.tls_certfile             = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.tls_enabled              = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cache.tls_keyfile              = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cinder.auth_section            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cinder.auth_type               = password {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cinder.cafile                  = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cinder.certfile                = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cinder.collect_timing          = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cinder.cross_az_attach         = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cinder.debug                   = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cinder.endpoint_template       = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cinder.http_retries            = 3 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cinder.insecure                = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cinder.keyfile                 = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cinder.os_region_name          = RegionOne {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cinder.split_loggers           = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cinder.timeout                 = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] compute.cpu_dedicated_set      = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] compute.cpu_shared_set         = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] compute.image_type_exclude_list = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] compute.max_concurrent_disk_ops = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] compute.max_disk_devices_to_attach = -1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] compute.resource_provider_association_refresh = 300 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] compute.shutdown_retry_interval = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] conductor.workers              = 3 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] console.allowed_origins        = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] console.ssl_ciphers            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] console.ssl_minimum_version    = default {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] consoleauth.token_ttl          = 600 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cyborg.cafile                  = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cyborg.certfile                = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cyborg.collect_timing          = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cyborg.connect_retries         = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cyborg.connect_retry_delay     = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cyborg.endpoint_override       = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cyborg.insecure                = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cyborg.keyfile                 = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cyborg.max_version             = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cyborg.min_version             = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cyborg.region_name             = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cyborg.service_name            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cyborg.service_type            = accelerator {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cyborg.split_loggers           = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cyborg.status_code_retries     = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cyborg.status_code_retry_delay = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cyborg.timeout                 = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] cyborg.version                 = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.backend               = sqlalchemy {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.connection            = **** {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.connection_debug      = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.connection_parameters =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.connection_recycle_time = 3600 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.connection_trace      = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.db_inc_retry_interval = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.db_max_retries        = 20 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.db_max_retry_interval = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.db_retry_interval     = 1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.max_overflow          = 50 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.max_pool_size         = 5 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.max_retries           = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.mysql_enable_ndb      = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.mysql_wsrep_sync_wait = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.pool_timeout          = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.retry_interval        = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.slave_connection      = **** {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] database.sqlite_synchronous    = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.backend           = sqlalchemy {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.connection        = **** {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.connection_debug  = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.connection_parameters =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.connection_recycle_time = 3600 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.connection_trace  = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.db_inc_retry_interval = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.db_max_retries    = 20 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.db_max_retry_interval = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.db_retry_interval = 1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.max_overflow      = 50 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.max_pool_size     = 5 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.max_retries       = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.mysql_enable_ndb  = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.pool_timeout      = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.retry_interval    = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.slave_connection  = **** {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] api_database.sqlite_synchronous = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] devices.enabled_mdev_types     = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ephemeral_storage_encryption.enabled = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.api_servers             = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.cafile                  = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.certfile                = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.collect_timing          = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.connect_retries         = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.connect_retry_delay     = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.debug                   = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.default_trusted_certificate_ids = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.enable_certificate_validation = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.enable_rbd_download     = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.endpoint_override       = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.insecure                = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.keyfile                 = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.max_version             = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.min_version             = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.num_retries             = 3 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.rbd_ceph_conf           =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.rbd_connect_timeout     = 5 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.rbd_pool                =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.rbd_user                =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.region_name             = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.service_name            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.service_type            = image {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.split_loggers           = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.status_code_retries     = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.status_code_retry_delay = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.timeout                 = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.verify_glance_signatures = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] glance.version                 = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] guestfs.debug                  = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] hyperv.config_drive_cdrom      = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] hyperv.config_drive_inject_password = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] hyperv.enable_instance_metrics_collection = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] hyperv.enable_remotefx         = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] hyperv.instances_path_share    =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] hyperv.iscsi_initiator_list    = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] hyperv.limit_cpu_features      = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] hyperv.power_state_check_timeframe = 60 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] hyperv.use_multipath_io        = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] hyperv.volume_attach_retry_count = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] hyperv.vswitch_name            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] mks.enabled                    = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] image_cache.manager_interval   = 2400 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] image_cache.precache_concurrency = 1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] image_cache.remove_unused_base_images = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] image_cache.subdirectory_name  = _base {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.api_max_retries         = 60 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.api_retry_interval      = 2 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.auth_section            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.auth_type               = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.cafile                  = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.certfile                = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.collect_timing          = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.connect_retries         = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.connect_retry_delay     = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.endpoint_override       = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.insecure                = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.keyfile                 = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.max_version             = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.min_version             = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.partition_key           = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.peer_list               = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.region_name             = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.serial_console_state_timeout = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.service_name            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.service_type            = baremetal {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.split_loggers           = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.status_code_retries     = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.status_code_retry_delay = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.timeout                 = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ironic.version                 = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] key_manager.fixed_key          = **** {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican.barbican_api_version  = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican.barbican_endpoint     = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican.barbican_endpoint_type = public {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican.barbican_region_name  = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican.cafile                = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican.certfile              = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican.collect_timing        = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican.insecure              = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican.keyfile               = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican.number_of_retries     = 60 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican.retry_delay           = 1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican.send_service_user_token = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican.split_loggers         = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican.timeout               = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican.verify_ssl            = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican.verify_ssl_path       = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican_service_user.auth_section = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican_service_user.auth_type = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican_service_user.cafile   = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican_service_user.certfile = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican_service_user.collect_timing = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican_service_user.insecure = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican_service_user.keyfile  = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican_service_user.split_loggers = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] barbican_service_user.timeout  = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vault.approle_role_id          = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vault.approle_secret_id        = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vault.cafile                   = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vault.certfile                 = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vault.collect_timing           = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vault.insecure                 = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vault.keyfile                  = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vault.kv_mountpoint            = secret {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vault.kv_version               = 2 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vault.namespace                = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vault.root_token_id            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vault.split_loggers            = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vault.ssl_ca_crt_file          = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vault.timeout                  = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vault.use_ssl                  = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] keystone.cafile                = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] keystone.certfile              = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] keystone.collect_timing        = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] keystone.connect_retries       = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] keystone.connect_retry_delay   = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] keystone.endpoint_override     = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] keystone.insecure              = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] keystone.keyfile               = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] keystone.max_version           = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] keystone.min_version           = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] keystone.region_name           = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] keystone.service_name          = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] keystone.service_type          = identity {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] keystone.split_loggers         = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] keystone.status_code_retries   = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] keystone.status_code_retry_delay = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] keystone.timeout               = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] keystone.version               = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.connection_uri         =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.cpu_mode               = custom {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: WARNING oslo_config.cfg [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.cpu_power_governor_high = performance {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.cpu_power_governor_low = powersave {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.cpu_power_management   = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.device_detach_attempts = 8 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.device_detach_timeout  = 20 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.disk_cachemodes        = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.disk_prefix            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.enabled_perf_events    = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.file_backed_memory     = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.gid_maps               = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.hw_disk_discard        = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.hw_machine_type        = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.images_rbd_glance_store_name =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.images_rbd_pool        = rbd {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.images_type            = default {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.images_volume_group    = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.inject_key             = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.inject_partition       = -2 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.inject_password        = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.iscsi_iface            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.iser_use_multipath     = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.live_migration_bandwidth = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.live_migration_downtime = 500 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.live_migration_inbound_addr = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.live_migration_permit_post_copy = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.live_migration_scheme  = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.live_migration_timeout_action = abort {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.live_migration_tunnelled = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: WARNING oslo_config.cfg [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 22 02:48:28 user nova-compute[73469]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 22 02:48:28 user nova-compute[73469]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 22 02:48:28 user nova-compute[73469]: and ``live_migration_inbound_addr`` respectively.
Aug 22 02:48:28 user nova-compute[73469]: ).  Its value may be silently ignored in the future.
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.live_migration_with_native_tls = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.max_queues             = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.nfs_mount_options      = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.num_memory_encrypted_guests = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.num_pcie_ports         = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.pmem_namespaces        = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.quobyte_client_cfg     = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.rbd_secret_uuid        = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.rbd_user               = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.remote_filesystem_transport = ssh {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.rescue_image_id        = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.rescue_kernel_id       = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.rescue_ramdisk_id      = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.rx_queue_size          = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.smbfs_mount_options    =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.snapshot_compression   = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.snapshot_image_format  = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.sparse_logical_volumes = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.swtpm_enabled          = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.swtpm_group            = tss {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.swtpm_user             = tss {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.sysinfo_serial         = unique {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.tb_cache_size          = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.tx_queue_size          = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.uid_maps               = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.use_virtio_for_bridges = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.virt_type              = kvm {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.volume_clear           = zero {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.volume_clear_size      = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.volume_use_multipath   = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.vzstorage_cache_path   = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.vzstorage_mount_user   = stack {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.auth_section           = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.auth_type              = password {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.cafile                 = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.certfile               = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.collect_timing         = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.connect_retries        = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.connect_retry_delay    = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.default_floating_pool  = public {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.endpoint_override      = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.extension_sync_interval = 600 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.http_retries           = 3 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.insecure               = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.keyfile                = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.max_version            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.min_version            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.ovs_bridge             = br-int {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.physnets               = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.region_name            = RegionOne {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.service_metadata_proxy = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.service_name           = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.service_type           = network {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.split_loggers          = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.status_code_retries    = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.status_code_retry_delay = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.timeout                = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] neutron.version                = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] notifications.bdms_in_notifications = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] notifications.default_level    = INFO {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] notifications.notification_format = unversioned {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] notifications.notify_on_state_change = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] pci.alias                      = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] pci.device_spec                = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] pci.report_in_placement        = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.auth_section         = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.auth_type            = password {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.cafile               = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.certfile             = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.collect_timing       = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.connect_retries      = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.connect_retry_delay  = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.default_domain_id    = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.default_domain_name  = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.domain_id            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.domain_name          = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.endpoint_override    = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.insecure             = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.keyfile              = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.max_version          = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.min_version          = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.password             = **** {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.project_domain_id    = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.project_domain_name  = Default {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.project_id           = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.project_name         = service {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.region_name          = RegionOne {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.service_name         = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.service_type         = placement {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.split_loggers        = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.status_code_retries  = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.status_code_retry_delay = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.system_scope         = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.timeout              = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.trust_id             = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.user_domain_id       = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.user_domain_name     = Default {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.user_id              = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.username             = placement {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] placement.version              = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] quota.cores                    = 20 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] quota.count_usage_from_placement = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] quota.injected_file_content_bytes = 10240 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] quota.injected_file_path_length = 255 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] quota.injected_files           = 5 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] quota.instances                = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] quota.key_pairs                = 100 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] quota.metadata_items           = 128 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] quota.ram                      = 51200 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] quota.recheck_quota            = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] quota.server_group_members     = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] quota.server_groups            = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] rdp.enabled                    = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] scheduler.image_metadata_prefilter = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] scheduler.max_attempts         = 3 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] scheduler.max_placement_results = 1000 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] scheduler.query_placement_for_availability_zone = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] scheduler.query_placement_for_image_type_support = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] scheduler.workers              = 3 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.host_subset_size = 1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.isolated_hosts = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.isolated_images = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.pci_in_placement = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.track_instance_changes = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] metrics.required               = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] metrics.weight_multiplier      = 1.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] metrics.weight_setting         = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] serial_console.enabled         = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] serial_console.port_range      = 10000:20000 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] serial_console.serialproxy_port = 6083 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] service_user.auth_section      = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] service_user.auth_type         = password {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] service_user.cafile            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] service_user.certfile          = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] service_user.collect_timing    = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] service_user.insecure          = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] service_user.keyfile           = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] service_user.send_service_user_token = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] service_user.split_loggers     = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] service_user.timeout           = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] spice.agent_enabled            = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] spice.enabled                  = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] spice.html5proxy_port          = 6082 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] spice.image_compression        = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] spice.jpeg_compression         = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] spice.playback_compression     = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] spice.server_listen            = 127.0.0.1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] spice.streaming_mode           = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] spice.zlib_compression         = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] upgrade_levels.baseapi         = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] upgrade_levels.cert            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] upgrade_levels.compute         = auto {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] upgrade_levels.conductor       = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] upgrade_levels.scheduler       = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vendordata_dynamic_auth.auth_section = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vendordata_dynamic_auth.auth_type = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vendordata_dynamic_auth.cafile = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vendordata_dynamic_auth.certfile = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vendordata_dynamic_auth.insecure = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vendordata_dynamic_auth.keyfile = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vendordata_dynamic_auth.timeout = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.api_retry_count         = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.ca_file                 = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.cache_prefix            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.cluster_name            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.connection_pool_size    = 10 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.console_delay_seconds   = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.datastore_regex         = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.host_ip                 = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.host_password           = **** {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:28 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.host_port               = 443 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.host_username           = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.insecure                = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.integration_bridge      = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.maximum_objects         = 100 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.pbm_default_policy      = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.pbm_enabled             = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.pbm_wsdl_location       = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.serial_port_proxy_uri   = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.serial_port_service_uri = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.task_poll_interval      = 0.5 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.use_linked_clone        = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.vnc_keymap              = en-us {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.vnc_port                = 5900 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vmware.vnc_port_total          = 10000 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vnc.auth_schemes               = ['none'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vnc.enabled                    = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vnc.novncproxy_port            = 6080 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vnc.server_listen              = 0.0.0.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vnc.vencrypt_ca_certs          = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vnc.vencrypt_client_cert       = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vnc.vencrypt_client_key        = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.disable_rootwrap   = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.enable_numa_live_migration = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.libvirt_disable_apic = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] wsgi.client_socket_timeout     = 900 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] wsgi.default_pool_size         = 1000 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] wsgi.keep_alive                = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] wsgi.max_header_line           = 16384 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] wsgi.ssl_ca_file               = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] wsgi.ssl_cert_file             = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] wsgi.ssl_key_file              = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] wsgi.tcp_keepidle              = 600 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] zvm.ca_file                    = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] zvm.cloud_connector_url        = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] zvm.reachable_timeout          = 300 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_policy.enforce_new_defaults = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_policy.enforce_scope      = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_policy.policy_default_rule = default {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_policy.policy_file        = policy.yaml {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] profiler.connection_string     = messaging:// {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] profiler.enabled               = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] profiler.es_doc_type           = notification {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] profiler.es_scroll_size        = 10000 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] profiler.es_scroll_time        = 2m {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] profiler.filter_error_trace    = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] profiler.hmac_keys             = **** {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] profiler.sentinel_service_name = mymaster {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] profiler.socket_timeout        = 0.1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] profiler.trace_requests        = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] profiler.trace_sqlalchemy      = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] profiler_jaeger.process_tags   = {} {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] profiler_jaeger.service_name_prefix = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] profiler_otlp.service_name_prefix = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] remote_debug.host              = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] remote_debug.port              = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.ssl      = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_notifications.retry = -1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_messaging_notifications.transport_url = **** {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.auth_section        = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.auth_type           = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.cafile              = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.certfile            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.collect_timing      = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.connect_retries     = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.connect_retry_delay = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.endpoint_id         = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.endpoint_override   = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.insecure            = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.keyfile             = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.max_version         = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.min_version         = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.region_name         = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.service_name        = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.service_type        = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.split_loggers       = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.status_code_retries = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.status_code_retry_delay = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.timeout             = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.valid_interfaces    = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_limit.version             = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_reports.file_event_handler = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] oslo_reports.log_dir           = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vif_plug_ovs_privileged.group  = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] vif_plug_ovs_privileged.user   = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] os_vif_linux_bridge.flat_interface = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] os_vif_ovs.isolate_vif         = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] os_vif_ovs.per_port_bridge     = False {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] os_brick.lock_path             = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] privsep_osbrick.capabilities   = [21] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] privsep_osbrick.group          = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] privsep_osbrick.helper_command = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] privsep_osbrick.user           = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] nova_sys_admin.group           = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] nova_sys_admin.helper_command  = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] nova_sys_admin.user            = None {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG oslo_service.service [None req-235c7deb-1c68-4ef9-9984-cbaefb426f5f None None] ******************************************************************************** {{(pid=73469) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 22 02:48:29 user nova-compute[73469]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 22 02:48:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Starting native event thread {{(pid=73469) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Starting green dispatch thread {{(pid=73469) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Starting connection event dispatch thread {{(pid=73469) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Connecting to libvirt: qemu:///system {{(pid=73469) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f79bdcfcf10> {{(pid=73469) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 22 02:48:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f79bdcfcf10> {{(pid=73469) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 22 02:48:29 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Connection event '1' reason 'None'
Aug 22 02:48:29 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 22 02:48:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.mount [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Initialising _HostMountState generation 0 {{(pid=73469) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 22 02:48:36 user nova-compute[73469]: INFO nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Libvirt host capabilities <capabilities>
Aug 22 02:48:36 user nova-compute[73469]:   <host>
Aug 22 02:48:36 user nova-compute[73469]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 22 02:48:36 user nova-compute[73469]:     <cpu>
Aug 22 02:48:36 user nova-compute[73469]:       <arch>x86_64</arch>
Aug 22 02:48:36 user nova-compute[73469]:       <model>IvyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <vendor>Intel</vendor>
Aug 22 02:48:36 user nova-compute[73469]:       <microcode version='1070'/>
Aug 22 02:48:36 user nova-compute[73469]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 22 02:48:36 user nova-compute[73469]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature name='ss'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature name='vmx'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature name='pcid'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature name='osxsave'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature name='hypervisor'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature name='arat'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature name='tsc_adjust'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature name='md-clear'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature name='stibp'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature name='arch-capabilities'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature name='ssbd'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature name='invtsc'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature name='rsba'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature name='skip-l1dfl-vmentry'/>
Aug 22 02:48:36 user nova-compute[73469]:       <pages unit='KiB' size='4'/>
Aug 22 02:48:36 user nova-compute[73469]:       <pages unit='KiB' size='2048'/>
Aug 22 02:48:36 user nova-compute[73469]:     </cpu>
Aug 22 02:48:36 user nova-compute[73469]:     <power_management>
Aug 22 02:48:36 user nova-compute[73469]:       <suspend_mem/>
Aug 22 02:48:36 user nova-compute[73469]:       <suspend_disk/>
Aug 22 02:48:36 user nova-compute[73469]:       <suspend_hybrid/>
Aug 22 02:48:36 user nova-compute[73469]:     </power_management>
Aug 22 02:48:36 user nova-compute[73469]:     <iommu support='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     <migration_features>
Aug 22 02:48:36 user nova-compute[73469]:       <live/>
Aug 22 02:48:36 user nova-compute[73469]:       <uri_transports>
Aug 22 02:48:36 user nova-compute[73469]:         <uri_transport>tcp</uri_transport>
Aug 22 02:48:36 user nova-compute[73469]:         <uri_transport>rdma</uri_transport>
Aug 22 02:48:36 user nova-compute[73469]:       </uri_transports>
Aug 22 02:48:36 user nova-compute[73469]:     </migration_features>
Aug 22 02:48:36 user nova-compute[73469]:     <topology>
Aug 22 02:48:36 user nova-compute[73469]:       <cells num='2'>
Aug 22 02:48:36 user nova-compute[73469]:         <cell id='0'>
Aug 22 02:48:36 user nova-compute[73469]:           <memory unit='KiB'>8189224</memory>
Aug 22 02:48:36 user nova-compute[73469]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 22 02:48:36 user nova-compute[73469]:           <pages unit='KiB' size='2048'>0</pages>
Aug 22 02:48:36 user nova-compute[73469]:           <distances>
Aug 22 02:48:36 user nova-compute[73469]:             <sibling id='0' value='10'/>
Aug 22 02:48:36 user nova-compute[73469]:             <sibling id='1' value='20'/>
Aug 22 02:48:36 user nova-compute[73469]:           </distances>
Aug 22 02:48:36 user nova-compute[73469]:           <cpus num='6'>
Aug 22 02:48:36 user nova-compute[73469]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 22 02:48:36 user nova-compute[73469]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 22 02:48:36 user nova-compute[73469]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 22 02:48:36 user nova-compute[73469]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 22 02:48:36 user nova-compute[73469]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 22 02:48:36 user nova-compute[73469]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 22 02:48:36 user nova-compute[73469]:           </cpus>
Aug 22 02:48:36 user nova-compute[73469]:         </cell>
Aug 22 02:48:36 user nova-compute[73469]:         <cell id='1'>
Aug 22 02:48:36 user nova-compute[73469]:           <memory unit='KiB'>8206460</memory>
Aug 22 02:48:36 user nova-compute[73469]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 22 02:48:36 user nova-compute[73469]:           <pages unit='KiB' size='2048'>0</pages>
Aug 22 02:48:36 user nova-compute[73469]:           <distances>
Aug 22 02:48:36 user nova-compute[73469]:             <sibling id='0' value='20'/>
Aug 22 02:48:36 user nova-compute[73469]:             <sibling id='1' value='10'/>
Aug 22 02:48:36 user nova-compute[73469]:           </distances>
Aug 22 02:48:36 user nova-compute[73469]:           <cpus num='6'>
Aug 22 02:48:36 user nova-compute[73469]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 22 02:48:36 user nova-compute[73469]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 22 02:48:36 user nova-compute[73469]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 22 02:48:36 user nova-compute[73469]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 22 02:48:36 user nova-compute[73469]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 22 02:48:36 user nova-compute[73469]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 22 02:48:36 user nova-compute[73469]:           </cpus>
Aug 22 02:48:36 user nova-compute[73469]:         </cell>
Aug 22 02:48:36 user nova-compute[73469]:       </cells>
Aug 22 02:48:36 user nova-compute[73469]:     </topology>
Aug 22 02:48:36 user nova-compute[73469]:     <cache>
Aug 22 02:48:36 user nova-compute[73469]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 22 02:48:36 user nova-compute[73469]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 22 02:48:36 user nova-compute[73469]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 22 02:48:36 user nova-compute[73469]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 22 02:48:36 user nova-compute[73469]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 22 02:48:36 user nova-compute[73469]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 22 02:48:36 user nova-compute[73469]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 22 02:48:36 user nova-compute[73469]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 22 02:48:36 user nova-compute[73469]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 22 02:48:36 user nova-compute[73469]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 22 02:48:36 user nova-compute[73469]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 22 02:48:36 user nova-compute[73469]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 22 02:48:36 user nova-compute[73469]:     </cache>
Aug 22 02:48:36 user nova-compute[73469]:     <secmodel>
Aug 22 02:48:36 user nova-compute[73469]:       <model>apparmor</model>
Aug 22 02:48:36 user nova-compute[73469]:       <doi>0</doi>
Aug 22 02:48:36 user nova-compute[73469]:     </secmodel>
Aug 22 02:48:36 user nova-compute[73469]:     <secmodel>
Aug 22 02:48:36 user nova-compute[73469]:       <model>dac</model>
Aug 22 02:48:36 user nova-compute[73469]:       <doi>0</doi>
Aug 22 02:48:36 user nova-compute[73469]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 22 02:48:36 user nova-compute[73469]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 22 02:48:36 user nova-compute[73469]:     </secmodel>
Aug 22 02:48:36 user nova-compute[73469]:   </host>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='alpha'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>64</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>clipper</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='armv6l'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>32</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>integratorcp</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>borzoi</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>spitz</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>nuri</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>musca-b1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>versatileab</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>kzm</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>musca-a</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>smdkc210</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>sx1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>z2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>tosa</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>sabrelite</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>realview-eb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>n810</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>n800</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>versatilepb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>terrier</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mainstone</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>midway</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>musicpal</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>microbit</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>cubieboard</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>verdex</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>netduino2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>raspi2b</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>cheetah</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>highbank</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>akita</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>connex</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>collie</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>raspi0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='armv7l'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>32</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>integratorcp</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>borzoi</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>spitz</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>nuri</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>musca-b1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>versatileab</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>kzm</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>musca-a</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>smdkc210</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>sx1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>z2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>tosa</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>sabrelite</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>realview-eb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>n810</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>n800</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>versatilepb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>terrier</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mainstone</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>midway</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>musicpal</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>microbit</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>cubieboard</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>verdex</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>netduino2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>raspi2b</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>cheetah</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>highbank</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>akita</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>connex</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>collie</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>raspi0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='aarch64'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>64</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>integratorcp</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>borzoi</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>spitz</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>nuri</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>musca-b1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>versatileab</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>kzm</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>musca-a</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>smdkc210</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>sx1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>z2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>tosa</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>sabrelite</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>realview-eb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>n810</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>n800</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>versatilepb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>terrier</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mainstone</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>midway</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>musicpal</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>microbit</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>cubieboard</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>verdex</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>netduino2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>raspi3b</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>raspi2b</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>cheetah</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>highbank</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>akita</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>connex</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>collie</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>raspi0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <acpi default='on' toggle='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='cris'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>32</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='i686'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>32</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>x-remote</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>isapc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>microvm</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='kvm'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <pae/>
Aug 22 02:48:36 user nova-compute[73469]:       <nonpae/>
Aug 22 02:48:36 user nova-compute[73469]:       <acpi default='on' toggle='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:       <apic default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='m68k'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>32</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>an5206</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>q800</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>next-cube</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='microblaze'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>32</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='microblazeel'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>32</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='mips'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>32</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='16'>malta</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mipssim</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='mipsel'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>32</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='16'>malta</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mipssim</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='mips64'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>64</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='16'>malta</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mipssim</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>pica61</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>magnum</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='mips64el'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>64</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='16'>malta</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mipssim</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>pica61</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>magnum</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='16'>boston</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='ppc'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>32</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>g3beige</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mac99</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>ppce500</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>pegasos2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>sam460ex</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>bamboo</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>40p</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>ref405ep</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>taihu</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='ppc64'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>64</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2048'>powernv9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>taihu</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2048'>powernv10</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>ppce500</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>40p</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>pegasos2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>bamboo</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>g3beige</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mac99</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>sam460ex</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>ref405ep</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2048'>powernv8</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='ppc64le'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>64</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2048'>powernv9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>taihu</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2048'>powernv10</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>ppce500</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>40p</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>pegasos2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>bamboo</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>g3beige</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>mac99</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>sam460ex</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>ref405ep</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2048'>powernv8</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='riscv32'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>32</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='8'>spike</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>opentitan</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='5'>sifive_u</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>sifive_e</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='8'>virt</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='riscv64'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>64</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='8'>spike</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='5'>sifive_u</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>shakti_c</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>sifive_e</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='8'>virt</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='s390x'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>64</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='sh4'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>32</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>shix</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>r2d</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='sh4eb'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>64</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>shix</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>r2d</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='sparc'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>32</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>SS-5</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>SS-20</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>LX</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>SS-4</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>SS-10</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>Voyager</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='sparc64'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>64</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>sun4u</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>niagara</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>sun4v</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='x86_64'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>64</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>x-remote</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='1'>isapc</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>microvm</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='kvm'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <acpi default='on' toggle='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:       <apic default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='xtensa'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>32</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>sim</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>kc705</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>ml605</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>virt</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>lx200</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>lx60</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]:   <guest>
Aug 22 02:48:36 user nova-compute[73469]:     <os_type>hvm</os_type>
Aug 22 02:48:36 user nova-compute[73469]:     <arch name='xtensaeb'>
Aug 22 02:48:36 user nova-compute[73469]:       <wordsize>32</wordsize>
Aug 22 02:48:36 user nova-compute[73469]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='4'>sim</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>kc705</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>ml605</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>virt</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>lx200</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>lx60</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 22 02:48:36 user nova-compute[73469]:       <domain type='qemu'/>
Aug 22 02:48:36 user nova-compute[73469]:     </arch>
Aug 22 02:48:36 user nova-compute[73469]:     <features>
Aug 22 02:48:36 user nova-compute[73469]:       <cpuselection/>
Aug 22 02:48:36 user nova-compute[73469]:       <deviceboot/>
Aug 22 02:48:36 user nova-compute[73469]:       <disksnapshot default='on' toggle='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     </features>
Aug 22 02:48:36 user nova-compute[73469]:   </guest>
Aug 22 02:48:36 user nova-compute[73469]: </capabilities>
Aug 22 02:48:36 user nova-compute[73469]: 
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 22 02:48:36 user nova-compute[73469]: <domainCapabilities>
Aug 22 02:48:36 user nova-compute[73469]:   <path>/usr/bin/qemu-system-i386</path>
Aug 22 02:48:36 user nova-compute[73469]:   <domain>kvm</domain>
Aug 22 02:48:36 user nova-compute[73469]:   <machine>pc-q35-6.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:   <arch>i686</arch>
Aug 22 02:48:36 user nova-compute[73469]:   <vcpu max='288'/>
Aug 22 02:48:36 user nova-compute[73469]:   <iothreads supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:   <os supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:     <enum name='firmware'/>
Aug 22 02:48:36 user nova-compute[73469]:     <loader supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='type'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>rom</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>pflash</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='readonly'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>yes</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>no</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='secure'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>no</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </loader>
Aug 22 02:48:36 user nova-compute[73469]:   </os>
Aug 22 02:48:36 user nova-compute[73469]:   <cpu>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='host-passthrough' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='hostPassthroughMigratable'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>off</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='maximum' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='maximumMigratable'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>on</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>off</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='host-model' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <vendor>Intel</vendor>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ss'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='vmx'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='pcid'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='hypervisor'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='arat'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='tsc_adjust'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='umip'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='md-clear'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='stibp'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='arch-capabilities'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ssbd'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ibpb'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ibrs'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='amd-stibp'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='amd-ssbd'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='erms'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='xsaveopt'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='lm'/>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='custom' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>qemu64</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>qemu32</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>phenom</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium3</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium2</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>n270</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>kvm64</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>kvm32</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>coreduo</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>core2duo</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>athlon</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Westmere-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Westmere</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Snowridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>SandyBridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Penryn</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G5</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G4</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G3</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G2</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G1</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Nehalem-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Nehalem</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>IvyBridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Icelake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-Rome</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-Milan</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-IBPB</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Dhyana</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cooperlake</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Conroe</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cascadelake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>486</model>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:   </cpu>
Aug 22 02:48:36 user nova-compute[73469]:   <memoryBacking supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:     <enum name='sourceType'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>file</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>anonymous</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>memfd</value>
Aug 22 02:48:36 user nova-compute[73469]:     </enum>
Aug 22 02:48:36 user nova-compute[73469]:   </memoryBacking>
Aug 22 02:48:36 user nova-compute[73469]:   <devices>
Aug 22 02:48:36 user nova-compute[73469]:     <disk supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='diskDevice'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>disk</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>cdrom</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>floppy</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>lun</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='bus'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>fdc</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>scsi</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>usb</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>sata</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-non-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </disk>
Aug 22 02:48:36 user nova-compute[73469]:     <graphics supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='type'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>sdl</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vnc</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>spice</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>egl-headless</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </graphics>
Aug 22 02:48:36 user nova-compute[73469]:     <video supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='modelType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vga</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>cirrus</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vmvga</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>qxl</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>none</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>bochs</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>ramfb</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </video>
Aug 22 02:48:36 user nova-compute[73469]:     <hostdev supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='mode'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>subsystem</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='startupPolicy'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>default</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>mandatory</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>requisite</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>optional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='subsysType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>usb</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>pci</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>scsi</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='capsType'/>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='pciBackend'/>
Aug 22 02:48:36 user nova-compute[73469]:     </hostdev>
Aug 22 02:48:36 user nova-compute[73469]:     <rng supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-non-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='backendModel'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>random</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>egd</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>builtin</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </rng>
Aug 22 02:48:36 user nova-compute[73469]:     <filesystem supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='driverType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>path</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>handle</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtiofs</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </filesystem>
Aug 22 02:48:36 user nova-compute[73469]:     <tpm supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>tpm-tis</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>tpm-crb</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='backendModel'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>passthrough</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>emulator</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </tpm>
Aug 22 02:48:36 user nova-compute[73469]:   </devices>
Aug 22 02:48:36 user nova-compute[73469]:   <features>
Aug 22 02:48:36 user nova-compute[73469]:     <gic supported='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     <vmcoreinfo supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <genid supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <backingStoreInput supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <backup supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <sev supported='no'/>
Aug 22 02:48:36 user nova-compute[73469]:   </features>
Aug 22 02:48:36 user nova-compute[73469]: </domainCapabilities>
Aug 22 02:48:36 user nova-compute[73469]:  {{(pid=73469) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 22 02:48:36 user nova-compute[73469]: <domainCapabilities>
Aug 22 02:48:36 user nova-compute[73469]:   <path>/usr/bin/qemu-system-i386</path>
Aug 22 02:48:36 user nova-compute[73469]:   <domain>kvm</domain>
Aug 22 02:48:36 user nova-compute[73469]:   <machine>pc-q35-jammy</machine>
Aug 22 02:48:36 user nova-compute[73469]:   <arch>i686</arch>
Aug 22 02:48:36 user nova-compute[73469]:   <vcpu max='288'/>
Aug 22 02:48:36 user nova-compute[73469]:   <iothreads supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:   <os supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:     <enum name='firmware'/>
Aug 22 02:48:36 user nova-compute[73469]:     <loader supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='type'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>rom</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>pflash</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='readonly'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>yes</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>no</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='secure'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>no</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </loader>
Aug 22 02:48:36 user nova-compute[73469]:   </os>
Aug 22 02:48:36 user nova-compute[73469]:   <cpu>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='host-passthrough' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='hostPassthroughMigratable'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>off</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='maximum' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='maximumMigratable'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>on</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>off</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='host-model' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <vendor>Intel</vendor>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ss'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='vmx'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='pcid'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='hypervisor'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='arat'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='tsc_adjust'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='umip'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='md-clear'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='stibp'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='arch-capabilities'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ssbd'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ibpb'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ibrs'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='amd-stibp'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='amd-ssbd'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='erms'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='xsaveopt'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='lm'/>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='custom' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>qemu64</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>qemu32</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>phenom</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium3</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium2</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>n270</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>kvm64</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>kvm32</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>coreduo</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>core2duo</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>athlon</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Westmere-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Westmere</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Snowridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>SandyBridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Penryn</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G5</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G4</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G3</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G2</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G1</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Nehalem-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Nehalem</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>IvyBridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Icelake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-Rome</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-Milan</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-IBPB</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Dhyana</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cooperlake</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Conroe</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cascadelake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>486</model>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:   </cpu>
Aug 22 02:48:36 user nova-compute[73469]:   <memoryBacking supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:     <enum name='sourceType'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>file</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>anonymous</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>memfd</value>
Aug 22 02:48:36 user nova-compute[73469]:     </enum>
Aug 22 02:48:36 user nova-compute[73469]:   </memoryBacking>
Aug 22 02:48:36 user nova-compute[73469]:   <devices>
Aug 22 02:48:36 user nova-compute[73469]:     <disk supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='diskDevice'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>disk</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>cdrom</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>floppy</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>lun</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='bus'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>fdc</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>scsi</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>usb</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>sata</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-non-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </disk>
Aug 22 02:48:36 user nova-compute[73469]:     <graphics supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='type'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>sdl</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vnc</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>spice</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>egl-headless</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </graphics>
Aug 22 02:48:36 user nova-compute[73469]:     <video supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='modelType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vga</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>cirrus</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vmvga</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>qxl</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>none</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>bochs</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>ramfb</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </video>
Aug 22 02:48:36 user nova-compute[73469]:     <hostdev supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='mode'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>subsystem</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='startupPolicy'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>default</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>mandatory</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>requisite</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>optional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='subsysType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>usb</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>pci</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>scsi</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='capsType'/>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='pciBackend'/>
Aug 22 02:48:36 user nova-compute[73469]:     </hostdev>
Aug 22 02:48:36 user nova-compute[73469]:     <rng supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-non-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='backendModel'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>random</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>egd</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>builtin</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </rng>
Aug 22 02:48:36 user nova-compute[73469]:     <filesystem supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='driverType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>path</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>handle</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtiofs</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </filesystem>
Aug 22 02:48:36 user nova-compute[73469]:     <tpm supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>tpm-tis</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>tpm-crb</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='backendModel'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>passthrough</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>emulator</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </tpm>
Aug 22 02:48:36 user nova-compute[73469]:   </devices>
Aug 22 02:48:36 user nova-compute[73469]:   <features>
Aug 22 02:48:36 user nova-compute[73469]:     <gic supported='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     <vmcoreinfo supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <genid supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <backingStoreInput supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <backup supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <sev supported='no'/>
Aug 22 02:48:36 user nova-compute[73469]:   </features>
Aug 22 02:48:36 user nova-compute[73469]: </domainCapabilities>
Aug 22 02:48:36 user nova-compute[73469]:  {{(pid=73469) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 22 02:48:36 user nova-compute[73469]: <domainCapabilities>
Aug 22 02:48:36 user nova-compute[73469]:   <path>/usr/bin/qemu-system-i386</path>
Aug 22 02:48:36 user nova-compute[73469]:   <domain>kvm</domain>
Aug 22 02:48:36 user nova-compute[73469]:   <machine>pc-i440fx-6.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:   <arch>i686</arch>
Aug 22 02:48:36 user nova-compute[73469]:   <vcpu max='255'/>
Aug 22 02:48:36 user nova-compute[73469]:   <iothreads supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:   <os supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:     <enum name='firmware'/>
Aug 22 02:48:36 user nova-compute[73469]:     <loader supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='type'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>rom</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>pflash</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='readonly'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>yes</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>no</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='secure'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>no</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </loader>
Aug 22 02:48:36 user nova-compute[73469]:   </os>
Aug 22 02:48:36 user nova-compute[73469]:   <cpu>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='host-passthrough' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='hostPassthroughMigratable'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>off</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='maximum' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='maximumMigratable'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>on</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>off</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='host-model' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <vendor>Intel</vendor>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ss'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='vmx'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='pcid'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='hypervisor'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='arat'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='tsc_adjust'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='umip'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='md-clear'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='stibp'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='arch-capabilities'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ssbd'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ibpb'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ibrs'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='amd-stibp'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='amd-ssbd'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='erms'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='xsaveopt'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='lm'/>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='custom' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>qemu64</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>qemu32</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>phenom</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium3</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium2</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>n270</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>kvm64</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>kvm32</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>coreduo</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>core2duo</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>athlon</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Westmere-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Westmere</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Snowridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>SandyBridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Penryn</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G5</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G4</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G3</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G2</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G1</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Nehalem-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Nehalem</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>IvyBridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Icelake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-Rome</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-Milan</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-IBPB</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Dhyana</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cooperlake</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Conroe</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cascadelake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>486</model>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:   </cpu>
Aug 22 02:48:36 user nova-compute[73469]:   <memoryBacking supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:     <enum name='sourceType'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>file</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>anonymous</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>memfd</value>
Aug 22 02:48:36 user nova-compute[73469]:     </enum>
Aug 22 02:48:36 user nova-compute[73469]:   </memoryBacking>
Aug 22 02:48:36 user nova-compute[73469]:   <devices>
Aug 22 02:48:36 user nova-compute[73469]:     <disk supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='diskDevice'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>disk</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>cdrom</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>floppy</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>lun</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='bus'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>ide</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>fdc</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>scsi</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>usb</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>sata</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-non-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </disk>
Aug 22 02:48:36 user nova-compute[73469]:     <graphics supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='type'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>sdl</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vnc</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>spice</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>egl-headless</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </graphics>
Aug 22 02:48:36 user nova-compute[73469]:     <video supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='modelType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vga</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>cirrus</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vmvga</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>qxl</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>none</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>bochs</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>ramfb</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </video>
Aug 22 02:48:36 user nova-compute[73469]:     <hostdev supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='mode'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>subsystem</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='startupPolicy'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>default</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>mandatory</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>requisite</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>optional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='subsysType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>usb</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>pci</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>scsi</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='capsType'/>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='pciBackend'/>
Aug 22 02:48:36 user nova-compute[73469]:     </hostdev>
Aug 22 02:48:36 user nova-compute[73469]:     <rng supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-non-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='backendModel'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>random</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>egd</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>builtin</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </rng>
Aug 22 02:48:36 user nova-compute[73469]:     <filesystem supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='driverType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>path</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>handle</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtiofs</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </filesystem>
Aug 22 02:48:36 user nova-compute[73469]:     <tpm supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>tpm-tis</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>tpm-crb</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='backendModel'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>passthrough</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>emulator</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </tpm>
Aug 22 02:48:36 user nova-compute[73469]:   </devices>
Aug 22 02:48:36 user nova-compute[73469]:   <features>
Aug 22 02:48:36 user nova-compute[73469]:     <gic supported='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     <vmcoreinfo supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <genid supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <backingStoreInput supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <backup supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <sev supported='no'/>
Aug 22 02:48:36 user nova-compute[73469]:   </features>
Aug 22 02:48:36 user nova-compute[73469]: </domainCapabilities>
Aug 22 02:48:36 user nova-compute[73469]:  {{(pid=73469) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 22 02:48:36 user nova-compute[73469]: <domainCapabilities>
Aug 22 02:48:36 user nova-compute[73469]:   <path>/usr/bin/qemu-system-i386</path>
Aug 22 02:48:36 user nova-compute[73469]:   <domain>kvm</domain>
Aug 22 02:48:36 user nova-compute[73469]:   <machine>pc-i440fx-jammy</machine>
Aug 22 02:48:36 user nova-compute[73469]:   <arch>i686</arch>
Aug 22 02:48:36 user nova-compute[73469]:   <vcpu max='255'/>
Aug 22 02:48:36 user nova-compute[73469]:   <iothreads supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:   <os supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:     <enum name='firmware'/>
Aug 22 02:48:36 user nova-compute[73469]:     <loader supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='type'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>rom</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>pflash</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='readonly'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>yes</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>no</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='secure'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>no</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </loader>
Aug 22 02:48:36 user nova-compute[73469]:   </os>
Aug 22 02:48:36 user nova-compute[73469]:   <cpu>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='host-passthrough' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='hostPassthroughMigratable'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>off</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='maximum' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='maximumMigratable'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>on</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>off</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='host-model' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <vendor>Intel</vendor>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ss'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='vmx'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='pcid'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='hypervisor'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='arat'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='tsc_adjust'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='umip'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='md-clear'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='stibp'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='arch-capabilities'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ssbd'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ibpb'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ibrs'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='amd-stibp'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='amd-ssbd'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='erms'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='xsaveopt'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='lm'/>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='custom' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>qemu64</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>qemu32</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>phenom</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium3</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium2</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>n270</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>kvm64</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>kvm32</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>coreduo</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>core2duo</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>athlon</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Westmere-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Westmere</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Snowridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>SandyBridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Penryn</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G5</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G4</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G3</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G2</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G1</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Nehalem-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Nehalem</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>IvyBridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Icelake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-Rome</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-Milan</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-IBPB</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Dhyana</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cooperlake</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Conroe</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cascadelake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>486</model>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:   </cpu>
Aug 22 02:48:36 user nova-compute[73469]:   <memoryBacking supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:     <enum name='sourceType'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>file</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>anonymous</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>memfd</value>
Aug 22 02:48:36 user nova-compute[73469]:     </enum>
Aug 22 02:48:36 user nova-compute[73469]:   </memoryBacking>
Aug 22 02:48:36 user nova-compute[73469]:   <devices>
Aug 22 02:48:36 user nova-compute[73469]:     <disk supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='diskDevice'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>disk</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>cdrom</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>floppy</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>lun</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='bus'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>ide</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>fdc</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>scsi</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>usb</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>sata</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-non-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </disk>
Aug 22 02:48:36 user nova-compute[73469]:     <graphics supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='type'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>sdl</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vnc</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>spice</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>egl-headless</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </graphics>
Aug 22 02:48:36 user nova-compute[73469]:     <video supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='modelType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vga</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>cirrus</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vmvga</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>qxl</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>none</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>bochs</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>ramfb</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </video>
Aug 22 02:48:36 user nova-compute[73469]:     <hostdev supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='mode'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>subsystem</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='startupPolicy'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>default</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>mandatory</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>requisite</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>optional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='subsysType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>usb</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>pci</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>scsi</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='capsType'/>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='pciBackend'/>
Aug 22 02:48:36 user nova-compute[73469]:     </hostdev>
Aug 22 02:48:36 user nova-compute[73469]:     <rng supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-non-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='backendModel'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>random</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>egd</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>builtin</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </rng>
Aug 22 02:48:36 user nova-compute[73469]:     <filesystem supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='driverType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>path</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>handle</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtiofs</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </filesystem>
Aug 22 02:48:36 user nova-compute[73469]:     <tpm supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>tpm-tis</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>tpm-crb</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='backendModel'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>passthrough</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>emulator</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </tpm>
Aug 22 02:48:36 user nova-compute[73469]:   </devices>
Aug 22 02:48:36 user nova-compute[73469]:   <features>
Aug 22 02:48:36 user nova-compute[73469]:     <gic supported='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     <vmcoreinfo supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <genid supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <backingStoreInput supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <backup supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <sev supported='no'/>
Aug 22 02:48:36 user nova-compute[73469]:   </features>
Aug 22 02:48:36 user nova-compute[73469]: </domainCapabilities>
Aug 22 02:48:36 user nova-compute[73469]:  {{(pid=73469) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 22 02:48:36 user nova-compute[73469]: <domainCapabilities>
Aug 22 02:48:36 user nova-compute[73469]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 22 02:48:36 user nova-compute[73469]:   <domain>kvm</domain>
Aug 22 02:48:36 user nova-compute[73469]:   <machine>pc-q35-6.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:   <arch>x86_64</arch>
Aug 22 02:48:36 user nova-compute[73469]:   <vcpu max='288'/>
Aug 22 02:48:36 user nova-compute[73469]:   <iothreads supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:   <os supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:     <enum name='firmware'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>efi</value>
Aug 22 02:48:36 user nova-compute[73469]:     </enum>
Aug 22 02:48:36 user nova-compute[73469]:     <loader supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='type'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>rom</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>pflash</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='readonly'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>yes</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>no</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='secure'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>yes</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>no</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </loader>
Aug 22 02:48:36 user nova-compute[73469]:   </os>
Aug 22 02:48:36 user nova-compute[73469]:   <cpu>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='host-passthrough' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='hostPassthroughMigratable'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>on</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>off</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='maximum' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='maximumMigratable'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>on</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>off</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='host-model' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <vendor>Intel</vendor>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ss'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='vmx'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='pcid'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='hypervisor'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='arat'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='tsc_adjust'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='umip'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='md-clear'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='stibp'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='arch-capabilities'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ssbd'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='invtsc'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ibpb'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ibrs'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='amd-stibp'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='amd-ssbd'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='rsba'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='pschange-mc-no'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='erms'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='xsaveopt'/>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='custom' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>qemu64</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>qemu32</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>phenom</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium3</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium2</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>n270</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>kvm64</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>kvm32</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>coreduo</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>core2duo</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>athlon</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Westmere-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Westmere</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Snowridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>SandyBridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Penryn</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G5</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G4</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G3</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G2</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Opteron_G1</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Nehalem</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>IvyBridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Icelake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-Rome</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-Milan</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-IBPB</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Dhyana</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cooperlake</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Conroe</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cascadelake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>486</model>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:   </cpu>
Aug 22 02:48:36 user nova-compute[73469]:   <memoryBacking supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:     <enum name='sourceType'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>file</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>anonymous</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>memfd</value>
Aug 22 02:48:36 user nova-compute[73469]:     </enum>
Aug 22 02:48:36 user nova-compute[73469]:   </memoryBacking>
Aug 22 02:48:36 user nova-compute[73469]:   <devices>
Aug 22 02:48:36 user nova-compute[73469]:     <disk supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='diskDevice'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>disk</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>cdrom</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>floppy</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>lun</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='bus'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>fdc</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>scsi</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>usb</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>sata</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-non-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </disk>
Aug 22 02:48:36 user nova-compute[73469]:     <graphics supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='type'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>sdl</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vnc</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>spice</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>egl-headless</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </graphics>
Aug 22 02:48:36 user nova-compute[73469]:     <video supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='modelType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vga</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>cirrus</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vmvga</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>qxl</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>none</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>bochs</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>ramfb</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </video>
Aug 22 02:48:36 user nova-compute[73469]:     <hostdev supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='mode'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>subsystem</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='startupPolicy'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>default</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>mandatory</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>requisite</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>optional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='subsysType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>usb</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>pci</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>scsi</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='capsType'/>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='pciBackend'/>
Aug 22 02:48:36 user nova-compute[73469]:     </hostdev>
Aug 22 02:48:36 user nova-compute[73469]:     <rng supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-non-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='backendModel'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>random</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>egd</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>builtin</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </rng>
Aug 22 02:48:36 user nova-compute[73469]:     <filesystem supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='driverType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>path</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>handle</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtiofs</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </filesystem>
Aug 22 02:48:36 user nova-compute[73469]:     <tpm supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>tpm-tis</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>tpm-crb</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='backendModel'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>passthrough</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>emulator</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </tpm>
Aug 22 02:48:36 user nova-compute[73469]:   </devices>
Aug 22 02:48:36 user nova-compute[73469]:   <features>
Aug 22 02:48:36 user nova-compute[73469]:     <gic supported='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     <vmcoreinfo supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <genid supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <backingStoreInput supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <backup supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <sev supported='no'/>
Aug 22 02:48:36 user nova-compute[73469]:   </features>
Aug 22 02:48:36 user nova-compute[73469]: </domainCapabilities>
Aug 22 02:48:36 user nova-compute[73469]:  {{(pid=73469) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 22 02:48:36 user nova-compute[73469]: <domainCapabilities>
Aug 22 02:48:36 user nova-compute[73469]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 22 02:48:36 user nova-compute[73469]:   <domain>kvm</domain>
Aug 22 02:48:36 user nova-compute[73469]:   <machine>pc-q35-jammy</machine>
Aug 22 02:48:36 user nova-compute[73469]:   <arch>x86_64</arch>
Aug 22 02:48:36 user nova-compute[73469]:   <vcpu max='288'/>
Aug 22 02:48:36 user nova-compute[73469]:   <iothreads supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:   <os supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:     <enum name='firmware'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>efi</value>
Aug 22 02:48:36 user nova-compute[73469]:     </enum>
Aug 22 02:48:36 user nova-compute[73469]:     <loader supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='type'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>rom</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>pflash</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='readonly'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>yes</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>no</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='secure'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>yes</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>no</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </loader>
Aug 22 02:48:36 user nova-compute[73469]:   </os>
Aug 22 02:48:36 user nova-compute[73469]:   <cpu>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='host-passthrough' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='hostPassthroughMigratable'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>on</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>off</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='maximum' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='maximumMigratable'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>on</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>off</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='host-model' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <vendor>Intel</vendor>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ss'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='vmx'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='pcid'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='hypervisor'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='arat'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='tsc_adjust'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='umip'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='md-clear'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='stibp'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='arch-capabilities'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ssbd'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='invtsc'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ibpb'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ibrs'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='amd-stibp'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='amd-ssbd'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='rsba'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='pschange-mc-no'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='erms'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='xsaveopt'/>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='custom' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>qemu64</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>qemu32</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>phenom</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium3</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium2</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>n270</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>kvm64</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>kvm32</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>coreduo</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>core2duo</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>athlon</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Westmere-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Westmere</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Snowridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>SandyBridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Penryn</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G5</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G4</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G3</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G2</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Opteron_G1</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Nehalem</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>IvyBridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Icelake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-Rome</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-Milan</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-IBPB</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Dhyana</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cooperlake</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Conroe</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cascadelake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>486</model>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:   </cpu>
Aug 22 02:48:36 user nova-compute[73469]:   <memoryBacking supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:     <enum name='sourceType'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>file</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>anonymous</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>memfd</value>
Aug 22 02:48:36 user nova-compute[73469]:     </enum>
Aug 22 02:48:36 user nova-compute[73469]:   </memoryBacking>
Aug 22 02:48:36 user nova-compute[73469]:   <devices>
Aug 22 02:48:36 user nova-compute[73469]:     <disk supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='diskDevice'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>disk</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>cdrom</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>floppy</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>lun</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='bus'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>fdc</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>scsi</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>usb</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>sata</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-non-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </disk>
Aug 22 02:48:36 user nova-compute[73469]:     <graphics supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='type'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>sdl</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vnc</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>spice</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>egl-headless</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </graphics>
Aug 22 02:48:36 user nova-compute[73469]:     <video supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='modelType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vga</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>cirrus</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vmvga</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>qxl</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>none</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>bochs</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>ramfb</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </video>
Aug 22 02:48:36 user nova-compute[73469]:     <hostdev supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='mode'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>subsystem</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='startupPolicy'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>default</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>mandatory</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>requisite</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>optional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='subsysType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>usb</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>pci</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>scsi</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='capsType'/>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='pciBackend'/>
Aug 22 02:48:36 user nova-compute[73469]:     </hostdev>
Aug 22 02:48:36 user nova-compute[73469]:     <rng supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-non-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='backendModel'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>random</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>egd</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>builtin</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </rng>
Aug 22 02:48:36 user nova-compute[73469]:     <filesystem supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='driverType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>path</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>handle</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtiofs</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </filesystem>
Aug 22 02:48:36 user nova-compute[73469]:     <tpm supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>tpm-tis</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>tpm-crb</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='backendModel'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>passthrough</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>emulator</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </tpm>
Aug 22 02:48:36 user nova-compute[73469]:   </devices>
Aug 22 02:48:36 user nova-compute[73469]:   <features>
Aug 22 02:48:36 user nova-compute[73469]:     <gic supported='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     <vmcoreinfo supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <genid supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <backingStoreInput supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <backup supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <sev supported='no'/>
Aug 22 02:48:36 user nova-compute[73469]:   </features>
Aug 22 02:48:36 user nova-compute[73469]: </domainCapabilities>
Aug 22 02:48:36 user nova-compute[73469]:  {{(pid=73469) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 22 02:48:36 user nova-compute[73469]: <domainCapabilities>
Aug 22 02:48:36 user nova-compute[73469]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 22 02:48:36 user nova-compute[73469]:   <domain>kvm</domain>
Aug 22 02:48:36 user nova-compute[73469]:   <machine>pc-i440fx-6.2</machine>
Aug 22 02:48:36 user nova-compute[73469]:   <arch>x86_64</arch>
Aug 22 02:48:36 user nova-compute[73469]:   <vcpu max='255'/>
Aug 22 02:48:36 user nova-compute[73469]:   <iothreads supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:   <os supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:     <enum name='firmware'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>efi</value>
Aug 22 02:48:36 user nova-compute[73469]:     </enum>
Aug 22 02:48:36 user nova-compute[73469]:     <loader supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='type'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>rom</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>pflash</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='readonly'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>yes</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>no</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='secure'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>no</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </loader>
Aug 22 02:48:36 user nova-compute[73469]:   </os>
Aug 22 02:48:36 user nova-compute[73469]:   <cpu>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='host-passthrough' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='hostPassthroughMigratable'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>on</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>off</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='maximum' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='maximumMigratable'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>on</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>off</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='host-model' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <vendor>Intel</vendor>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ss'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='vmx'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='pcid'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='hypervisor'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='arat'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='tsc_adjust'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='umip'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='md-clear'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='stibp'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='arch-capabilities'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ssbd'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='invtsc'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ibpb'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ibrs'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='amd-stibp'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='amd-ssbd'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='rsba'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='pschange-mc-no'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='erms'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='xsaveopt'/>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='custom' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>qemu64</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>qemu32</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>phenom</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium3</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium2</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>n270</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>kvm64</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>kvm32</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>coreduo</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>core2duo</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>athlon</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Westmere-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Westmere</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Snowridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>SandyBridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Penryn</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G5</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G4</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G3</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G2</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Opteron_G1</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Nehalem</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>IvyBridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Icelake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-Rome</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-Milan</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-IBPB</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Dhyana</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cooperlake</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Conroe</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cascadelake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>486</model>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:   </cpu>
Aug 22 02:48:36 user nova-compute[73469]:   <memoryBacking supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:     <enum name='sourceType'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>file</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>anonymous</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>memfd</value>
Aug 22 02:48:36 user nova-compute[73469]:     </enum>
Aug 22 02:48:36 user nova-compute[73469]:   </memoryBacking>
Aug 22 02:48:36 user nova-compute[73469]:   <devices>
Aug 22 02:48:36 user nova-compute[73469]:     <disk supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='diskDevice'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>disk</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>cdrom</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>floppy</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>lun</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='bus'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>ide</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>fdc</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>scsi</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>usb</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>sata</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-non-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </disk>
Aug 22 02:48:36 user nova-compute[73469]:     <graphics supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='type'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>sdl</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vnc</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>spice</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>egl-headless</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </graphics>
Aug 22 02:48:36 user nova-compute[73469]:     <video supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='modelType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vga</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>cirrus</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vmvga</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>qxl</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>none</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>bochs</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>ramfb</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </video>
Aug 22 02:48:36 user nova-compute[73469]:     <hostdev supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='mode'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>subsystem</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='startupPolicy'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>default</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>mandatory</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>requisite</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>optional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='subsysType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>usb</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>pci</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>scsi</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='capsType'/>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='pciBackend'/>
Aug 22 02:48:36 user nova-compute[73469]:     </hostdev>
Aug 22 02:48:36 user nova-compute[73469]:     <rng supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-non-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='backendModel'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>random</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>egd</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>builtin</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </rng>
Aug 22 02:48:36 user nova-compute[73469]:     <filesystem supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='driverType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>path</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>handle</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtiofs</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </filesystem>
Aug 22 02:48:36 user nova-compute[73469]:     <tpm supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>tpm-tis</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>tpm-crb</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='backendModel'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>passthrough</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>emulator</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </tpm>
Aug 22 02:48:36 user nova-compute[73469]:   </devices>
Aug 22 02:48:36 user nova-compute[73469]:   <features>
Aug 22 02:48:36 user nova-compute[73469]:     <gic supported='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     <vmcoreinfo supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <genid supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <backingStoreInput supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <backup supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <sev supported='no'/>
Aug 22 02:48:36 user nova-compute[73469]:   </features>
Aug 22 02:48:36 user nova-compute[73469]: </domainCapabilities>
Aug 22 02:48:36 user nova-compute[73469]:  {{(pid=73469) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 22 02:48:36 user nova-compute[73469]: <domainCapabilities>
Aug 22 02:48:36 user nova-compute[73469]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 22 02:48:36 user nova-compute[73469]:   <domain>kvm</domain>
Aug 22 02:48:36 user nova-compute[73469]:   <machine>pc-i440fx-jammy</machine>
Aug 22 02:48:36 user nova-compute[73469]:   <arch>x86_64</arch>
Aug 22 02:48:36 user nova-compute[73469]:   <vcpu max='255'/>
Aug 22 02:48:36 user nova-compute[73469]:   <iothreads supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:   <os supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:     <enum name='firmware'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>efi</value>
Aug 22 02:48:36 user nova-compute[73469]:     </enum>
Aug 22 02:48:36 user nova-compute[73469]:     <loader supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='type'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>rom</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>pflash</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='readonly'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>yes</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>no</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='secure'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>no</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </loader>
Aug 22 02:48:36 user nova-compute[73469]:   </os>
Aug 22 02:48:36 user nova-compute[73469]:   <cpu>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='host-passthrough' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='hostPassthroughMigratable'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>on</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>off</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='maximum' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='maximumMigratable'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>on</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>off</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='host-model' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <vendor>Intel</vendor>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ss'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='vmx'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='pcid'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='hypervisor'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='arat'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='tsc_adjust'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='umip'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='md-clear'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='stibp'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='arch-capabilities'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ssbd'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='invtsc'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ibpb'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='ibrs'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='amd-stibp'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='amd-ssbd'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='rsba'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='require' name='pschange-mc-no'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='erms'/>
Aug 22 02:48:36 user nova-compute[73469]:       <feature policy='disable' name='xsaveopt'/>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:     <mode name='custom' supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>qemu64</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>qemu32</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>phenom</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium3</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium2</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>pentium</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>n270</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>kvm64</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>kvm32</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>coreduo</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>core2duo</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>athlon</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Westmere-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Westmere</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Snowridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Skylake-Client</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>SandyBridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Penryn</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G5</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G4</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G3</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Opteron_G2</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Opteron_G1</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Nehalem</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>IvyBridge</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Icelake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Haswell</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-Rome</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-Milan</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC-IBPB</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>EPYC</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Dhyana</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cooperlake</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>Conroe</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Cascadelake-Server</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-noTSX</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell-IBRS</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='no'>Broadwell</model>
Aug 22 02:48:36 user nova-compute[73469]:       <model usable='yes'>486</model>
Aug 22 02:48:36 user nova-compute[73469]:     </mode>
Aug 22 02:48:36 user nova-compute[73469]:   </cpu>
Aug 22 02:48:36 user nova-compute[73469]:   <memoryBacking supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:     <enum name='sourceType'>
Aug 22 02:48:36 user nova-compute[73469]:       <value>file</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>anonymous</value>
Aug 22 02:48:36 user nova-compute[73469]:       <value>memfd</value>
Aug 22 02:48:36 user nova-compute[73469]:     </enum>
Aug 22 02:48:36 user nova-compute[73469]:   </memoryBacking>
Aug 22 02:48:36 user nova-compute[73469]:   <devices>
Aug 22 02:48:36 user nova-compute[73469]:     <disk supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='diskDevice'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>disk</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>cdrom</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>floppy</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>lun</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='bus'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>ide</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>fdc</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>scsi</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>usb</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>sata</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-non-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </disk>
Aug 22 02:48:36 user nova-compute[73469]:     <graphics supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='type'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>sdl</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vnc</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>spice</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>egl-headless</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </graphics>
Aug 22 02:48:36 user nova-compute[73469]:     <video supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='modelType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vga</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>cirrus</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>vmvga</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>qxl</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>none</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>bochs</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>ramfb</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </video>
Aug 22 02:48:36 user nova-compute[73469]:     <hostdev supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='mode'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>subsystem</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='startupPolicy'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>default</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>mandatory</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>requisite</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>optional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='subsysType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>usb</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>pci</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>scsi</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='capsType'/>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='pciBackend'/>
Aug 22 02:48:36 user nova-compute[73469]:     </hostdev>
Aug 22 02:48:36 user nova-compute[73469]:     <rng supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtio-non-transitional</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='backendModel'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>random</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>egd</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>builtin</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </rng>
Aug 22 02:48:36 user nova-compute[73469]:     <filesystem supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='driverType'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>path</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>handle</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>virtiofs</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </filesystem>
Aug 22 02:48:36 user nova-compute[73469]:     <tpm supported='yes'>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='model'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>tpm-tis</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>tpm-crb</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:       <enum name='backendModel'>
Aug 22 02:48:36 user nova-compute[73469]:         <value>passthrough</value>
Aug 22 02:48:36 user nova-compute[73469]:         <value>emulator</value>
Aug 22 02:48:36 user nova-compute[73469]:       </enum>
Aug 22 02:48:36 user nova-compute[73469]:     </tpm>
Aug 22 02:48:36 user nova-compute[73469]:   </devices>
Aug 22 02:48:36 user nova-compute[73469]:   <features>
Aug 22 02:48:36 user nova-compute[73469]:     <gic supported='no'/>
Aug 22 02:48:36 user nova-compute[73469]:     <vmcoreinfo supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <genid supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <backingStoreInput supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <backup supported='yes'/>
Aug 22 02:48:36 user nova-compute[73469]:     <sev supported='no'/>
Aug 22 02:48:36 user nova-compute[73469]:   </features>
Aug 22 02:48:36 user nova-compute[73469]: </domainCapabilities>
Aug 22 02:48:36 user nova-compute[73469]:  {{(pid=73469) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73469) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73469) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Checking secure boot support for host arch (x86_64) {{(pid=73469) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 22 02:48:36 user nova-compute[73469]: INFO nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Secure Boot support detected
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] cpu compare xml: <cpu match="exact">
Aug 22 02:48:36 user nova-compute[73469]:   <model>Nehalem</model>
Aug 22 02:48:36 user nova-compute[73469]: </cpu>
Aug 22 02:48:36 user nova-compute[73469]:  {{(pid=73469) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 22 02:48:36 user nova-compute[73469]: INFO nova.virt.node [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Generated node identity 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c
Aug 22 02:48:36 user nova-compute[73469]: INFO nova.virt.node [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Wrote node identity 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c to /opt/stack/data/nova/compute_id
Aug 22 02:48:36 user nova-compute[73469]: WARNING nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Compute nodes ['4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 22 02:48:36 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 22 02:48:36 user nova-compute[73469]: WARNING nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 22 02:48:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:48:36 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 02:48:37 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:48:37 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:48:37 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Hypervisor/Node resource view: name=user free_ram=10835MB free_disk=26.219127655029297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 02:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:48:37 user nova-compute[73469]: WARNING nova.compute.resource_tracker [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] No compute node record for user:4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c could not be found.
Aug 22 02:48:37 user nova-compute[73469]: INFO nova.compute.resource_tracker [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Compute node record created for user:user with uuid: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c
Aug 22 02:48:37 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 02:48:37 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 02:48:37 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [req-4aed1b24-5a61-456c-abee-f22e173b2d69] Created resource provider record via placement API for resource provider with UUID 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c and name user.
Aug 22 02:48:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73469) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 22 02:48:37 user nova-compute[73469]: INFO nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] kernel doesn't support AMD SEV
Aug 22 02:48:37 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Updating inventory in ProviderTree for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 22 02:48:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:48:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Libvirt baseline CPU <cpu>
Aug 22 02:48:37 user nova-compute[73469]:   <arch>x86_64</arch>
Aug 22 02:48:37 user nova-compute[73469]:   <model>Nehalem</model>
Aug 22 02:48:37 user nova-compute[73469]:   <vendor>Intel</vendor>
Aug 22 02:48:37 user nova-compute[73469]:   <topology sockets="6" cores="1" threads="1"/>
Aug 22 02:48:37 user nova-compute[73469]: </cpu>
Aug 22 02:48:37 user nova-compute[73469]:  {{(pid=73469) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 22 02:48:37 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Updated inventory for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 22 02:48:37 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Updating resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c generation from 0 to 1 during operation: update_inventory {{(pid=73469) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 22 02:48:37 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Updating inventory in ProviderTree for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 22 02:48:37 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Updating resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c generation from 1 to 2 during operation: update_traits {{(pid=73469) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 22 02:48:37 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 02:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:48:37 user nova-compute[73469]: DEBUG nova.service [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Creating RPC server for service compute {{(pid=73469) start /opt/stack/nova/nova/service.py:182}}
Aug 22 02:48:37 user nova-compute[73469]: DEBUG nova.service [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Join ServiceGroup membership for this service compute {{(pid=73469) start /opt/stack/nova/nova/service.py:199}}
Aug 22 02:48:37 user nova-compute[73469]: DEBUG nova.servicegroup.drivers.db [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73469) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 22 02:48:50 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:48:50 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Didn't find any instances for network info cache update. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 02:49:28 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:49:28 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:49:28 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=10253MB free_disk=26.122844696044922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 02:49:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:50:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:50:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:50:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:50:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 02:50:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 02:50:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Didn't find any instances for network info cache update. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 22 02:50:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:50:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:50:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:50:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:50:28 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 02:50:29 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:50:29 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:50:29 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=10185MB free_disk=26.169334411621094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 02:50:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:50:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:50:29 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 02:50:29 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 02:50:29 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:50:29 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:50:29 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 02:50:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:50:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:50:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:50:30 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:50:30 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:50:30 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:50:30 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:50:30 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 02:51:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:51:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 02:51:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 02:51:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Didn't find any instances for network info cache update. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 22 02:51:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:51:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:51:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:51:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:51:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:51:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:51:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:51:29 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 02:51:29 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:51:29 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:51:29 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=10210MB free_disk=25.953182220458984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 02:51:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:51:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:51:29 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 02:51:29 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 02:51:29 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:51:29 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:51:29 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 02:51:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:51:30 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:51:32 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:51:32 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:51:32 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:51:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 02:52:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:52:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 02:52:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 02:52:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Didn't find any instances for network info cache update. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 22 02:52:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:52:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:52:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:29 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 02:52:29 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:52:29 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:52:29 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=9451MB free_disk=25.976268768310547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 02:52:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:30 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 02:52:30 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 02:52:30 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:52:30 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:52:30 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 02:52:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:31 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:52:31 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:52:31 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:52:32 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:52:34 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:52:34 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:52:34 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:52:34 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 02:52:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "bda33a54-edf0-4809-9469-f1774fdc5b12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "bda33a54-edf0-4809-9469-f1774fdc5b12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "9d0668c0-7a49-4857-9b69-541021f18ab2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:37 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:52:37 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:52:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:52:37 user nova-compute[73469]: INFO nova.compute.claims [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Claim successful on node user
Aug 22 02:52:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:38 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:52:38 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:52:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:52:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.443s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:38 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:52:38 user nova-compute[73469]: INFO nova.compute.claims [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Claim successful on node user
Aug 22 02:52:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:52:38 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:52:38 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 02:52:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:52:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:52:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:52:38 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Creating image(s)
Aug 22 02:52:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "/opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "/opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "/opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:38 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:52:38 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:52:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:52:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:52:38 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:52:38 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 02:52:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:52:39 user nova-compute[73469]: DEBUG nova.policy [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7b228f99c9e4d058e128a5a99636b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9131cb883044191931dc31e51e94766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:52:39 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:52:39 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:52:39 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Creating image(s)
Aug 22 02:52:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "/opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "/opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc.part --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:39 user nova-compute[73469]: DEBUG nova.policy [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64b023ffba814ac5b6a3bc4666107767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cd52eb0f2642bc95dbf216ae280e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:52:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "dc3f5545-8ebb-4947-97d0-98a91f67e421" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:39 user nova-compute[73469]: DEBUG nova.compute.manager [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:52:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc.part --force-share --output=json" returned: 0 in 0.206s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:39 user nova-compute[73469]: DEBUG nova.virt.images [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] a2a344d0-c924-4f6a-b6e6-23be8c2d6ded was qcow2, converting to raw {{(pid=73469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 22 02:52:39 user nova-compute[73469]: DEBUG nova.privsep.utils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 22 02:52:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc.part /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc.converted {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:39 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:52:39 user nova-compute[73469]: INFO nova.compute.claims [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Claim successful on node user
Aug 22 02:52:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc.part /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc.converted" returned: 0 in 0.289s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc.converted --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:40 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:52:40 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:52:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:52:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc.converted --force-share --output=json" returned: 0 in 0.272s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.835s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:40 user nova-compute[73469]: INFO oslo.privsep.daemon [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpm27dxux4/privsep.sock']
Aug 22 02:52:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.390s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:40 user sudo[82748]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpm27dxux4/privsep.sock
Aug 22 02:52:40 user sudo[82748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 22 02:52:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:52:40 user nova-compute[73469]: DEBUG nova.network.neutron [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:52:40 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 02:52:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:52:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:52:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:52:40 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Creating image(s)
Aug 22 02:52:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "/opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "/opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:41 user nova-compute[73469]: DEBUG nova.policy [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64b023ffba814ac5b6a3bc4666107767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cd52eb0f2642bc95dbf216ae280e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:52:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Acquiring lock "759d99dd-a48e-489a-bc96-b4365b1fd17f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:52:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:41 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:52:41 user nova-compute[73469]: INFO nova.compute.claims [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Claim successful on node user
Aug 22 02:52:42 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:52:42 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:52:42 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Successfully created port: 6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:52:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:52:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:52:42 user nova-compute[73469]: DEBUG nova.network.neutron [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:52:42 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 02:52:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:52:42 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Successfully created port: 2932ec7b-1969-4b0c-8566-d4ebca4b99f7 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:52:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:52:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:52:42 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Creating image(s)
Aug 22 02:52:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Acquiring lock "/opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "/opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "/opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:42 user sudo[82748]: pam_unix(sudo:session): session closed for user root
Aug 22 02:52:42 user nova-compute[73469]: INFO oslo.privsep.daemon [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Spawned new privsep daemon via rootwrap
Aug 22 02:52:42 user nova-compute[73469]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 22 02:52:42 user nova-compute[73469]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 22 02:52:42 user nova-compute[73469]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 22 02:52:42 user nova-compute[73469]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82780
Aug 22 02:52:42 user nova-compute[73469]: WARNING oslo_privsep.priv_context [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] privsep daemon already running
Aug 22 02:52:42 user nova-compute[73469]: WARNING oslo_privsep.priv_context [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] privsep daemon already running
Aug 22 02:52:42 user nova-compute[73469]: WARNING oslo_privsep.priv_context [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] privsep daemon already running
Aug 22 02:52:42 user nova-compute[73469]: DEBUG nova.policy [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc7a13ca907b44ac805814e070afb9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb5668009ac4dc9bbce7142275795ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:52:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.192s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.194s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.245s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.219s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.188s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk 1073741824" returned: 0 in 0.058s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.216s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.181s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG nova.network.neutron [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Successfully created port: 85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.257s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk 1073741824" returned: 0 in 0.059s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.570s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Cannot resize image /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG nova.objects.instance [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'migration_context' on Instance uuid bda33a54-edf0-4809-9469-f1774fdc5b12 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Ensure instance console log exists: /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.225s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 02:52:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.228s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk 1073741824" returned: 0 in 0.061s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.842s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Cannot resize image /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG nova.objects.instance [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'migration_context' on Instance uuid dc3f5545-8ebb-4947-97d0-98a91f67e421 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Ensure instance console log exists: /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.196s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.194s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Cannot resize image /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'migration_context' on Instance uuid 9d0668c0-7a49-4857-9b69-541021f18ab2 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Ensure instance console log exists: /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/disk 1073741824" returned: 0 in 0.216s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.425s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.269s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Checking if we can resize image /opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 02:52:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Cannot resize image /opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG nova.objects.instance [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lazy-loading 'migration_context' on Instance uuid 759d99dd-a48e-489a-bc96-b4365b1fd17f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Ensure instance console log exists: /opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Successfully updated port: 6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquired lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-e3e42e4d-4735-4d8f-b4da-8258e46b856f req-a15b4fc7-614f-4fed-9193-fd6194c0ed46 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received event network-changed-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-e3e42e4d-4735-4d8f-b4da-8258e46b856f req-a15b4fc7-614f-4fed-9193-fd6194c0ed46 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Refreshing instance network info cache due to event network-changed-6148435c-1cc6-4d56-baa1-4cfb2b3924f6. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e3e42e4d-4735-4d8f-b4da-8258e46b856f req-a15b4fc7-614f-4fed-9193-fd6194c0ed46 service nova] Acquiring lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG nova.network.neutron [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Successfully updated port: 85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "refresh_cache-dc3f5545-8ebb-4947-97d0-98a91f67e421" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquired lock "refresh_cache-dc3f5545-8ebb-4947-97d0-98a91f67e421" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG nova.network.neutron [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG nova.network.neutron [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-f1a9d403-37d5-43d7-abb7-c5114c1fb373 req-95964f7a-d443-4c9b-9eb6-4227f1480442 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Received event network-changed-85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-f1a9d403-37d5-43d7-abb7-c5114c1fb373 req-95964f7a-d443-4c9b-9eb6-4227f1480442 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Refreshing instance network info cache due to event network-changed-85ef805d-a41f-4146-bbed-a2feed61c8bb. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:52:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f1a9d403-37d5-43d7-abb7-c5114c1fb373 req-95964f7a-d443-4c9b-9eb6-4227f1480442 service nova] Acquiring lock "refresh_cache-dc3f5545-8ebb-4947-97d0-98a91f67e421" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.network.neutron [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Successfully created port: d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.network.neutron [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Updating instance_info_cache with network_info: [{"id": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "address": "fa:16:3e:89:d7:b7", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ef805d-a4", "ovs_interfaceid": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Releasing lock "refresh_cache-dc3f5545-8ebb-4947-97d0-98a91f67e421" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.compute.manager [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Instance network_info: |[{"id": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "address": "fa:16:3e:89:d7:b7", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ef805d-a4", "ovs_interfaceid": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f1a9d403-37d5-43d7-abb7-c5114c1fb373 req-95964f7a-d443-4c9b-9eb6-4227f1480442 service nova] Acquired lock "refresh_cache-dc3f5545-8ebb-4947-97d0-98a91f67e421" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.network.neutron [req-f1a9d403-37d5-43d7-abb7-c5114c1fb373 req-95964f7a-d443-4c9b-9eb6-4227f1480442 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Refreshing network info cache for port 85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Start _get_guest_xml network_info=[{"id": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "address": "fa:16:3e:89:d7:b7", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ef805d-a4", "ovs_interfaceid": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:52:46 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:52:46 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Successfully updated port: 2932ec7b-1969-4b0c-8566-d4ebca4b99f7 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "refresh_cache-bda33a54-edf0-4809-9469-f1774fdc5b12" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquired lock "refresh_cache-bda33a54-edf0-4809-9469-f1774fdc5b12" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.privsep.utils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:52:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-393165444',display_name='tempest-ServerRescueNegativeTestJSON-server-393165444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-393165444',id=3,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46cd52eb0f2642bc95dbf216ae280e12',ramdisk_id='',reservation_id='r-odxnfkyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2020570120',owner_user_name='tempest-ServerRescueNegativeTestJSON-2020570120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:52:41Z,user_data=None,user_id='64b023ffba814ac5b6a3bc4666107767',uuid=dc3f5545-8ebb-4947-97d0-98a91f67e421,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "address": "fa:16:3e:89:d7:b7", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ef805d-a4", "ovs_interfaceid": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converting VIF {"id": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "address": "fa:16:3e:89:d7:b7", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ef805d-a4", "ovs_interfaceid": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:d7:b7,bridge_name='br-int',has_traffic_filtering=True,id=85ef805d-a41f-4146-bbed-a2feed61c8bb,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ef805d-a4') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.objects.instance [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'pci_devices' on Instance uuid dc3f5545-8ebb-4947-97d0-98a91f67e421 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Updating instance_info_cache with network_info: [{"id": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "address": "fa:16:3e:8e:27:47", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6148435c-1c", "ovs_interfaceid": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:52:46 user nova-compute[73469]:   <uuid>dc3f5545-8ebb-4947-97d0-98a91f67e421</uuid>
Aug 22 02:52:46 user nova-compute[73469]:   <name>instance-00000003</name>
Aug 22 02:52:46 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:52:46 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:52:46 user nova-compute[73469]:   <metadata>
Aug 22 02:52:46 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:52:46 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:52:46 user nova-compute[73469]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-393165444</nova:name>
Aug 22 02:52:46 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:52:46</nova:creationTime>
Aug 22 02:52:46 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:52:46 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:52:46 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:52:46 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:52:46 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:52:46 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:52:46 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:52:46 user nova-compute[73469]:       <nova:owner>
Aug 22 02:52:46 user nova-compute[73469]:         <nova:user uuid="64b023ffba814ac5b6a3bc4666107767">tempest-ServerRescueNegativeTestJSON-2020570120-project-member</nova:user>
Aug 22 02:52:46 user nova-compute[73469]:         <nova:project uuid="46cd52eb0f2642bc95dbf216ae280e12">tempest-ServerRescueNegativeTestJSON-2020570120</nova:project>
Aug 22 02:52:46 user nova-compute[73469]:       </nova:owner>
Aug 22 02:52:46 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:52:46 user nova-compute[73469]:       <nova:ports>
Aug 22 02:52:46 user nova-compute[73469]:         <nova:port uuid="85ef805d-a41f-4146-bbed-a2feed61c8bb">
Aug 22 02:52:46 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 22 02:52:46 user nova-compute[73469]:         </nova:port>
Aug 22 02:52:46 user nova-compute[73469]:       </nova:ports>
Aug 22 02:52:46 user nova-compute[73469]:     </nova:instance>
Aug 22 02:52:46 user nova-compute[73469]:   </metadata>
Aug 22 02:52:46 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:52:46 user nova-compute[73469]:     <system>
Aug 22 02:52:46 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:52:46 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:52:46 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:52:46 user nova-compute[73469]:       <entry name="serial">dc3f5545-8ebb-4947-97d0-98a91f67e421</entry>
Aug 22 02:52:46 user nova-compute[73469]:       <entry name="uuid">dc3f5545-8ebb-4947-97d0-98a91f67e421</entry>
Aug 22 02:52:46 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:52:46 user nova-compute[73469]:     </system>
Aug 22 02:52:46 user nova-compute[73469]:   </sysinfo>
Aug 22 02:52:46 user nova-compute[73469]:   <os>
Aug 22 02:52:46 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:52:46 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:52:46 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:52:46 user nova-compute[73469]:   </os>
Aug 22 02:52:46 user nova-compute[73469]:   <features>
Aug 22 02:52:46 user nova-compute[73469]:     <acpi/>
Aug 22 02:52:46 user nova-compute[73469]:     <apic/>
Aug 22 02:52:46 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:52:46 user nova-compute[73469]:   </features>
Aug 22 02:52:46 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:52:46 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:52:46 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:52:46 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:52:46 user nova-compute[73469]:   </clock>
Aug 22 02:52:46 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:52:46 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:52:46 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:52:46 user nova-compute[73469]:   </cpu>
Aug 22 02:52:46 user nova-compute[73469]:   <devices>
Aug 22 02:52:46 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:52:46 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:52:46 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk"/>
Aug 22 02:52:46 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:52:46 user nova-compute[73469]:     </disk>
Aug 22 02:52:46 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:52:46 user nova-compute[73469]:       <mac address="fa:16:3e:89:d7:b7"/>
Aug 22 02:52:46 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:52:46 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:52:46 user nova-compute[73469]:       <target dev="tap85ef805d-a4"/>
Aug 22 02:52:46 user nova-compute[73469]:     </interface>
Aug 22 02:52:46 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:52:46 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/console.log" append="off"/>
Aug 22 02:52:46 user nova-compute[73469]:     </serial>
Aug 22 02:52:46 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:52:46 user nova-compute[73469]:     <video>
Aug 22 02:52:46 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:52:46 user nova-compute[73469]:     </video>
Aug 22 02:52:46 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:52:46 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:52:46 user nova-compute[73469]:     </rng>
Aug 22 02:52:46 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:52:46 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:52:46 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:52:46 user nova-compute[73469]:     </memballoon>
Aug 22 02:52:46 user nova-compute[73469]:   </devices>
Aug 22 02:52:46 user nova-compute[73469]: </domain>
Aug 22 02:52:46 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:52:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-393165444',display_name='tempest-ServerRescueNegativeTestJSON-server-393165444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-393165444',id=3,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46cd52eb0f2642bc95dbf216ae280e12',ramdisk_id='',reservation_id='r-odxnfkyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2020570120',owner_user_name='tempest-ServerRescueNegativeTestJSON-2020570120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:52:41Z,user_data=None,user_id='64b023ffba814ac5b6a3bc4666107767',uuid=dc3f5545-8ebb-4947-97d0-98a91f67e421,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "address": "fa:16:3e:89:d7:b7", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ef805d-a4", "ovs_interfaceid": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converting VIF {"id": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "address": "fa:16:3e:89:d7:b7", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ef805d-a4", "ovs_interfaceid": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:d7:b7,bridge_name='br-int',has_traffic_filtering=True,id=85ef805d-a41f-4146-bbed-a2feed61c8bb,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ef805d-a4') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG os_vif [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:d7:b7,bridge_name='br-int',has_traffic_filtering=True,id=85ef805d-a41f-4146-bbed-a2feed61c8bb,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ef805d-a4') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Releasing lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Instance network_info: |[{"id": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "address": "fa:16:3e:8e:27:47", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6148435c-1c", "ovs_interfaceid": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Created schema index Interface.name {{(pid=73469) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Created schema index Port.name {{(pid=73469) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Created schema index Bridge.name {{(pid=73469) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e3e42e4d-4735-4d8f-b4da-8258e46b856f req-a15b4fc7-614f-4fed-9193-fd6194c0ed46 service nova] Acquired lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.network.neutron [req-e3e42e4d-4735-4d8f-b4da-8258e46b856f req-a15b4fc7-614f-4fed-9193-fd6194c0ed46 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Refreshing network info cache for port 6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Start _get_guest_xml network_info=[{"id": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "address": "fa:16:3e:8e:27:47", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6148435c-1c", "ovs_interfaceid": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [POLLOUT] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:52:47 user nova-compute[73469]: INFO oslo.privsep.daemon [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpm_yj_o3j/privsep.sock']
Aug 22 02:52:47 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:52:47 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:52:47 user sudo[82854]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpm_yj_o3j/privsep.sock
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:52:47 user sudo[82854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1254960621',display_name='tempest-ServerRescueNegativeTestJSON-server-1254960621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1254960621',id=2,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46cd52eb0f2642bc95dbf216ae280e12',ramdisk_id='',reservation_id='r-ijl84rjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2020570120',owner_user_name='tempest-ServerRescueNegativeTestJSON-2020570120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:52:39Z,user_data=None,user_id='64b023ffba814ac5b6a3bc4666107767',uuid=9d0668c0-7a49-4857-9b69-541021f18ab2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "address": "fa:16:3e:8e:27:47", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6148435c-1c", "ovs_interfaceid": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converting VIF {"id": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "address": "fa:16:3e:8e:27:47", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6148435c-1c", "ovs_interfaceid": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:27:47,bridge_name='br-int',has_traffic_filtering=True,id=6148435c-1cc6-4d56-baa1-4cfb2b3924f6,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6148435c-1c') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d0668c0-7a49-4857-9b69-541021f18ab2 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.compute.manager [req-44b1da58-e33c-4fa8-a2de-74b70b4c96f5 req-9a353f29-bd51-4839-9f28-e6cbc9faa183 service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Received event network-changed-2932ec7b-1969-4b0c-8566-d4ebca4b99f7 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.compute.manager [req-44b1da58-e33c-4fa8-a2de-74b70b4c96f5 req-9a353f29-bd51-4839-9f28-e6cbc9faa183 service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Refreshing instance network info cache due to event network-changed-2932ec7b-1969-4b0c-8566-d4ebca4b99f7. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-44b1da58-e33c-4fa8-a2de-74b70b4c96f5 req-9a353f29-bd51-4839-9f28-e6cbc9faa183 service nova] Acquiring lock "refresh_cache-bda33a54-edf0-4809-9469-f1774fdc5b12" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:52:47 user nova-compute[73469]:   <uuid>9d0668c0-7a49-4857-9b69-541021f18ab2</uuid>
Aug 22 02:52:47 user nova-compute[73469]:   <name>instance-00000002</name>
Aug 22 02:52:47 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:52:47 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:52:47 user nova-compute[73469]:   <metadata>
Aug 22 02:52:47 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:52:47 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:52:47 user nova-compute[73469]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1254960621</nova:name>
Aug 22 02:52:47 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:52:47</nova:creationTime>
Aug 22 02:52:47 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:52:47 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:52:47 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:52:47 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:52:47 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:52:47 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:52:47 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:52:47 user nova-compute[73469]:       <nova:owner>
Aug 22 02:52:47 user nova-compute[73469]:         <nova:user uuid="64b023ffba814ac5b6a3bc4666107767">tempest-ServerRescueNegativeTestJSON-2020570120-project-member</nova:user>
Aug 22 02:52:47 user nova-compute[73469]:         <nova:project uuid="46cd52eb0f2642bc95dbf216ae280e12">tempest-ServerRescueNegativeTestJSON-2020570120</nova:project>
Aug 22 02:52:47 user nova-compute[73469]:       </nova:owner>
Aug 22 02:52:47 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:52:47 user nova-compute[73469]:       <nova:ports>
Aug 22 02:52:47 user nova-compute[73469]:         <nova:port uuid="6148435c-1cc6-4d56-baa1-4cfb2b3924f6">
Aug 22 02:52:47 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 22 02:52:47 user nova-compute[73469]:         </nova:port>
Aug 22 02:52:47 user nova-compute[73469]:       </nova:ports>
Aug 22 02:52:47 user nova-compute[73469]:     </nova:instance>
Aug 22 02:52:47 user nova-compute[73469]:   </metadata>
Aug 22 02:52:47 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:52:47 user nova-compute[73469]:     <system>
Aug 22 02:52:47 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:52:47 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:52:47 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:52:47 user nova-compute[73469]:       <entry name="serial">9d0668c0-7a49-4857-9b69-541021f18ab2</entry>
Aug 22 02:52:47 user nova-compute[73469]:       <entry name="uuid">9d0668c0-7a49-4857-9b69-541021f18ab2</entry>
Aug 22 02:52:47 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:52:47 user nova-compute[73469]:     </system>
Aug 22 02:52:47 user nova-compute[73469]:   </sysinfo>
Aug 22 02:52:47 user nova-compute[73469]:   <os>
Aug 22 02:52:47 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:52:47 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:52:47 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:52:47 user nova-compute[73469]:   </os>
Aug 22 02:52:47 user nova-compute[73469]:   <features>
Aug 22 02:52:47 user nova-compute[73469]:     <acpi/>
Aug 22 02:52:47 user nova-compute[73469]:     <apic/>
Aug 22 02:52:47 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:52:47 user nova-compute[73469]:   </features>
Aug 22 02:52:47 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:52:47 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:52:47 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:52:47 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:52:47 user nova-compute[73469]:   </clock>
Aug 22 02:52:47 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:52:47 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:52:47 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:52:47 user nova-compute[73469]:   </cpu>
Aug 22 02:52:47 user nova-compute[73469]:   <devices>
Aug 22 02:52:47 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:52:47 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:52:47 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk"/>
Aug 22 02:52:47 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:52:47 user nova-compute[73469]:     </disk>
Aug 22 02:52:47 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:52:47 user nova-compute[73469]:       <mac address="fa:16:3e:8e:27:47"/>
Aug 22 02:52:47 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:52:47 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:52:47 user nova-compute[73469]:       <target dev="tap6148435c-1c"/>
Aug 22 02:52:47 user nova-compute[73469]:     </interface>
Aug 22 02:52:47 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:52:47 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/console.log" append="off"/>
Aug 22 02:52:47 user nova-compute[73469]:     </serial>
Aug 22 02:52:47 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:52:47 user nova-compute[73469]:     <video>
Aug 22 02:52:47 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:52:47 user nova-compute[73469]:     </video>
Aug 22 02:52:47 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:52:47 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:52:47 user nova-compute[73469]:     </rng>
Aug 22 02:52:47 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:52:47 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:52:47 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:52:47 user nova-compute[73469]:     </memballoon>
Aug 22 02:52:47 user nova-compute[73469]:   </devices>
Aug 22 02:52:47 user nova-compute[73469]: </domain>
Aug 22 02:52:47 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1254960621',display_name='tempest-ServerRescueNegativeTestJSON-server-1254960621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1254960621',id=2,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46cd52eb0f2642bc95dbf216ae280e12',ramdisk_id='',reservation_id='r-ijl84rjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2020570120',owner_user_name='tempest-ServerRescueNegativeTestJSON-2020570120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:52:39Z,user_data=None,user_id='64b023ffba814ac5b6a3bc4666107767',uuid=9d0668c0-7a49-4857-9b69-541021f18ab2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "address": "fa:16:3e:8e:27:47", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6148435c-1c", "ovs_interfaceid": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converting VIF {"id": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "address": "fa:16:3e:8e:27:47", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6148435c-1c", "ovs_interfaceid": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:27:47,bridge_name='br-int',has_traffic_filtering=True,id=6148435c-1cc6-4d56-baa1-4cfb2b3924f6,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6148435c-1c') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG os_vif [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:27:47,bridge_name='br-int',has_traffic_filtering=True,id=6148435c-1cc6-4d56-baa1-4cfb2b3924f6,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6148435c-1c') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:52:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Updating instance_info_cache with network_info: [{"id": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "address": "fa:16:3e:bb:16:09", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2932ec7b-19", "ovs_interfaceid": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Releasing lock "refresh_cache-bda33a54-edf0-4809-9469-f1774fdc5b12" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Instance network_info: |[{"id": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "address": "fa:16:3e:bb:16:09", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2932ec7b-19", "ovs_interfaceid": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-44b1da58-e33c-4fa8-a2de-74b70b4c96f5 req-9a353f29-bd51-4839-9f28-e6cbc9faa183 service nova] Acquired lock "refresh_cache-bda33a54-edf0-4809-9469-f1774fdc5b12" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.network.neutron [req-44b1da58-e33c-4fa8-a2de-74b70b4c96f5 req-9a353f29-bd51-4839-9f28-e6cbc9faa183 service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Refreshing network info cache for port 2932ec7b-1969-4b0c-8566-d4ebca4b99f7 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Start _get_guest_xml network_info=[{"id": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "address": "fa:16:3e:bb:16:09", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2932ec7b-19", "ovs_interfaceid": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:52:48 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:52:48 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-718399569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-718399569',id=1,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9131cb883044191931dc31e51e94766',ramdisk_id='',reservation_id='r-o5r9oly0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568629509',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:52:38Z,user_data=None,user_id='a7b228f99c9e4d058e128a5a99636b7b',uuid=bda33a54-edf0-4809-9469-f1774fdc5b12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "address": "fa:16:3e:bb:16:09", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2932ec7b-19", "ovs_interfaceid": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converting VIF {"id": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "address": "fa:16:3e:bb:16:09", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2932ec7b-19", "ovs_interfaceid": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:16:09,bridge_name='br-int',has_traffic_filtering=True,id=2932ec7b-1969-4b0c-8566-d4ebca4b99f7,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2932ec7b-19') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.objects.instance [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'pci_devices' on Instance uuid bda33a54-edf0-4809-9469-f1774fdc5b12 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.network.neutron [req-e3e42e4d-4735-4d8f-b4da-8258e46b856f req-a15b4fc7-614f-4fed-9193-fd6194c0ed46 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Updated VIF entry in instance network info cache for port 6148435c-1cc6-4d56-baa1-4cfb2b3924f6. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.network.neutron [req-e3e42e4d-4735-4d8f-b4da-8258e46b856f req-a15b4fc7-614f-4fed-9193-fd6194c0ed46 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Updating instance_info_cache with network_info: [{"id": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "address": "fa:16:3e:8e:27:47", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6148435c-1c", "ovs_interfaceid": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.network.neutron [req-f1a9d403-37d5-43d7-abb7-c5114c1fb373 req-95964f7a-d443-4c9b-9eb6-4227f1480442 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Updated VIF entry in instance network info cache for port 85ef805d-a41f-4146-bbed-a2feed61c8bb. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.network.neutron [req-f1a9d403-37d5-43d7-abb7-c5114c1fb373 req-95964f7a-d443-4c9b-9eb6-4227f1480442 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Updating instance_info_cache with network_info: [{"id": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "address": "fa:16:3e:89:d7:b7", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ef805d-a4", "ovs_interfaceid": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:52:48 user nova-compute[73469]:   <uuid>bda33a54-edf0-4809-9469-f1774fdc5b12</uuid>
Aug 22 02:52:48 user nova-compute[73469]:   <name>instance-00000001</name>
Aug 22 02:52:48 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:52:48 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:52:48 user nova-compute[73469]:   <metadata>
Aug 22 02:52:48 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:52:48 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:52:48 user nova-compute[73469]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-718399569</nova:name>
Aug 22 02:52:48 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:52:48</nova:creationTime>
Aug 22 02:52:48 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:52:48 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:52:48 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:52:48 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:52:48 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:52:48 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:52:48 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:52:48 user nova-compute[73469]:       <nova:owner>
Aug 22 02:52:48 user nova-compute[73469]:         <nova:user uuid="a7b228f99c9e4d058e128a5a99636b7b">tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member</nova:user>
Aug 22 02:52:48 user nova-compute[73469]:         <nova:project uuid="c9131cb883044191931dc31e51e94766">tempest-ServerBootFromVolumeStableRescueTest-568629509</nova:project>
Aug 22 02:52:48 user nova-compute[73469]:       </nova:owner>
Aug 22 02:52:48 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:52:48 user nova-compute[73469]:       <nova:ports>
Aug 22 02:52:48 user nova-compute[73469]:         <nova:port uuid="2932ec7b-1969-4b0c-8566-d4ebca4b99f7">
Aug 22 02:52:48 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 22 02:52:48 user nova-compute[73469]:         </nova:port>
Aug 22 02:52:48 user nova-compute[73469]:       </nova:ports>
Aug 22 02:52:48 user nova-compute[73469]:     </nova:instance>
Aug 22 02:52:48 user nova-compute[73469]:   </metadata>
Aug 22 02:52:48 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:52:48 user nova-compute[73469]:     <system>
Aug 22 02:52:48 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:52:48 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:52:48 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:52:48 user nova-compute[73469]:       <entry name="serial">bda33a54-edf0-4809-9469-f1774fdc5b12</entry>
Aug 22 02:52:48 user nova-compute[73469]:       <entry name="uuid">bda33a54-edf0-4809-9469-f1774fdc5b12</entry>
Aug 22 02:52:48 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:52:48 user nova-compute[73469]:     </system>
Aug 22 02:52:48 user nova-compute[73469]:   </sysinfo>
Aug 22 02:52:48 user nova-compute[73469]:   <os>
Aug 22 02:52:48 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:52:48 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:52:48 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:52:48 user nova-compute[73469]:   </os>
Aug 22 02:52:48 user nova-compute[73469]:   <features>
Aug 22 02:52:48 user nova-compute[73469]:     <acpi/>
Aug 22 02:52:48 user nova-compute[73469]:     <apic/>
Aug 22 02:52:48 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:52:48 user nova-compute[73469]:   </features>
Aug 22 02:52:48 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:52:48 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:52:48 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:52:48 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:52:48 user nova-compute[73469]:   </clock>
Aug 22 02:52:48 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:52:48 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:52:48 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:52:48 user nova-compute[73469]:   </cpu>
Aug 22 02:52:48 user nova-compute[73469]:   <devices>
Aug 22 02:52:48 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:52:48 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:52:48 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk"/>
Aug 22 02:52:48 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:52:48 user nova-compute[73469]:     </disk>
Aug 22 02:52:48 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:52:48 user nova-compute[73469]:       <mac address="fa:16:3e:bb:16:09"/>
Aug 22 02:52:48 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:52:48 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:52:48 user nova-compute[73469]:       <target dev="tap2932ec7b-19"/>
Aug 22 02:52:48 user nova-compute[73469]:     </interface>
Aug 22 02:52:48 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:52:48 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/console.log" append="off"/>
Aug 22 02:52:48 user nova-compute[73469]:     </serial>
Aug 22 02:52:48 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:52:48 user nova-compute[73469]:     <video>
Aug 22 02:52:48 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:52:48 user nova-compute[73469]:     </video>
Aug 22 02:52:48 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:52:48 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:52:48 user nova-compute[73469]:     </rng>
Aug 22 02:52:48 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:52:48 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:52:48 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:52:48 user nova-compute[73469]:     </memballoon>
Aug 22 02:52:48 user nova-compute[73469]:   </devices>
Aug 22 02:52:48 user nova-compute[73469]: </domain>
Aug 22 02:52:48 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-718399569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-718399569',id=1,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9131cb883044191931dc31e51e94766',ramdisk_id='',reservation_id='r-o5r9oly0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568629509',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:52:38Z,user_data=None,user_id='a7b228f99c9e4d058e128a5a99636b7b',uuid=bda33a54-edf0-4809-9469-f1774fdc5b12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "address": "fa:16:3e:bb:16:09", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2932ec7b-19", "ovs_interfaceid": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converting VIF {"id": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "address": "fa:16:3e:bb:16:09", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2932ec7b-19", "ovs_interfaceid": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:16:09,bridge_name='br-int',has_traffic_filtering=True,id=2932ec7b-1969-4b0c-8566-d4ebca4b99f7,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2932ec7b-19') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG os_vif [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:16:09,bridge_name='br-int',has_traffic_filtering=True,id=2932ec7b-1969-4b0c-8566-d4ebca4b99f7,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2932ec7b-19') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e3e42e4d-4735-4d8f-b4da-8258e46b856f req-a15b4fc7-614f-4fed-9193-fd6194c0ed46 service nova] Releasing lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:52:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f1a9d403-37d5-43d7-abb7-c5114c1fb373 req-95964f7a-d443-4c9b-9eb6-4227f1480442 service nova] Releasing lock "refresh_cache-dc3f5545-8ebb-4947-97d0-98a91f67e421" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:52:49 user sudo[82854]: pam_unix(sudo:session): session closed for user root
Aug 22 02:52:49 user nova-compute[73469]: INFO oslo.privsep.daemon [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Spawned new privsep daemon via rootwrap
Aug 22 02:52:49 user nova-compute[73469]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 22 02:52:49 user nova-compute[73469]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 22 02:52:49 user nova-compute[73469]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 22 02:52:49 user nova-compute[73469]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82862
Aug 22 02:52:49 user nova-compute[73469]: WARNING oslo_privsep.priv_context [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] privsep daemon already running
Aug 22 02:52:49 user nova-compute[73469]: WARNING oslo_privsep.priv_context [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] privsep daemon already running
Aug 22 02:52:49 user nova-compute[73469]: DEBUG nova.network.neutron [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Successfully updated port: d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Acquiring lock "refresh_cache-759d99dd-a48e-489a-bc96-b4365b1fd17f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Acquired lock "refresh_cache-759d99dd-a48e-489a-bc96-b4365b1fd17f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG nova.network.neutron [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-c423786f-e34e-4b0f-9123-70d80e9779b4 req-feb5f9a4-55cb-4b9e-bb59-f2349b79f50b service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Received event network-changed-d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-c423786f-e34e-4b0f-9123-70d80e9779b4 req-feb5f9a4-55cb-4b9e-bb59-f2349b79f50b service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Refreshing instance network info cache due to event network-changed-d38956d2-634a-4523-9111-e113654418ad. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c423786f-e34e-4b0f-9123-70d80e9779b4 req-feb5f9a4-55cb-4b9e-bb59-f2349b79f50b service nova] Acquiring lock "refresh_cache-759d99dd-a48e-489a-bc96-b4365b1fd17f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG nova.network.neutron [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85ef805d-a4, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85ef805d-a4, col_values=(('external_ids', {'iface-id': '85ef805d-a41f-4146-bbed-a2feed61c8bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:d7:b7', 'vm-uuid': 'dc3f5545-8ebb-4947-97d0-98a91f67e421'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:49 user nova-compute[73469]: INFO os_vif [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:d7:b7,bridge_name='br-int',has_traffic_filtering=True,id=85ef805d-a41f-4146-bbed-a2feed61c8bb,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ef805d-a4')
Aug 22 02:52:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6148435c-1c, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6148435c-1c, col_values=(('external_ids', {'iface-id': '6148435c-1cc6-4d56-baa1-4cfb2b3924f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:27:47', 'vm-uuid': '9d0668c0-7a49-4857-9b69-541021f18ab2'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:49 user nova-compute[73469]: INFO os_vif [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:27:47,bridge_name='br-int',has_traffic_filtering=True,id=6148435c-1cc6-4d56-baa1-4cfb2b3924f6,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6148435c-1c')
Aug 22 02:52:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2932ec7b-19, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2932ec7b-19, col_values=(('external_ids', {'iface-id': '2932ec7b-1969-4b0c-8566-d4ebca4b99f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:16:09', 'vm-uuid': 'bda33a54-edf0-4809-9469-f1774fdc5b12'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:49 user nova-compute[73469]: INFO os_vif [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:16:09,bridge_name='br-int',has_traffic_filtering=True,id=2932ec7b-1969-4b0c-8566-d4ebca4b99f7,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2932ec7b-19')
Aug 22 02:52:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] No VIF found with MAC fa:16:3e:89:d7:b7, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] No VIF found with MAC fa:16:3e:8e:27:47, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:52:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] No VIF found with MAC fa:16:3e:bb:16:09, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.network.neutron [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Updating instance_info_cache with network_info: [{"id": "d38956d2-634a-4523-9111-e113654418ad", "address": "fa:16:3e:cc:8b:35", "network": {"id": "a7b64e12-abb3-4a23-87ea-1991927b957d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214261658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb5668009ac4dc9bbce7142275795ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38956d2-63", "ovs_interfaceid": "d38956d2-634a-4523-9111-e113654418ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Releasing lock "refresh_cache-759d99dd-a48e-489a-bc96-b4365b1fd17f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Instance network_info: |[{"id": "d38956d2-634a-4523-9111-e113654418ad", "address": "fa:16:3e:cc:8b:35", "network": {"id": "a7b64e12-abb3-4a23-87ea-1991927b957d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214261658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb5668009ac4dc9bbce7142275795ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38956d2-63", "ovs_interfaceid": "d38956d2-634a-4523-9111-e113654418ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c423786f-e34e-4b0f-9123-70d80e9779b4 req-feb5f9a4-55cb-4b9e-bb59-f2349b79f50b service nova] Acquired lock "refresh_cache-759d99dd-a48e-489a-bc96-b4365b1fd17f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.network.neutron [req-c423786f-e34e-4b0f-9123-70d80e9779b4 req-feb5f9a4-55cb-4b9e-bb59-f2349b79f50b service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Refreshing network info cache for port d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Start _get_guest_xml network_info=[{"id": "d38956d2-634a-4523-9111-e113654418ad", "address": "fa:16:3e:cc:8b:35", "network": {"id": "a7b64e12-abb3-4a23-87ea-1991927b957d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214261658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb5668009ac4dc9bbce7142275795ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38956d2-63", "ovs_interfaceid": "d38956d2-634a-4523-9111-e113654418ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:52:50 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:52:50 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1632433254',display_name='tempest-DeleteServersTestJSON-server-1632433254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1632433254',id=4,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fb5668009ac4dc9bbce7142275795ad',ramdisk_id='',reservation_id='r-ufp9nxti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1883805460',owner_user_name='tempest-DeleteServersTestJSON-1883805460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:52:43Z,user_data=None,user_id='cc7a13ca907b44ac805814e070afb9d1',uuid=759d99dd-a48e-489a-bc96-b4365b1fd17f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d38956d2-634a-4523-9111-e113654418ad", "address": "fa:16:3e:cc:8b:35", "network": {"id": "a7b64e12-abb3-4a23-87ea-1991927b957d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214261658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb5668009ac4dc9bbce7142275795ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38956d2-63", "ovs_interfaceid": "d38956d2-634a-4523-9111-e113654418ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Converting VIF {"id": "d38956d2-634a-4523-9111-e113654418ad", "address": "fa:16:3e:cc:8b:35", "network": {"id": "a7b64e12-abb3-4a23-87ea-1991927b957d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214261658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb5668009ac4dc9bbce7142275795ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38956d2-63", "ovs_interfaceid": "d38956d2-634a-4523-9111-e113654418ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:8b:35,bridge_name='br-int',has_traffic_filtering=True,id=d38956d2-634a-4523-9111-e113654418ad,network=Network(a7b64e12-abb3-4a23-87ea-1991927b957d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38956d2-63') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.objects.instance [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lazy-loading 'pci_devices' on Instance uuid 759d99dd-a48e-489a-bc96-b4365b1fd17f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:52:50 user nova-compute[73469]:   <uuid>759d99dd-a48e-489a-bc96-b4365b1fd17f</uuid>
Aug 22 02:52:50 user nova-compute[73469]:   <name>instance-00000004</name>
Aug 22 02:52:50 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:52:50 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:52:50 user nova-compute[73469]:   <metadata>
Aug 22 02:52:50 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:52:50 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:52:50 user nova-compute[73469]:       <nova:name>tempest-DeleteServersTestJSON-server-1632433254</nova:name>
Aug 22 02:52:50 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:52:50</nova:creationTime>
Aug 22 02:52:50 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:52:50 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:52:50 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:52:50 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:52:50 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:52:50 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:52:50 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:52:50 user nova-compute[73469]:       <nova:owner>
Aug 22 02:52:50 user nova-compute[73469]:         <nova:user uuid="cc7a13ca907b44ac805814e070afb9d1">tempest-DeleteServersTestJSON-1883805460-project-member</nova:user>
Aug 22 02:52:50 user nova-compute[73469]:         <nova:project uuid="3fb5668009ac4dc9bbce7142275795ad">tempest-DeleteServersTestJSON-1883805460</nova:project>
Aug 22 02:52:50 user nova-compute[73469]:       </nova:owner>
Aug 22 02:52:50 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:52:50 user nova-compute[73469]:       <nova:ports>
Aug 22 02:52:50 user nova-compute[73469]:         <nova:port uuid="d38956d2-634a-4523-9111-e113654418ad">
Aug 22 02:52:50 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 22 02:52:50 user nova-compute[73469]:         </nova:port>
Aug 22 02:52:50 user nova-compute[73469]:       </nova:ports>
Aug 22 02:52:50 user nova-compute[73469]:     </nova:instance>
Aug 22 02:52:50 user nova-compute[73469]:   </metadata>
Aug 22 02:52:50 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:52:50 user nova-compute[73469]:     <system>
Aug 22 02:52:50 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:52:50 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:52:50 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:52:50 user nova-compute[73469]:       <entry name="serial">759d99dd-a48e-489a-bc96-b4365b1fd17f</entry>
Aug 22 02:52:50 user nova-compute[73469]:       <entry name="uuid">759d99dd-a48e-489a-bc96-b4365b1fd17f</entry>
Aug 22 02:52:50 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:52:50 user nova-compute[73469]:     </system>
Aug 22 02:52:50 user nova-compute[73469]:   </sysinfo>
Aug 22 02:52:50 user nova-compute[73469]:   <os>
Aug 22 02:52:50 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:52:50 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:52:50 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:52:50 user nova-compute[73469]:   </os>
Aug 22 02:52:50 user nova-compute[73469]:   <features>
Aug 22 02:52:50 user nova-compute[73469]:     <acpi/>
Aug 22 02:52:50 user nova-compute[73469]:     <apic/>
Aug 22 02:52:50 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:52:50 user nova-compute[73469]:   </features>
Aug 22 02:52:50 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:52:50 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:52:50 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:52:50 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:52:50 user nova-compute[73469]:   </clock>
Aug 22 02:52:50 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:52:50 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:52:50 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:52:50 user nova-compute[73469]:   </cpu>
Aug 22 02:52:50 user nova-compute[73469]:   <devices>
Aug 22 02:52:50 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:52:50 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:52:50 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/disk"/>
Aug 22 02:52:50 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:52:50 user nova-compute[73469]:     </disk>
Aug 22 02:52:50 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:52:50 user nova-compute[73469]:       <mac address="fa:16:3e:cc:8b:35"/>
Aug 22 02:52:50 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:52:50 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:52:50 user nova-compute[73469]:       <target dev="tapd38956d2-63"/>
Aug 22 02:52:50 user nova-compute[73469]:     </interface>
Aug 22 02:52:50 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:52:50 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/console.log" append="off"/>
Aug 22 02:52:50 user nova-compute[73469]:     </serial>
Aug 22 02:52:50 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:52:50 user nova-compute[73469]:     <video>
Aug 22 02:52:50 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:52:50 user nova-compute[73469]:     </video>
Aug 22 02:52:50 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:52:50 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:52:50 user nova-compute[73469]:     </rng>
Aug 22 02:52:50 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:52:50 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:52:50 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:52:50 user nova-compute[73469]:     </memballoon>
Aug 22 02:52:50 user nova-compute[73469]:   </devices>
Aug 22 02:52:50 user nova-compute[73469]: </domain>
Aug 22 02:52:50 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1632433254',display_name='tempest-DeleteServersTestJSON-server-1632433254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1632433254',id=4,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fb5668009ac4dc9bbce7142275795ad',ramdisk_id='',reservation_id='r-ufp9nxti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1883805460',owner_user_name='tempest-DeleteServersTestJSON-1883805460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:52:43Z,user_data=None,user_id='cc7a13ca907b44ac805814e070afb9d1',uuid=759d99dd-a48e-489a-bc96-b4365b1fd17f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d38956d2-634a-4523-9111-e113654418ad", "address": "fa:16:3e:cc:8b:35", "network": {"id": "a7b64e12-abb3-4a23-87ea-1991927b957d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214261658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb5668009ac4dc9bbce7142275795ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38956d2-63", "ovs_interfaceid": "d38956d2-634a-4523-9111-e113654418ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Converting VIF {"id": "d38956d2-634a-4523-9111-e113654418ad", "address": "fa:16:3e:cc:8b:35", "network": {"id": "a7b64e12-abb3-4a23-87ea-1991927b957d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214261658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb5668009ac4dc9bbce7142275795ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38956d2-63", "ovs_interfaceid": "d38956d2-634a-4523-9111-e113654418ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:8b:35,bridge_name='br-int',has_traffic_filtering=True,id=d38956d2-634a-4523-9111-e113654418ad,network=Network(a7b64e12-abb3-4a23-87ea-1991927b957d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38956d2-63') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG os_vif [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:8b:35,bridge_name='br-int',has_traffic_filtering=True,id=d38956d2-634a-4523-9111-e113654418ad,network=Network(a7b64e12-abb3-4a23-87ea-1991927b957d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38956d2-63') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd38956d2-63, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd38956d2-63, col_values=(('external_ids', {'iface-id': 'd38956d2-634a-4523-9111-e113654418ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:8b:35', 'vm-uuid': '759d99dd-a48e-489a-bc96-b4365b1fd17f'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:50 user nova-compute[73469]: INFO os_vif [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:8b:35,bridge_name='br-int',has_traffic_filtering=True,id=d38956d2-634a-4523-9111-e113654418ad,network=Network(a7b64e12-abb3-4a23-87ea-1991927b957d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38956d2-63')
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] No VIF found with MAC fa:16:3e:cc:8b:35, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.network.neutron [req-44b1da58-e33c-4fa8-a2de-74b70b4c96f5 req-9a353f29-bd51-4839-9f28-e6cbc9faa183 service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Updated VIF entry in instance network info cache for port 2932ec7b-1969-4b0c-8566-d4ebca4b99f7. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG nova.network.neutron [req-44b1da58-e33c-4fa8-a2de-74b70b4c96f5 req-9a353f29-bd51-4839-9f28-e6cbc9faa183 service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Updating instance_info_cache with network_info: [{"id": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "address": "fa:16:3e:bb:16:09", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2932ec7b-19", "ovs_interfaceid": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:52:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-44b1da58-e33c-4fa8-a2de-74b70b4c96f5 req-9a353f29-bd51-4839-9f28-e6cbc9faa183 service nova] Releasing lock "refresh_cache-bda33a54-edf0-4809-9469-f1774fdc5b12" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:52:51 user nova-compute[73469]: DEBUG nova.network.neutron [req-c423786f-e34e-4b0f-9123-70d80e9779b4 req-feb5f9a4-55cb-4b9e-bb59-f2349b79f50b service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Updated VIF entry in instance network info cache for port d38956d2-634a-4523-9111-e113654418ad. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:52:51 user nova-compute[73469]: DEBUG nova.network.neutron [req-c423786f-e34e-4b0f-9123-70d80e9779b4 req-feb5f9a4-55cb-4b9e-bb59-f2349b79f50b service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Updating instance_info_cache with network_info: [{"id": "d38956d2-634a-4523-9111-e113654418ad", "address": "fa:16:3e:cc:8b:35", "network": {"id": "a7b64e12-abb3-4a23-87ea-1991927b957d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214261658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb5668009ac4dc9bbce7142275795ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38956d2-63", "ovs_interfaceid": "d38956d2-634a-4523-9111-e113654418ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:52:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c423786f-e34e-4b0f-9123-70d80e9779b4 req-feb5f9a4-55cb-4b9e-bb59-f2349b79f50b service nova] Releasing lock "refresh_cache-759d99dd-a48e-489a-bc96-b4365b1fd17f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:52:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:52:57 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672777.8735688, 9d0668c0-7a49-4857-9b69-541021f18ab2 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:52:57 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] VM Resumed (Lifecycle Event)
Aug 22 02:52:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:52:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:52:57 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Instance spawned successfully.
Aug 22 02:52:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:52:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:52:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:52:57 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Instance spawned successfully.
Aug 22 02:52:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:52:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:52:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:52:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:52:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:52:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:52:58 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Instance spawned successfully.
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:52:58 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Instance spawned successfully.
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:52:58 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672777.8790324, 9d0668c0-7a49-4857-9b69-541021f18ab2 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:52:58 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] VM Started (Lifecycle Event)
Aug 22 02:52:58 user nova-compute[73469]: INFO nova.compute.manager [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Took 19.09 seconds to spawn the instance on the hypervisor.
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:52:58 user nova-compute[73469]: INFO nova.compute.manager [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Took 19.58 seconds to spawn the instance on the hypervisor.
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:52:58 user nova-compute[73469]: INFO nova.compute.manager [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Took 17.38 seconds to spawn the instance on the hypervisor.
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:52:58 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672777.9278023, dc3f5545-8ebb-4947-97d0-98a91f67e421 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:52:58 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] VM Resumed (Lifecycle Event)
Aug 22 02:52:58 user nova-compute[73469]: INFO nova.compute.manager [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Took 15.69 seconds to spawn the instance on the hypervisor.
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:52:58 user nova-compute[73469]: INFO nova.compute.manager [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Took 20.63 seconds to build instance.
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:52:58 user nova-compute[73469]: INFO nova.compute.manager [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Took 20.72 seconds to build instance.
Aug 22 02:52:58 user nova-compute[73469]: INFO nova.compute.manager [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Took 18.60 seconds to build instance.
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672777.9279273, dc3f5545-8ebb-4947-97d0-98a91f67e421 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:52:58 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] VM Started (Lifecycle Event)
Aug 22 02:52:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f6af969-e459-4571-9ee4-c245a54869a9 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "bda33a54-edf0-4809-9469-f1774fdc5b12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.996s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:58 user nova-compute[73469]: INFO nova.compute.manager [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Took 16.70 seconds to build instance.
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e157ba0a-4094-4397-a91a-134004b5102e tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.841s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b31489d6-7a81-46fa-8c21-6df73f01e2e9 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.020s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-412c175f-37e3-4ca1-93d1-b9a275235162 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.820s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672777.9501266, 759d99dd-a48e-489a-bc96-b4365b1fd17f => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:52:58 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] VM Resumed (Lifecycle Event)
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672777.9548059, 759d99dd-a48e-489a-bc96-b4365b1fd17f => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:52:58 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] VM Started (Lifecycle Event)
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672777.9635565, bda33a54-edf0-4809-9469-f1774fdc5b12 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:52:58 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] VM Resumed (Lifecycle Event)
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672777.9637399, bda33a54-edf0-4809-9469-f1774fdc5b12 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:52:58 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] VM Started (Lifecycle Event)
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:52:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:52:59 user nova-compute[73469]: DEBUG nova.compute.manager [req-de526023-a14b-410c-bcf5-73d6ae8762ea req-d3722eb4-520c-4602-98c6-f1ee6b6a59ed service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received event network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:52:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-de526023-a14b-410c-bcf5-73d6ae8762ea req-d3722eb4-520c-4602-98c6-f1ee6b6a59ed service nova] Acquiring lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:52:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-de526023-a14b-410c-bcf5-73d6ae8762ea req-d3722eb4-520c-4602-98c6-f1ee6b6a59ed service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:52:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-de526023-a14b-410c-bcf5-73d6ae8762ea req-d3722eb4-520c-4602-98c6-f1ee6b6a59ed service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:52:59 user nova-compute[73469]: DEBUG nova.compute.manager [req-de526023-a14b-410c-bcf5-73d6ae8762ea req-d3722eb4-520c-4602-98c6-f1ee6b6a59ed service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] No waiting events found dispatching network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:52:59 user nova-compute[73469]: WARNING nova.compute.manager [req-de526023-a14b-410c-bcf5-73d6ae8762ea req-d3722eb4-520c-4602-98c6-f1ee6b6a59ed service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received unexpected event network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 for instance with vm_state active and task_state None.
Aug 22 02:53:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:53:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:01 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:53:01 user nova-compute[73469]: INFO nova.compute.claims [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Claim successful on node user
Aug 22 02:53:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG nova.compute.manager [req-f9cefc7c-64a2-4974-99e0-1e098da68ed2 req-24848d25-69b2-4ef9-b5eb-581cbd67ea6e service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received event network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f9cefc7c-64a2-4974-99e0-1e098da68ed2 req-24848d25-69b2-4ef9-b5eb-581cbd67ea6e service nova] Acquiring lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f9cefc7c-64a2-4974-99e0-1e098da68ed2 req-24848d25-69b2-4ef9-b5eb-581cbd67ea6e service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f9cefc7c-64a2-4974-99e0-1e098da68ed2 req-24848d25-69b2-4ef9-b5eb-581cbd67ea6e service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG nova.compute.manager [req-f9cefc7c-64a2-4974-99e0-1e098da68ed2 req-24848d25-69b2-4ef9-b5eb-581cbd67ea6e service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] No waiting events found dispatching network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:53:02 user nova-compute[73469]: WARNING nova.compute.manager [req-f9cefc7c-64a2-4974-99e0-1e098da68ed2 req-24848d25-69b2-4ef9-b5eb-581cbd67ea6e service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received unexpected event network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 for instance with vm_state active and task_state None.
Aug 22 02:53:02 user nova-compute[73469]: DEBUG nova.compute.manager [req-f9cefc7c-64a2-4974-99e0-1e098da68ed2 req-24848d25-69b2-4ef9-b5eb-581cbd67ea6e service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Received event network-vif-plugged-2932ec7b-1969-4b0c-8566-d4ebca4b99f7 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f9cefc7c-64a2-4974-99e0-1e098da68ed2 req-24848d25-69b2-4ef9-b5eb-581cbd67ea6e service nova] Acquiring lock "bda33a54-edf0-4809-9469-f1774fdc5b12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f9cefc7c-64a2-4974-99e0-1e098da68ed2 req-24848d25-69b2-4ef9-b5eb-581cbd67ea6e service nova] Lock "bda33a54-edf0-4809-9469-f1774fdc5b12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f9cefc7c-64a2-4974-99e0-1e098da68ed2 req-24848d25-69b2-4ef9-b5eb-581cbd67ea6e service nova] Lock "bda33a54-edf0-4809-9469-f1774fdc5b12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG nova.compute.manager [req-f9cefc7c-64a2-4974-99e0-1e098da68ed2 req-24848d25-69b2-4ef9-b5eb-581cbd67ea6e service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] No waiting events found dispatching network-vif-plugged-2932ec7b-1969-4b0c-8566-d4ebca4b99f7 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:53:02 user nova-compute[73469]: WARNING nova.compute.manager [req-f9cefc7c-64a2-4974-99e0-1e098da68ed2 req-24848d25-69b2-4ef9-b5eb-581cbd67ea6e service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Received unexpected event network-vif-plugged-2932ec7b-1969-4b0c-8566-d4ebca4b99f7 for instance with vm_state active and task_state None.
Aug 22 02:53:02 user nova-compute[73469]: DEBUG nova.compute.manager [req-f9cefc7c-64a2-4974-99e0-1e098da68ed2 req-24848d25-69b2-4ef9-b5eb-581cbd67ea6e service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Received event network-vif-plugged-2932ec7b-1969-4b0c-8566-d4ebca4b99f7 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f9cefc7c-64a2-4974-99e0-1e098da68ed2 req-24848d25-69b2-4ef9-b5eb-581cbd67ea6e service nova] Acquiring lock "bda33a54-edf0-4809-9469-f1774fdc5b12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f9cefc7c-64a2-4974-99e0-1e098da68ed2 req-24848d25-69b2-4ef9-b5eb-581cbd67ea6e service nova] Lock "bda33a54-edf0-4809-9469-f1774fdc5b12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f9cefc7c-64a2-4974-99e0-1e098da68ed2 req-24848d25-69b2-4ef9-b5eb-581cbd67ea6e service nova] Lock "bda33a54-edf0-4809-9469-f1774fdc5b12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG nova.compute.manager [req-f9cefc7c-64a2-4974-99e0-1e098da68ed2 req-24848d25-69b2-4ef9-b5eb-581cbd67ea6e service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] No waiting events found dispatching network-vif-plugged-2932ec7b-1969-4b0c-8566-d4ebca4b99f7 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:53:02 user nova-compute[73469]: WARNING nova.compute.manager [req-f9cefc7c-64a2-4974-99e0-1e098da68ed2 req-24848d25-69b2-4ef9-b5eb-581cbd67ea6e service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Received unexpected event network-vif-plugged-2932ec7b-1969-4b0c-8566-d4ebca4b99f7 for instance with vm_state active and task_state None.
Aug 22 02:53:02 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.701s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG nova.network.neutron [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:53:02 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 02:53:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:53:02 user nova-compute[73469]: DEBUG nova.policy [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd0825598415407d98df7353ed5f08c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39885655a2984da4b2ec082427384bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:53:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:53:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:53:03 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Creating image(s)
Aug 22 02:53:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "/opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "/opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.270s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.307s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk 1073741824" returned: 0 in 0.073s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.391s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.446s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:04 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 02:53:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:04 user nova-compute[73469]: DEBUG nova.network.neutron [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Successfully created port: 1dffa70d-3c6e-4c82-9c6b-4d182c9f0365 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:53:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json" returned: 0 in 0.471s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:04 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Cannot resize image /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 02:53:04 user nova-compute[73469]: DEBUG nova.objects.instance [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lazy-loading 'migration_context' on Instance uuid f5fdf305-bf02-4b53-bb0d-83e939ae1acb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:53:04 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:53:04 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Ensure instance console log exists: /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:53:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:07 user nova-compute[73469]: DEBUG nova.network.neutron [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Successfully updated port: 1dffa70d-3c6e-4c82-9c6b-4d182c9f0365 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:53:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "refresh_cache-f5fdf305-bf02-4b53-bb0d-83e939ae1acb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:53:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquired lock "refresh_cache-f5fdf305-bf02-4b53-bb0d-83e939ae1acb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:53:07 user nova-compute[73469]: DEBUG nova.network.neutron [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:53:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-038f1a8b-fa32-4ed4-85b0-bc7765af86f5 req-6e535318-176f-4e84-b12f-6e6bba4a48a2 service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Received event network-changed-1dffa70d-3c6e-4c82-9c6b-4d182c9f0365 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-038f1a8b-fa32-4ed4-85b0-bc7765af86f5 req-6e535318-176f-4e84-b12f-6e6bba4a48a2 service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Refreshing instance network info cache due to event network-changed-1dffa70d-3c6e-4c82-9c6b-4d182c9f0365. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:53:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-038f1a8b-fa32-4ed4-85b0-bc7765af86f5 req-6e535318-176f-4e84-b12f-6e6bba4a48a2 service nova] Acquiring lock "refresh_cache-f5fdf305-bf02-4b53-bb0d-83e939ae1acb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:53:07 user nova-compute[73469]: DEBUG nova.network.neutron [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:53:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Acquiring lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:07 user nova-compute[73469]: DEBUG nova.compute.manager [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:53:08 user nova-compute[73469]: INFO nova.compute.claims [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Claim successful on node user
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.network.neutron [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Updating instance_info_cache with network_info: [{"id": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "address": "fa:16:3e:70:a3:62", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dffa70d-3c", "ovs_interfaceid": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Releasing lock "refresh_cache-f5fdf305-bf02-4b53-bb0d-83e939ae1acb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Instance network_info: |[{"id": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "address": "fa:16:3e:70:a3:62", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dffa70d-3c", "ovs_interfaceid": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-038f1a8b-fa32-4ed4-85b0-bc7765af86f5 req-6e535318-176f-4e84-b12f-6e6bba4a48a2 service nova] Acquired lock "refresh_cache-f5fdf305-bf02-4b53-bb0d-83e939ae1acb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.network.neutron [req-038f1a8b-fa32-4ed4-85b0-bc7765af86f5 req-6e535318-176f-4e84-b12f-6e6bba4a48a2 service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Refreshing network info cache for port 1dffa70d-3c6e-4c82-9c6b-4d182c9f0365 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Start _get_guest_xml network_info=[{"id": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "address": "fa:16:3e:70:a3:62", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dffa70d-3c", "ovs_interfaceid": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:53:08 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:53:08 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:53:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.646s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.compute.manager [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1302387054',display_name='tempest-VolumesAdminNegativeTest-server-1302387054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1302387054',id=5,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd9maV4fKnxtWLxuACn7FIZwYpeZBBpKyHfJTpYXpgkHcXQeMuPsiYHPWu8OMtMg+/AVjMygAp9vAI3jGWRPU04msJz485Fn004nvYgGQJkEPTstjoAC3UUs25v+STOBw==',key_name='tempest-keypair-140235032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39885655a2984da4b2ec082427384bea',ramdisk_id='',reservation_id='r-01ml0ful',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1884652392',owner_user_name='tempest-VolumesAdminNegativeTest-1884652392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:53:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd0825598415407d98df7353ed5f08c8',uuid=f5fdf305-bf02-4b53-bb0d-83e939ae1acb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "address": "fa:16:3e:70:a3:62", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dffa70d-3c", "ovs_interfaceid": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Converting VIF {"id": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "address": "fa:16:3e:70:a3:62", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dffa70d-3c", "ovs_interfaceid": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=1dffa70d-3c6e-4c82-9c6b-4d182c9f0365,network=Network(b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dffa70d-3c') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.objects.instance [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lazy-loading 'pci_devices' on Instance uuid f5fdf305-bf02-4b53-bb0d-83e939ae1acb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.compute.manager [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.network.neutron [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:53:08 user nova-compute[73469]:   <uuid>f5fdf305-bf02-4b53-bb0d-83e939ae1acb</uuid>
Aug 22 02:53:08 user nova-compute[73469]:   <name>instance-00000005</name>
Aug 22 02:53:08 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:53:08 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:53:08 user nova-compute[73469]:   <metadata>
Aug 22 02:53:08 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:53:08 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:53:08 user nova-compute[73469]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1302387054</nova:name>
Aug 22 02:53:08 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:53:08</nova:creationTime>
Aug 22 02:53:08 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:53:08 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:53:08 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:53:08 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:53:08 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:53:08 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:53:08 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:53:08 user nova-compute[73469]:       <nova:owner>
Aug 22 02:53:08 user nova-compute[73469]:         <nova:user uuid="bd0825598415407d98df7353ed5f08c8">tempest-VolumesAdminNegativeTest-1884652392-project-member</nova:user>
Aug 22 02:53:08 user nova-compute[73469]:         <nova:project uuid="39885655a2984da4b2ec082427384bea">tempest-VolumesAdminNegativeTest-1884652392</nova:project>
Aug 22 02:53:08 user nova-compute[73469]:       </nova:owner>
Aug 22 02:53:08 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:53:08 user nova-compute[73469]:       <nova:ports>
Aug 22 02:53:08 user nova-compute[73469]:         <nova:port uuid="1dffa70d-3c6e-4c82-9c6b-4d182c9f0365">
Aug 22 02:53:08 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 22 02:53:08 user nova-compute[73469]:         </nova:port>
Aug 22 02:53:08 user nova-compute[73469]:       </nova:ports>
Aug 22 02:53:08 user nova-compute[73469]:     </nova:instance>
Aug 22 02:53:08 user nova-compute[73469]:   </metadata>
Aug 22 02:53:08 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:53:08 user nova-compute[73469]:     <system>
Aug 22 02:53:08 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:53:08 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:53:08 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:53:08 user nova-compute[73469]:       <entry name="serial">f5fdf305-bf02-4b53-bb0d-83e939ae1acb</entry>
Aug 22 02:53:08 user nova-compute[73469]:       <entry name="uuid">f5fdf305-bf02-4b53-bb0d-83e939ae1acb</entry>
Aug 22 02:53:08 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:53:08 user nova-compute[73469]:     </system>
Aug 22 02:53:08 user nova-compute[73469]:   </sysinfo>
Aug 22 02:53:08 user nova-compute[73469]:   <os>
Aug 22 02:53:08 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:53:08 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:53:08 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:53:08 user nova-compute[73469]:   </os>
Aug 22 02:53:08 user nova-compute[73469]:   <features>
Aug 22 02:53:08 user nova-compute[73469]:     <acpi/>
Aug 22 02:53:08 user nova-compute[73469]:     <apic/>
Aug 22 02:53:08 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:53:08 user nova-compute[73469]:   </features>
Aug 22 02:53:08 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:53:08 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:53:08 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:53:08 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:53:08 user nova-compute[73469]:   </clock>
Aug 22 02:53:08 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:53:08 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:53:08 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:53:08 user nova-compute[73469]:   </cpu>
Aug 22 02:53:08 user nova-compute[73469]:   <devices>
Aug 22 02:53:08 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:53:08 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:53:08 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk"/>
Aug 22 02:53:08 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:53:08 user nova-compute[73469]:     </disk>
Aug 22 02:53:08 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:53:08 user nova-compute[73469]:       <mac address="fa:16:3e:70:a3:62"/>
Aug 22 02:53:08 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:53:08 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:53:08 user nova-compute[73469]:       <target dev="tap1dffa70d-3c"/>
Aug 22 02:53:08 user nova-compute[73469]:     </interface>
Aug 22 02:53:08 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:53:08 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/console.log" append="off"/>
Aug 22 02:53:08 user nova-compute[73469]:     </serial>
Aug 22 02:53:08 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:53:08 user nova-compute[73469]:     <video>
Aug 22 02:53:08 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:53:08 user nova-compute[73469]:     </video>
Aug 22 02:53:08 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:53:08 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:53:08 user nova-compute[73469]:     </rng>
Aug 22 02:53:08 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:53:08 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:53:08 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:53:08 user nova-compute[73469]:     </memballoon>
Aug 22 02:53:08 user nova-compute[73469]:   </devices>
Aug 22 02:53:08 user nova-compute[73469]: </domain>
Aug 22 02:53:08 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1302387054',display_name='tempest-VolumesAdminNegativeTest-server-1302387054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1302387054',id=5,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd9maV4fKnxtWLxuACn7FIZwYpeZBBpKyHfJTpYXpgkHcXQeMuPsiYHPWu8OMtMg+/AVjMygAp9vAI3jGWRPU04msJz485Fn004nvYgGQJkEPTstjoAC3UUs25v+STOBw==',key_name='tempest-keypair-140235032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39885655a2984da4b2ec082427384bea',ramdisk_id='',reservation_id='r-01ml0ful',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1884652392',owner_user_name='tempest-VolumesAdminNegativeTest-1884652392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:53:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd0825598415407d98df7353ed5f08c8',uuid=f5fdf305-bf02-4b53-bb0d-83e939ae1acb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "address": "fa:16:3e:70:a3:62", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dffa70d-3c", "ovs_interfaceid": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Converting VIF {"id": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "address": "fa:16:3e:70:a3:62", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dffa70d-3c", "ovs_interfaceid": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=1dffa70d-3c6e-4c82-9c6b-4d182c9f0365,network=Network(b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dffa70d-3c') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG os_vif [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=1dffa70d-3c6e-4c82-9c6b-4d182c9f0365,network=Network(b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dffa70d-3c') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:53:08 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 02:53:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dffa70d-3c, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1dffa70d-3c, col_values=(('external_ids', {'iface-id': '1dffa70d-3c6e-4c82-9c6b-4d182c9f0365', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:a3:62', 'vm-uuid': 'f5fdf305-bf02-4b53-bb0d-83e939ae1acb'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG nova.compute.manager [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:53:08 user nova-compute[73469]: INFO os_vif [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=1dffa70d-3c6e-4c82-9c6b-4d182c9f0365,network=Network(b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dffa70d-3c')
Aug 22 02:53:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:53:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] No VIF found with MAC fa:16:3e:70:a3:62, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:53:09 user nova-compute[73469]: DEBUG nova.compute.manager [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:53:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:53:09 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Creating image(s)
Aug 22 02:53:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Lock "/opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Lock "/opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:09 user nova-compute[73469]: DEBUG nova.policy [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74d31e86d8734f4dab684a5b41c109c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2998d1c629d446cfbf70d34b254ad473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:53:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.244s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.010s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Acquiring lock "f988e66c-6bd1-49bb-ac43-140008f7c995" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:09 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:53:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.378s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk 1073741824" returned: 0 in 0.078s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.461s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:53:10 user nova-compute[73469]: INFO nova.compute.claims [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Claim successful on node user
Aug 22 02:53:10 user nova-compute[73469]: DEBUG nova.network.neutron [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Successfully created port: 52040c67-b1ad-4eea-86b2-43143b75acb5 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.296s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG nova.network.neutron [req-038f1a8b-fa32-4ed4-85b0-bc7765af86f5 req-6e535318-176f-4e84-b12f-6e6bba4a48a2 service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Updated VIF entry in instance network info cache for port 1dffa70d-3c6e-4c82-9c6b-4d182c9f0365. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG nova.network.neutron [req-038f1a8b-fa32-4ed4-85b0-bc7765af86f5 req-6e535318-176f-4e84-b12f-6e6bba4a48a2 service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Updating instance_info_cache with network_info: [{"id": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "address": "fa:16:3e:70:a3:62", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dffa70d-3c", "ovs_interfaceid": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Cannot resize image /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG nova.objects.instance [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Lazy-loading 'migration_context' on Instance uuid e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Ensure instance console log exists: /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-038f1a8b-fa32-4ed4-85b0-bc7765af86f5 req-6e535318-176f-4e84-b12f-6e6bba4a48a2 service nova] Releasing lock "refresh_cache-f5fdf305-bf02-4b53-bb0d-83e939ae1acb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.943s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:10 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:53:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:11 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:53:11 user nova-compute[73469]: DEBUG nova.network.neutron [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:53:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:11 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 22 02:53:11 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:53:11 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:53:11 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:53:11 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Creating image(s)
Aug 22 02:53:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Acquiring lock "/opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "/opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "/opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Acquiring lock "dd3d75ce1a1ca9f409ccd559944ce38f88da297b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "dd3d75ce1a1ca9f409ccd559944ce38f88da297b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:11 user nova-compute[73469]: DEBUG nova.policy [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2578791264c145369cdfdec5b4b697da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea11f6b107064d67925facec50a49fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:53:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd3d75ce1a1ca9f409ccd559944ce38f88da297b.part --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:12 user nova-compute[73469]: DEBUG nova.network.neutron [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Successfully updated port: 52040c67-b1ad-4eea-86b2-43143b75acb5 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:53:12 user nova-compute[73469]: DEBUG nova.compute.manager [req-d6ea941d-40d4-4bc9-8401-887f4b979228 req-4fbe6487-4ed6-4b70-a519-921689cd55b0 service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Received event network-changed-52040c67-b1ad-4eea-86b2-43143b75acb5 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:12 user nova-compute[73469]: DEBUG nova.compute.manager [req-d6ea941d-40d4-4bc9-8401-887f4b979228 req-4fbe6487-4ed6-4b70-a519-921689cd55b0 service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Refreshing instance network info cache due to event network-changed-52040c67-b1ad-4eea-86b2-43143b75acb5. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:53:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d6ea941d-40d4-4bc9-8401-887f4b979228 req-4fbe6487-4ed6-4b70-a519-921689cd55b0 service nova] Acquiring lock "refresh_cache-e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:53:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d6ea941d-40d4-4bc9-8401-887f4b979228 req-4fbe6487-4ed6-4b70-a519-921689cd55b0 service nova] Acquired lock "refresh_cache-e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:53:12 user nova-compute[73469]: DEBUG nova.network.neutron [req-d6ea941d-40d4-4bc9-8401-887f4b979228 req-4fbe6487-4ed6-4b70-a519-921689cd55b0 service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Refreshing network info cache for port 52040c67-b1ad-4eea-86b2-43143b75acb5 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:53:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Acquiring lock "refresh_cache-e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:53:12 user nova-compute[73469]: DEBUG nova.network.neutron [req-d6ea941d-40d4-4bc9-8401-887f4b979228 req-4fbe6487-4ed6-4b70-a519-921689cd55b0 service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:53:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd3d75ce1a1ca9f409ccd559944ce38f88da297b.part --force-share --output=json" returned: 0 in 0.533s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:12 user nova-compute[73469]: DEBUG nova.virt.images [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] 31c48251-7534-48de-b2b4-d8d4d18d595f was qcow2, converting to raw {{(pid=73469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 22 02:53:12 user nova-compute[73469]: DEBUG nova.privsep.utils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 22 02:53:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dd3d75ce1a1ca9f409ccd559944ce38f88da297b.part /opt/stack/data/nova/instances/_base/dd3d75ce1a1ca9f409ccd559944ce38f88da297b.converted {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dd3d75ce1a1ca9f409ccd559944ce38f88da297b.part /opt/stack/data/nova/instances/_base/dd3d75ce1a1ca9f409ccd559944ce38f88da297b.converted" returned: 0 in 0.393s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd3d75ce1a1ca9f409ccd559944ce38f88da297b.converted --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:13 user nova-compute[73469]: DEBUG nova.network.neutron [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Successfully created port: ec723392-c81a-4e29-9b7c-29bfe467419f {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:53:13 user nova-compute[73469]: DEBUG nova.network.neutron [req-d6ea941d-40d4-4bc9-8401-887f4b979228 req-4fbe6487-4ed6-4b70-a519-921689cd55b0 service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:53:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d6ea941d-40d4-4bc9-8401-887f4b979228 req-4fbe6487-4ed6-4b70-a519-921689cd55b0 service nova] Releasing lock "refresh_cache-e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:53:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Acquired lock "refresh_cache-e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:53:13 user nova-compute[73469]: DEBUG nova.network.neutron [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:53:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd3d75ce1a1ca9f409ccd559944ce38f88da297b.converted --force-share --output=json" returned: 0 in 0.296s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "dd3d75ce1a1ca9f409ccd559944ce38f88da297b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.884s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd3d75ce1a1ca9f409ccd559944ce38f88da297b --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:13 user nova-compute[73469]: DEBUG nova.network.neutron [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:53:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd3d75ce1a1ca9f409ccd559944ce38f88da297b --force-share --output=json" returned: 0 in 0.343s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Acquiring lock "dd3d75ce1a1ca9f409ccd559944ce38f88da297b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "dd3d75ce1a1ca9f409ccd559944ce38f88da297b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd3d75ce1a1ca9f409ccd559944ce38f88da297b --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd3d75ce1a1ca9f409ccd559944ce38f88da297b --force-share --output=json" returned: 0 in 0.330s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd3d75ce1a1ca9f409ccd559944ce38f88da297b,backing_fmt=raw /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd3d75ce1a1ca9f409ccd559944ce38f88da297b,backing_fmt=raw /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk 1073741824" returned: 0 in 0.071s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "dd3d75ce1a1ca9f409ccd559944ce38f88da297b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.425s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd3d75ce1a1ca9f409ccd559944ce38f88da297b --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672794.1703882, f5fdf305-bf02-4b53-bb0d-83e939ae1acb => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:53:14 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] VM Resumed (Lifecycle Event)
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:53:14 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Instance spawned successfully.
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:14 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672794.17608, f5fdf305-bf02-4b53-bb0d-83e939ae1acb => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:53:14 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] VM Started (Lifecycle Event)
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:53:14 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:53:14 user nova-compute[73469]: INFO nova.compute.manager [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Took 11.34 seconds to spawn the instance on the hypervisor.
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd3d75ce1a1ca9f409ccd559944ce38f88da297b --force-share --output=json" returned: 0 in 0.436s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.network.neutron [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Successfully updated port: ec723392-c81a-4e29-9b7c-29bfe467419f {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Acquiring lock "refresh_cache-f988e66c-6bd1-49bb-ac43-140008f7c995" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Acquired lock "refresh_cache-f988e66c-6bd1-49bb-ac43-140008f7c995" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.network.neutron [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-284dde4d-e3ce-42f7-b3ab-ead9b52ea7a7 req-75fa3cd8-0460-4785-bad7-54ce5730afc3 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Received event network-changed-ec723392-c81a-4e29-9b7c-29bfe467419f {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-284dde4d-e3ce-42f7-b3ab-ead9b52ea7a7 req-75fa3cd8-0460-4785-bad7-54ce5730afc3 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Refreshing instance network info cache due to event network-changed-ec723392-c81a-4e29-9b7c-29bfe467419f. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-284dde4d-e3ce-42f7-b3ab-ead9b52ea7a7 req-75fa3cd8-0460-4785-bad7-54ce5730afc3 service nova] Acquiring lock "refresh_cache-f988e66c-6bd1-49bb-ac43-140008f7c995" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Cannot resize image /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.objects.instance [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lazy-loading 'migration_context' on Instance uuid f988e66c-6bd1-49bb-ac43-140008f7c995 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Ensure instance console log exists: /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:14 user nova-compute[73469]: DEBUG nova.network.neutron [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:53:14 user nova-compute[73469]: INFO nova.compute.manager [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Took 12.97 seconds to build instance.
Aug 22 02:53:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e586ffaf-3028-4323-b5b7-061814b7d295 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.372s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.network.neutron [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Updating instance_info_cache with network_info: [{"id": "52040c67-b1ad-4eea-86b2-43143b75acb5", "address": "fa:16:3e:2b:aa:81", "network": {"id": "2731bb0f-0af6-4f92-ad67-294ad45891b7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1587989028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2998d1c629d446cfbf70d34b254ad473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52040c67-b1", "ovs_interfaceid": "52040c67-b1ad-4eea-86b2-43143b75acb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Releasing lock "refresh_cache-e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.compute.manager [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Instance network_info: |[{"id": "52040c67-b1ad-4eea-86b2-43143b75acb5", "address": "fa:16:3e:2b:aa:81", "network": {"id": "2731bb0f-0af6-4f92-ad67-294ad45891b7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1587989028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2998d1c629d446cfbf70d34b254ad473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52040c67-b1", "ovs_interfaceid": "52040c67-b1ad-4eea-86b2-43143b75acb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Start _get_guest_xml network_info=[{"id": "52040c67-b1ad-4eea-86b2-43143b75acb5", "address": "fa:16:3e:2b:aa:81", "network": {"id": "2731bb0f-0af6-4f92-ad67-294ad45891b7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1587989028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2998d1c629d446cfbf70d34b254ad473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52040c67-b1", "ovs_interfaceid": "52040c67-b1ad-4eea-86b2-43143b75acb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:53:15 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:53:15 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1113267848',display_name='tempest-VolumesAssistedSnapshotsTest-server-1113267848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1113267848',id=6,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeH8OxpCrZPtj9pmWfiAyyFneiooHemk/mkvV95vmZjpi+LV5UoZQkmEw+QdaifEhFgT+viLuguggIAnpvaVN01Se10f3LR1T5BwDUrPj24WboY55mMq8pjpUExHE8BsA==',key_name='tempest-keypair-419590459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2998d1c629d446cfbf70d34b254ad473',ramdisk_id='',reservation_id='r-l59rr859',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-838523114',owner_user_name='tempest-VolumesAssistedSnapshotsTest-838523114-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:53:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74d31e86d8734f4dab684a5b41c109c3',uuid=e8cc9ae7-e8ec-4407-8f02-4e895ae682b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52040c67-b1ad-4eea-86b2-43143b75acb5", "address": "fa:16:3e:2b:aa:81", "network": {"id": "2731bb0f-0af6-4f92-ad67-294ad45891b7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1587989028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2998d1c629d446cfbf70d34b254ad473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52040c67-b1", "ovs_interfaceid": "52040c67-b1ad-4eea-86b2-43143b75acb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Converting VIF {"id": "52040c67-b1ad-4eea-86b2-43143b75acb5", "address": "fa:16:3e:2b:aa:81", "network": {"id": "2731bb0f-0af6-4f92-ad67-294ad45891b7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1587989028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2998d1c629d446cfbf70d34b254ad473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52040c67-b1", "ovs_interfaceid": "52040c67-b1ad-4eea-86b2-43143b75acb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:aa:81,bridge_name='br-int',has_traffic_filtering=True,id=52040c67-b1ad-4eea-86b2-43143b75acb5,network=Network(2731bb0f-0af6-4f92-ad67-294ad45891b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52040c67-b1') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.objects.instance [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Lazy-loading 'pci_devices' on Instance uuid e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:53:15 user nova-compute[73469]:   <uuid>e8cc9ae7-e8ec-4407-8f02-4e895ae682b4</uuid>
Aug 22 02:53:15 user nova-compute[73469]:   <name>instance-00000006</name>
Aug 22 02:53:15 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:53:15 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:53:15 user nova-compute[73469]:   <metadata>
Aug 22 02:53:15 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:53:15 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:53:15 user nova-compute[73469]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1113267848</nova:name>
Aug 22 02:53:15 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:53:15</nova:creationTime>
Aug 22 02:53:15 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:53:15 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:53:15 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:53:15 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:53:15 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:53:15 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:53:15 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:53:15 user nova-compute[73469]:       <nova:owner>
Aug 22 02:53:15 user nova-compute[73469]:         <nova:user uuid="74d31e86d8734f4dab684a5b41c109c3">tempest-VolumesAssistedSnapshotsTest-838523114-project-member</nova:user>
Aug 22 02:53:15 user nova-compute[73469]:         <nova:project uuid="2998d1c629d446cfbf70d34b254ad473">tempest-VolumesAssistedSnapshotsTest-838523114</nova:project>
Aug 22 02:53:15 user nova-compute[73469]:       </nova:owner>
Aug 22 02:53:15 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:53:15 user nova-compute[73469]:       <nova:ports>
Aug 22 02:53:15 user nova-compute[73469]:         <nova:port uuid="52040c67-b1ad-4eea-86b2-43143b75acb5">
Aug 22 02:53:15 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 22 02:53:15 user nova-compute[73469]:         </nova:port>
Aug 22 02:53:15 user nova-compute[73469]:       </nova:ports>
Aug 22 02:53:15 user nova-compute[73469]:     </nova:instance>
Aug 22 02:53:15 user nova-compute[73469]:   </metadata>
Aug 22 02:53:15 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:53:15 user nova-compute[73469]:     <system>
Aug 22 02:53:15 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:53:15 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:53:15 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:53:15 user nova-compute[73469]:       <entry name="serial">e8cc9ae7-e8ec-4407-8f02-4e895ae682b4</entry>
Aug 22 02:53:15 user nova-compute[73469]:       <entry name="uuid">e8cc9ae7-e8ec-4407-8f02-4e895ae682b4</entry>
Aug 22 02:53:15 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:53:15 user nova-compute[73469]:     </system>
Aug 22 02:53:15 user nova-compute[73469]:   </sysinfo>
Aug 22 02:53:15 user nova-compute[73469]:   <os>
Aug 22 02:53:15 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:53:15 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:53:15 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:53:15 user nova-compute[73469]:   </os>
Aug 22 02:53:15 user nova-compute[73469]:   <features>
Aug 22 02:53:15 user nova-compute[73469]:     <acpi/>
Aug 22 02:53:15 user nova-compute[73469]:     <apic/>
Aug 22 02:53:15 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:53:15 user nova-compute[73469]:   </features>
Aug 22 02:53:15 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:53:15 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:53:15 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:53:15 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:53:15 user nova-compute[73469]:   </clock>
Aug 22 02:53:15 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:53:15 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:53:15 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:53:15 user nova-compute[73469]:   </cpu>
Aug 22 02:53:15 user nova-compute[73469]:   <devices>
Aug 22 02:53:15 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:53:15 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:53:15 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk"/>
Aug 22 02:53:15 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:53:15 user nova-compute[73469]:     </disk>
Aug 22 02:53:15 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:53:15 user nova-compute[73469]:       <mac address="fa:16:3e:2b:aa:81"/>
Aug 22 02:53:15 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:53:15 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:53:15 user nova-compute[73469]:       <target dev="tap52040c67-b1"/>
Aug 22 02:53:15 user nova-compute[73469]:     </interface>
Aug 22 02:53:15 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:53:15 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/console.log" append="off"/>
Aug 22 02:53:15 user nova-compute[73469]:     </serial>
Aug 22 02:53:15 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:53:15 user nova-compute[73469]:     <video>
Aug 22 02:53:15 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:53:15 user nova-compute[73469]:     </video>
Aug 22 02:53:15 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:53:15 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:53:15 user nova-compute[73469]:     </rng>
Aug 22 02:53:15 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:53:15 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:53:15 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:53:15 user nova-compute[73469]:     </memballoon>
Aug 22 02:53:15 user nova-compute[73469]:   </devices>
Aug 22 02:53:15 user nova-compute[73469]: </domain>
Aug 22 02:53:15 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1113267848',display_name='tempest-VolumesAssistedSnapshotsTest-server-1113267848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1113267848',id=6,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeH8OxpCrZPtj9pmWfiAyyFneiooHemk/mkvV95vmZjpi+LV5UoZQkmEw+QdaifEhFgT+viLuguggIAnpvaVN01Se10f3LR1T5BwDUrPj24WboY55mMq8pjpUExHE8BsA==',key_name='tempest-keypair-419590459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2998d1c629d446cfbf70d34b254ad473',ramdisk_id='',reservation_id='r-l59rr859',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-838523114',owner_user_name='tempest-VolumesAssistedSnapshotsTest-838523114-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:53:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74d31e86d8734f4dab684a5b41c109c3',uuid=e8cc9ae7-e8ec-4407-8f02-4e895ae682b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52040c67-b1ad-4eea-86b2-43143b75acb5", "address": "fa:16:3e:2b:aa:81", "network": {"id": "2731bb0f-0af6-4f92-ad67-294ad45891b7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1587989028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2998d1c629d446cfbf70d34b254ad473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52040c67-b1", "ovs_interfaceid": "52040c67-b1ad-4eea-86b2-43143b75acb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Converting VIF {"id": "52040c67-b1ad-4eea-86b2-43143b75acb5", "address": "fa:16:3e:2b:aa:81", "network": {"id": "2731bb0f-0af6-4f92-ad67-294ad45891b7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1587989028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2998d1c629d446cfbf70d34b254ad473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52040c67-b1", "ovs_interfaceid": "52040c67-b1ad-4eea-86b2-43143b75acb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:aa:81,bridge_name='br-int',has_traffic_filtering=True,id=52040c67-b1ad-4eea-86b2-43143b75acb5,network=Network(2731bb0f-0af6-4f92-ad67-294ad45891b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52040c67-b1') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG os_vif [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:aa:81,bridge_name='br-int',has_traffic_filtering=True,id=52040c67-b1ad-4eea-86b2-43143b75acb5,network=Network(2731bb0f-0af6-4f92-ad67-294ad45891b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52040c67-b1') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52040c67-b1, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap52040c67-b1, col_values=(('external_ids', {'iface-id': '52040c67-b1ad-4eea-86b2-43143b75acb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:aa:81', 'vm-uuid': 'e8cc9ae7-e8ec-4407-8f02-4e895ae682b4'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:15 user nova-compute[73469]: INFO os_vif [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:aa:81,bridge_name='br-int',has_traffic_filtering=True,id=52040c67-b1ad-4eea-86b2-43143b75acb5,network=Network(2731bb0f-0af6-4f92-ad67-294ad45891b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52040c67-b1')
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] No VIF found with MAC fa:16:3e:2b:aa:81, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.network.neutron [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Updating instance_info_cache with network_info: [{"id": "ec723392-c81a-4e29-9b7c-29bfe467419f", "address": "fa:16:3e:b1:f4:12", "network": {"id": "44ec7375-8521-4a64-a172-6677f74183e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-546521769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea11f6b107064d67925facec50a49fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec723392-c8", "ovs_interfaceid": "ec723392-c81a-4e29-9b7c-29bfe467419f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Releasing lock "refresh_cache-f988e66c-6bd1-49bb-ac43-140008f7c995" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Instance network_info: |[{"id": "ec723392-c81a-4e29-9b7c-29bfe467419f", "address": "fa:16:3e:b1:f4:12", "network": {"id": "44ec7375-8521-4a64-a172-6677f74183e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-546521769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea11f6b107064d67925facec50a49fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec723392-c8", "ovs_interfaceid": "ec723392-c81a-4e29-9b7c-29bfe467419f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-284dde4d-e3ce-42f7-b3ab-ead9b52ea7a7 req-75fa3cd8-0460-4785-bad7-54ce5730afc3 service nova] Acquired lock "refresh_cache-f988e66c-6bd1-49bb-ac43-140008f7c995" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.network.neutron [req-284dde4d-e3ce-42f7-b3ab-ead9b52ea7a7 req-75fa3cd8-0460-4785-bad7-54ce5730afc3 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Refreshing network info cache for port ec723392-c81a-4e29-9b7c-29bfe467419f {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Start _get_guest_xml network_info=[{"id": "ec723392-c81a-4e29-9b7c-29bfe467419f", "address": "fa:16:3e:b1:f4:12", "network": {"id": "44ec7375-8521-4a64-a172-6677f74183e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-546521769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea11f6b107064d67925facec50a49fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec723392-c8", "ovs_interfaceid": "ec723392-c81a-4e29-9b7c-29bfe467419f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:53:00Z,direct_url=<?>,disk_format='qcow2',id=31c48251-7534-48de-b2b4-d8d4d18d595f,min_disk=0,min_ram=0,name='',owner='5ede13bd6c0248cbb82e57cb73aa9452',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:53:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '31c48251-7534-48de-b2b4-d8d4d18d595f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:53:15 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:53:15 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:53:00Z,direct_url=<?>,disk_format='qcow2',id=31c48251-7534-48de-b2b4-d8d4d18d595f,min_disk=0,min_ram=0,name='',owner='5ede13bd6c0248cbb82e57cb73aa9452',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:53:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:53:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-609542542',display_name='tempest-AttachSCSIVolumeTestJSON-server-609542542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-609542542',id=7,image_ref='31c48251-7534-48de-b2b4-d8d4d18d595f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0M+3FuT1yOxrBv6NKuI4r7yvfUIUwIr2xOLHOz1RaTlWriFPmHJ6u84K0wWbYYxpB901RsPKGl+54I6yfFJHKR5MjEy4puP9PAUBG46aET6Lr17VKbZDWq9CnrQecRfQ==',key_name='tempest-keypair-853967548',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea11f6b107064d67925facec50a49fb7',ramdisk_id='',reservation_id='r-n4zhb4dx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='31c48251-7534-48de-b2b4-d8d4d18d595f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1011330548',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1011330548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:53:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2578791264c145369cdfdec5b4b697da',uuid=f988e66c-6bd1-49bb-ac43-140008f7c995,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec723392-c81a-4e29-9b7c-29bfe467419f", "address": "fa:16:3e:b1:f4:12", "network": {"id": "44ec7375-8521-4a64-a172-6677f74183e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-546521769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea11f6b107064d67925facec50a49fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec723392-c8", "ovs_interfaceid": "ec723392-c81a-4e29-9b7c-29bfe467419f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Converting VIF {"id": "ec723392-c81a-4e29-9b7c-29bfe467419f", "address": "fa:16:3e:b1:f4:12", "network": {"id": "44ec7375-8521-4a64-a172-6677f74183e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-546521769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea11f6b107064d67925facec50a49fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec723392-c8", "ovs_interfaceid": "ec723392-c81a-4e29-9b7c-29bfe467419f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:f4:12,bridge_name='br-int',has_traffic_filtering=True,id=ec723392-c81a-4e29-9b7c-29bfe467419f,network=Network(44ec7375-8521-4a64-a172-6677f74183e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec723392-c8') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.objects.instance [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lazy-loading 'pci_devices' on Instance uuid f988e66c-6bd1-49bb-ac43-140008f7c995 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:53:15 user nova-compute[73469]:   <uuid>f988e66c-6bd1-49bb-ac43-140008f7c995</uuid>
Aug 22 02:53:15 user nova-compute[73469]:   <name>instance-00000007</name>
Aug 22 02:53:15 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:53:15 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:53:15 user nova-compute[73469]:   <metadata>
Aug 22 02:53:15 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:53:15 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:53:15 user nova-compute[73469]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-609542542</nova:name>
Aug 22 02:53:15 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:53:15</nova:creationTime>
Aug 22 02:53:15 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:53:15 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:53:15 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:53:15 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:53:15 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:53:15 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:53:15 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:53:15 user nova-compute[73469]:       <nova:owner>
Aug 22 02:53:15 user nova-compute[73469]:         <nova:user uuid="2578791264c145369cdfdec5b4b697da">tempest-AttachSCSIVolumeTestJSON-1011330548-project-member</nova:user>
Aug 22 02:53:15 user nova-compute[73469]:         <nova:project uuid="ea11f6b107064d67925facec50a49fb7">tempest-AttachSCSIVolumeTestJSON-1011330548</nova:project>
Aug 22 02:53:15 user nova-compute[73469]:       </nova:owner>
Aug 22 02:53:15 user nova-compute[73469]:       <nova:root type="image" uuid="31c48251-7534-48de-b2b4-d8d4d18d595f"/>
Aug 22 02:53:15 user nova-compute[73469]:       <nova:ports>
Aug 22 02:53:15 user nova-compute[73469]:         <nova:port uuid="ec723392-c81a-4e29-9b7c-29bfe467419f">
Aug 22 02:53:15 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 22 02:53:15 user nova-compute[73469]:         </nova:port>
Aug 22 02:53:15 user nova-compute[73469]:       </nova:ports>
Aug 22 02:53:15 user nova-compute[73469]:     </nova:instance>
Aug 22 02:53:15 user nova-compute[73469]:   </metadata>
Aug 22 02:53:15 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:53:15 user nova-compute[73469]:     <system>
Aug 22 02:53:15 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:53:15 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:53:15 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:53:15 user nova-compute[73469]:       <entry name="serial">f988e66c-6bd1-49bb-ac43-140008f7c995</entry>
Aug 22 02:53:15 user nova-compute[73469]:       <entry name="uuid">f988e66c-6bd1-49bb-ac43-140008f7c995</entry>
Aug 22 02:53:15 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:53:15 user nova-compute[73469]:     </system>
Aug 22 02:53:15 user nova-compute[73469]:   </sysinfo>
Aug 22 02:53:15 user nova-compute[73469]:   <os>
Aug 22 02:53:15 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:53:15 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:53:15 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:53:15 user nova-compute[73469]:   </os>
Aug 22 02:53:15 user nova-compute[73469]:   <features>
Aug 22 02:53:15 user nova-compute[73469]:     <acpi/>
Aug 22 02:53:15 user nova-compute[73469]:     <apic/>
Aug 22 02:53:15 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:53:15 user nova-compute[73469]:   </features>
Aug 22 02:53:15 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:53:15 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:53:15 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:53:15 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:53:15 user nova-compute[73469]:   </clock>
Aug 22 02:53:15 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:53:15 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:53:15 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:53:15 user nova-compute[73469]:   </cpu>
Aug 22 02:53:15 user nova-compute[73469]:   <devices>
Aug 22 02:53:15 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:53:15 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:53:15 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk"/>
Aug 22 02:53:15 user nova-compute[73469]:       <target dev="sda" bus="scsi"/>
Aug 22 02:53:15 user nova-compute[73469]:       <address type="drive" controller="0" unit="0"/>
Aug 22 02:53:15 user nova-compute[73469]:     </disk>
Aug 22 02:53:15 user nova-compute[73469]:     <disk type="file" device="cdrom">
Aug 22 02:53:15 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none"/>
Aug 22 02:53:15 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk.config"/>
Aug 22 02:53:15 user nova-compute[73469]:       <target dev="sdb" bus="scsi"/>
Aug 22 02:53:15 user nova-compute[73469]:       <address type="drive" controller="0" unit="1"/>
Aug 22 02:53:15 user nova-compute[73469]:     </disk>
Aug 22 02:53:15 user nova-compute[73469]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 22 02:53:15 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:53:15 user nova-compute[73469]:       <mac address="fa:16:3e:b1:f4:12"/>
Aug 22 02:53:15 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:53:15 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:53:15 user nova-compute[73469]:       <target dev="tapec723392-c8"/>
Aug 22 02:53:15 user nova-compute[73469]:     </interface>
Aug 22 02:53:15 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:53:15 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/console.log" append="off"/>
Aug 22 02:53:15 user nova-compute[73469]:     </serial>
Aug 22 02:53:15 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:53:15 user nova-compute[73469]:     <video>
Aug 22 02:53:15 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:53:15 user nova-compute[73469]:     </video>
Aug 22 02:53:15 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:53:15 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:53:15 user nova-compute[73469]:     </rng>
Aug 22 02:53:15 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:53:15 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:53:15 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:53:15 user nova-compute[73469]:     </memballoon>
Aug 22 02:53:15 user nova-compute[73469]:   </devices>
Aug 22 02:53:15 user nova-compute[73469]: </domain>
Aug 22 02:53:15 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:53:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-609542542',display_name='tempest-AttachSCSIVolumeTestJSON-server-609542542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-609542542',id=7,image_ref='31c48251-7534-48de-b2b4-d8d4d18d595f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0M+3FuT1yOxrBv6NKuI4r7yvfUIUwIr2xOLHOz1RaTlWriFPmHJ6u84K0wWbYYxpB901RsPKGl+54I6yfFJHKR5MjEy4puP9PAUBG46aET6Lr17VKbZDWq9CnrQecRfQ==',key_name='tempest-keypair-853967548',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea11f6b107064d67925facec50a49fb7',ramdisk_id='',reservation_id='r-n4zhb4dx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='31c48251-7534-48de-b2b4-d8d4d18d595f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1011330548',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1011330548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:53:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2578791264c145369cdfdec5b4b697da',uuid=f988e66c-6bd1-49bb-ac43-140008f7c995,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec723392-c81a-4e29-9b7c-29bfe467419f", "address": "fa:16:3e:b1:f4:12", "network": {"id": "44ec7375-8521-4a64-a172-6677f74183e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-546521769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea11f6b107064d67925facec50a49fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec723392-c8", "ovs_interfaceid": "ec723392-c81a-4e29-9b7c-29bfe467419f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Converting VIF {"id": "ec723392-c81a-4e29-9b7c-29bfe467419f", "address": "fa:16:3e:b1:f4:12", "network": {"id": "44ec7375-8521-4a64-a172-6677f74183e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-546521769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea11f6b107064d67925facec50a49fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec723392-c8", "ovs_interfaceid": "ec723392-c81a-4e29-9b7c-29bfe467419f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:f4:12,bridge_name='br-int',has_traffic_filtering=True,id=ec723392-c81a-4e29-9b7c-29bfe467419f,network=Network(44ec7375-8521-4a64-a172-6677f74183e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec723392-c8') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG os_vif [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:f4:12,bridge_name='br-int',has_traffic_filtering=True,id=ec723392-c81a-4e29-9b7c-29bfe467419f,network=Network(44ec7375-8521-4a64-a172-6677f74183e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec723392-c8') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec723392-c8, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec723392-c8, col_values=(('external_ids', {'iface-id': 'ec723392-c81a-4e29-9b7c-29bfe467419f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:f4:12', 'vm-uuid': 'f988e66c-6bd1-49bb-ac43-140008f7c995'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:53:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:15 user nova-compute[73469]: INFO os_vif [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:f4:12,bridge_name='br-int',has_traffic_filtering=True,id=ec723392-c81a-4e29-9b7c-29bfe467419f,network=Network(44ec7375-8521-4a64-a172-6677f74183e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec723392-c8')
Aug 22 02:53:16 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] No BDM found with device name sda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:53:16 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:53:16 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] No VIF found with MAC fa:16:3e:b1:f4:12, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:53:16 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Using config drive
Aug 22 02:53:16 user nova-compute[73469]: DEBUG nova.network.neutron [req-284dde4d-e3ce-42f7-b3ab-ead9b52ea7a7 req-75fa3cd8-0460-4785-bad7-54ce5730afc3 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Updated VIF entry in instance network info cache for port ec723392-c81a-4e29-9b7c-29bfe467419f. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:53:16 user nova-compute[73469]: DEBUG nova.network.neutron [req-284dde4d-e3ce-42f7-b3ab-ead9b52ea7a7 req-75fa3cd8-0460-4785-bad7-54ce5730afc3 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Updating instance_info_cache with network_info: [{"id": "ec723392-c81a-4e29-9b7c-29bfe467419f", "address": "fa:16:3e:b1:f4:12", "network": {"id": "44ec7375-8521-4a64-a172-6677f74183e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-546521769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea11f6b107064d67925facec50a49fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec723392-c8", "ovs_interfaceid": "ec723392-c81a-4e29-9b7c-29bfe467419f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:53:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-284dde4d-e3ce-42f7-b3ab-ead9b52ea7a7 req-75fa3cd8-0460-4785-bad7-54ce5730afc3 service nova] Releasing lock "refresh_cache-f988e66c-6bd1-49bb-ac43-140008f7c995" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:53:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:17 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Creating config drive at /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk.config
Aug 22 02:53:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprrc0m2o7 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprrc0m2o7" returned: 0 in 0.063s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:19 user nova-compute[73469]: DEBUG nova.compute.manager [req-125b6561-de9e-4df1-b49c-caf5626a4d9a req-e7098b69-6da6-4563-80d8-33f817d45a05 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Received event network-vif-plugged-d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-125b6561-de9e-4df1-b49c-caf5626a4d9a req-e7098b69-6da6-4563-80d8-33f817d45a05 service nova] Acquiring lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-125b6561-de9e-4df1-b49c-caf5626a4d9a req-e7098b69-6da6-4563-80d8-33f817d45a05 service nova] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-125b6561-de9e-4df1-b49c-caf5626a4d9a req-e7098b69-6da6-4563-80d8-33f817d45a05 service nova] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:19 user nova-compute[73469]: DEBUG nova.compute.manager [req-125b6561-de9e-4df1-b49c-caf5626a4d9a req-e7098b69-6da6-4563-80d8-33f817d45a05 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] No waiting events found dispatching network-vif-plugged-d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:53:19 user nova-compute[73469]: WARNING nova.compute.manager [req-125b6561-de9e-4df1-b49c-caf5626a4d9a req-e7098b69-6da6-4563-80d8-33f817d45a05 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Received unexpected event network-vif-plugged-d38956d2-634a-4523-9111-e113654418ad for instance with vm_state active and task_state None.
Aug 22 02:53:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Acquiring lock "f478387d-e004-4314-961d-abf4a910e970" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "f478387d-e004-4314-961d-abf4a910e970" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:53:21 user nova-compute[73469]: INFO nova.compute.claims [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Claim successful on node user
Aug 22 02:53:21 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-c7563675-f5d2-42cd-abd8-c3c8ccecb46d req-a4684765-d129-4116-8b44-5fbb3e8946cb service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Received event network-vif-plugged-d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c7563675-f5d2-42cd-abd8-c3c8ccecb46d req-a4684765-d129-4116-8b44-5fbb3e8946cb service nova] Acquiring lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c7563675-f5d2-42cd-abd8-c3c8ccecb46d req-a4684765-d129-4116-8b44-5fbb3e8946cb service nova] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c7563675-f5d2-42cd-abd8-c3c8ccecb46d req-a4684765-d129-4116-8b44-5fbb3e8946cb service nova] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-c7563675-f5d2-42cd-abd8-c3c8ccecb46d req-a4684765-d129-4116-8b44-5fbb3e8946cb service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] No waiting events found dispatching network-vif-plugged-d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:53:21 user nova-compute[73469]: WARNING nova.compute.manager [req-c7563675-f5d2-42cd-abd8-c3c8ccecb46d req-a4684765-d129-4116-8b44-5fbb3e8946cb service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Received unexpected event network-vif-plugged-d38956d2-634a-4523-9111-e113654418ad for instance with vm_state active and task_state None.
Aug 22 02:53:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-c7563675-f5d2-42cd-abd8-c3c8ccecb46d req-a4684765-d129-4116-8b44-5fbb3e8946cb service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Received event network-vif-plugged-52040c67-b1ad-4eea-86b2-43143b75acb5 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c7563675-f5d2-42cd-abd8-c3c8ccecb46d req-a4684765-d129-4116-8b44-5fbb3e8946cb service nova] Acquiring lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c7563675-f5d2-42cd-abd8-c3c8ccecb46d req-a4684765-d129-4116-8b44-5fbb3e8946cb service nova] Lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c7563675-f5d2-42cd-abd8-c3c8ccecb46d req-a4684765-d129-4116-8b44-5fbb3e8946cb service nova] Lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-c7563675-f5d2-42cd-abd8-c3c8ccecb46d req-a4684765-d129-4116-8b44-5fbb3e8946cb service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] No waiting events found dispatching network-vif-plugged-52040c67-b1ad-4eea-86b2-43143b75acb5 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:53:21 user nova-compute[73469]: WARNING nova.compute.manager [req-c7563675-f5d2-42cd-abd8-c3c8ccecb46d req-a4684765-d129-4116-8b44-5fbb3e8946cb service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Received unexpected event network-vif-plugged-52040c67-b1ad-4eea-86b2-43143b75acb5 for instance with vm_state building and task_state spawning.
Aug 22 02:53:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-c7563675-f5d2-42cd-abd8-c3c8ccecb46d req-a4684765-d129-4116-8b44-5fbb3e8946cb service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Received event network-vif-plugged-52040c67-b1ad-4eea-86b2-43143b75acb5 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c7563675-f5d2-42cd-abd8-c3c8ccecb46d req-a4684765-d129-4116-8b44-5fbb3e8946cb service nova] Acquiring lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c7563675-f5d2-42cd-abd8-c3c8ccecb46d req-a4684765-d129-4116-8b44-5fbb3e8946cb service nova] Lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c7563675-f5d2-42cd-abd8-c3c8ccecb46d req-a4684765-d129-4116-8b44-5fbb3e8946cb service nova] Lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-c7563675-f5d2-42cd-abd8-c3c8ccecb46d req-a4684765-d129-4116-8b44-5fbb3e8946cb service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] No waiting events found dispatching network-vif-plugged-52040c67-b1ad-4eea-86b2-43143b75acb5 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:53:21 user nova-compute[73469]: WARNING nova.compute.manager [req-c7563675-f5d2-42cd-abd8-c3c8ccecb46d req-a4684765-d129-4116-8b44-5fbb3e8946cb service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Received unexpected event network-vif-plugged-52040c67-b1ad-4eea-86b2-43143b75acb5 for instance with vm_state building and task_state spawning.
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672801.9958286, e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:53:22 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] VM Resumed (Lifecycle Event)
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.network.neutron [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:53:22 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 02:53:22 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Instance spawned successfully.
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:22 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672802.0074964, e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:53:22 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] VM Started (Lifecycle Event)
Aug 22 02:53:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:53:22 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Instance spawned successfully.
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:53:22 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672802.1895692, f988e66c-6bd1-49bb-ac43-140008f7c995 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:53:22 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] VM Resumed (Lifecycle Event)
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.policy [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94d6857e94724880877a28c02ad6eaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af59db42fc849efa62fe05f0225084c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:53:22 user nova-compute[73469]: INFO nova.compute.manager [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Took 13.15 seconds to spawn the instance on the hypervisor.
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:53:22 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672802.194306, f988e66c-6bd1-49bb-ac43-140008f7c995 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:53:22 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] VM Started (Lifecycle Event)
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:53:22 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Creating image(s)
Aug 22 02:53:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Acquiring lock "/opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "/opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "/opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:53:22 user nova-compute[73469]: INFO nova.compute.manager [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Took 11.00 seconds to spawn the instance on the hypervisor.
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:53:22 user nova-compute[73469]: INFO nova.compute.manager [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Took 14.40 seconds to build instance.
Aug 22 02:53:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-818c3c15-125e-4152-a4a4-974196c0e472 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.567s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:22 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:53:22 user nova-compute[73469]: INFO nova.compute.manager [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Took 12.49 seconds to build instance.
Aug 22 02:53:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c72e5920-d3ad-4693-9fb8-b3786fd1dfc2 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.728s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.248s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.230s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk 1073741824" returned: 0 in 0.072s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:23 user nova-compute[73469]: DEBUG nova.network.neutron [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Successfully created port: f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:53:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.263s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:23 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 02:53:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:23 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Cannot resize image /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 02:53:23 user nova-compute[73469]: DEBUG nova.objects.instance [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lazy-loading 'migration_context' on Instance uuid f478387d-e004-4314-961d-abf4a910e970 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:53:23 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:53:23 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Ensure instance console log exists: /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:53:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.network.neutron [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Successfully updated port: f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Acquiring lock "refresh_cache-f478387d-e004-4314-961d-abf4a910e970" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Acquired lock "refresh_cache-f478387d-e004-4314-961d-abf4a910e970" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.network.neutron [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-54319fb4-c5bf-45c6-9d6c-f9f8a54599bb req-90056cde-9851-4f5b-a096-8bc6e6c3537c service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] Received event network-changed-f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-54319fb4-c5bf-45c6-9d6c-f9f8a54599bb req-90056cde-9851-4f5b-a096-8bc6e6c3537c service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] Refreshing instance network info cache due to event network-changed-f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-54319fb4-c5bf-45c6-9d6c-f9f8a54599bb req-90056cde-9851-4f5b-a096-8bc6e6c3537c service nova] Acquiring lock "refresh_cache-f478387d-e004-4314-961d-abf4a910e970" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.network.neutron [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.network.neutron [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Updating instance_info_cache with network_info: [{"id": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "address": "fa:16:3e:40:4d:fa", "network": {"id": "10332235-8c40-4287-965d-a31a57873020", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075046749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af59db42fc849efa62fe05f0225084c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a77e8c-e1", "ovs_interfaceid": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Releasing lock "refresh_cache-f478387d-e004-4314-961d-abf4a910e970" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Instance network_info: |[{"id": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "address": "fa:16:3e:40:4d:fa", "network": {"id": "10332235-8c40-4287-965d-a31a57873020", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075046749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af59db42fc849efa62fe05f0225084c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a77e8c-e1", "ovs_interfaceid": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-54319fb4-c5bf-45c6-9d6c-f9f8a54599bb req-90056cde-9851-4f5b-a096-8bc6e6c3537c service nova] Acquired lock "refresh_cache-f478387d-e004-4314-961d-abf4a910e970" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.network.neutron [req-54319fb4-c5bf-45c6-9d6c-f9f8a54599bb req-90056cde-9851-4f5b-a096-8bc6e6c3537c service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] Refreshing network info cache for port f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Start _get_guest_xml network_info=[{"id": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "address": "fa:16:3e:40:4d:fa", "network": {"id": "10332235-8c40-4287-965d-a31a57873020", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075046749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af59db42fc849efa62fe05f0225084c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a77e8c-e1", "ovs_interfaceid": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:53:24 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:53:24 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2072789517',display_name='tempest-TestVolumeSwap-server-2072789517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2072789517',id=8,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNkHzhaIKZAAMJju6nMvsYsNMkUHkELvuE21pKgUC0dqShiMeHcF48QrQyu+m0sBQZSc2Mm8RwyW5CwMiT1Ik7ll82rf28/HcHgucqaMHaUWjdIqwobXPJG4U51Zu6WYA==',key_name='tempest-keypair-1765973754',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4af59db42fc849efa62fe05f0225084c',ramdisk_id='',reservation_id='r-w9t6bpam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-784062355',owner_user_name='tempest-TestVolumeSwap-784062355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:53:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94d6857e94724880877a28c02ad6eaaa',uuid=f478387d-e004-4314-961d-abf4a910e970,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "address": "fa:16:3e:40:4d:fa", "network": {"id": "10332235-8c40-4287-965d-a31a57873020", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075046749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af59db42fc849efa62fe05f0225084c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a77e8c-e1", "ovs_interfaceid": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Converting VIF {"id": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "address": "fa:16:3e:40:4d:fa", "network": {"id": "10332235-8c40-4287-965d-a31a57873020", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075046749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af59db42fc849efa62fe05f0225084c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a77e8c-e1", "ovs_interfaceid": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:4d:fa,bridge_name='br-int',has_traffic_filtering=True,id=f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e,network=Network(10332235-8c40-4287-965d-a31a57873020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3a77e8c-e1') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.objects.instance [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lazy-loading 'pci_devices' on Instance uuid f478387d-e004-4314-961d-abf4a910e970 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:53:24 user nova-compute[73469]:   <uuid>f478387d-e004-4314-961d-abf4a910e970</uuid>
Aug 22 02:53:24 user nova-compute[73469]:   <name>instance-00000008</name>
Aug 22 02:53:24 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:53:24 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:53:24 user nova-compute[73469]:   <metadata>
Aug 22 02:53:24 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:53:24 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:53:24 user nova-compute[73469]:       <nova:name>tempest-TestVolumeSwap-server-2072789517</nova:name>
Aug 22 02:53:24 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:53:24</nova:creationTime>
Aug 22 02:53:24 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:53:24 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:53:24 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:53:24 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:53:24 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:53:24 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:53:24 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:53:24 user nova-compute[73469]:       <nova:owner>
Aug 22 02:53:24 user nova-compute[73469]:         <nova:user uuid="94d6857e94724880877a28c02ad6eaaa">tempest-TestVolumeSwap-784062355-project-member</nova:user>
Aug 22 02:53:24 user nova-compute[73469]:         <nova:project uuid="4af59db42fc849efa62fe05f0225084c">tempest-TestVolumeSwap-784062355</nova:project>
Aug 22 02:53:24 user nova-compute[73469]:       </nova:owner>
Aug 22 02:53:24 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:53:24 user nova-compute[73469]:       <nova:ports>
Aug 22 02:53:24 user nova-compute[73469]:         <nova:port uuid="f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e">
Aug 22 02:53:24 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 22 02:53:24 user nova-compute[73469]:         </nova:port>
Aug 22 02:53:24 user nova-compute[73469]:       </nova:ports>
Aug 22 02:53:24 user nova-compute[73469]:     </nova:instance>
Aug 22 02:53:24 user nova-compute[73469]:   </metadata>
Aug 22 02:53:24 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:53:24 user nova-compute[73469]:     <system>
Aug 22 02:53:24 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:53:24 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:53:24 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:53:24 user nova-compute[73469]:       <entry name="serial">f478387d-e004-4314-961d-abf4a910e970</entry>
Aug 22 02:53:24 user nova-compute[73469]:       <entry name="uuid">f478387d-e004-4314-961d-abf4a910e970</entry>
Aug 22 02:53:24 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:53:24 user nova-compute[73469]:     </system>
Aug 22 02:53:24 user nova-compute[73469]:   </sysinfo>
Aug 22 02:53:24 user nova-compute[73469]:   <os>
Aug 22 02:53:24 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:53:24 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:53:24 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:53:24 user nova-compute[73469]:   </os>
Aug 22 02:53:24 user nova-compute[73469]:   <features>
Aug 22 02:53:24 user nova-compute[73469]:     <acpi/>
Aug 22 02:53:24 user nova-compute[73469]:     <apic/>
Aug 22 02:53:24 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:53:24 user nova-compute[73469]:   </features>
Aug 22 02:53:24 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:53:24 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:53:24 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:53:24 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:53:24 user nova-compute[73469]:   </clock>
Aug 22 02:53:24 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:53:24 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:53:24 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:53:24 user nova-compute[73469]:   </cpu>
Aug 22 02:53:24 user nova-compute[73469]:   <devices>
Aug 22 02:53:24 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:53:24 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:53:24 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk"/>
Aug 22 02:53:24 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:53:24 user nova-compute[73469]:     </disk>
Aug 22 02:53:24 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:53:24 user nova-compute[73469]:       <mac address="fa:16:3e:40:4d:fa"/>
Aug 22 02:53:24 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:53:24 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:53:24 user nova-compute[73469]:       <target dev="tapf3a77e8c-e1"/>
Aug 22 02:53:24 user nova-compute[73469]:     </interface>
Aug 22 02:53:24 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:53:24 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/console.log" append="off"/>
Aug 22 02:53:24 user nova-compute[73469]:     </serial>
Aug 22 02:53:24 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:53:24 user nova-compute[73469]:     <video>
Aug 22 02:53:24 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:53:24 user nova-compute[73469]:     </video>
Aug 22 02:53:24 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:53:24 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:53:24 user nova-compute[73469]:     </rng>
Aug 22 02:53:24 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:53:24 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:53:24 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:53:24 user nova-compute[73469]:     </memballoon>
Aug 22 02:53:24 user nova-compute[73469]:   </devices>
Aug 22 02:53:24 user nova-compute[73469]: </domain>
Aug 22 02:53:24 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2072789517',display_name='tempest-TestVolumeSwap-server-2072789517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2072789517',id=8,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNkHzhaIKZAAMJju6nMvsYsNMkUHkELvuE21pKgUC0dqShiMeHcF48QrQyu+m0sBQZSc2Mm8RwyW5CwMiT1Ik7ll82rf28/HcHgucqaMHaUWjdIqwobXPJG4U51Zu6WYA==',key_name='tempest-keypair-1765973754',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4af59db42fc849efa62fe05f0225084c',ramdisk_id='',reservation_id='r-w9t6bpam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-784062355',owner_user_name='tempest-TestVolumeSwap-784062355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:53:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94d6857e94724880877a28c02ad6eaaa',uuid=f478387d-e004-4314-961d-abf4a910e970,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "address": "fa:16:3e:40:4d:fa", "network": {"id": "10332235-8c40-4287-965d-a31a57873020", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075046749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af59db42fc849efa62fe05f0225084c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a77e8c-e1", "ovs_interfaceid": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Converting VIF {"id": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "address": "fa:16:3e:40:4d:fa", "network": {"id": "10332235-8c40-4287-965d-a31a57873020", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075046749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af59db42fc849efa62fe05f0225084c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a77e8c-e1", "ovs_interfaceid": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:4d:fa,bridge_name='br-int',has_traffic_filtering=True,id=f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e,network=Network(10332235-8c40-4287-965d-a31a57873020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3a77e8c-e1') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG os_vif [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:4d:fa,bridge_name='br-int',has_traffic_filtering=True,id=f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e,network=Network(10332235-8c40-4287-965d-a31a57873020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3a77e8c-e1') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3a77e8c-e1, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3a77e8c-e1, col_values=(('external_ids', {'iface-id': 'f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:4d:fa', 'vm-uuid': 'f478387d-e004-4314-961d-abf4a910e970'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:24 user nova-compute[73469]: INFO os_vif [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:4d:fa,bridge_name='br-int',has_traffic_filtering=True,id=f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e,network=Network(10332235-8c40-4287-965d-a31a57873020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3a77e8c-e1')
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:53:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] No VIF found with MAC fa:16:3e:40:4d:fa, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:53:25 user nova-compute[73469]: DEBUG nova.network.neutron [req-54319fb4-c5bf-45c6-9d6c-f9f8a54599bb req-90056cde-9851-4f5b-a096-8bc6e6c3537c service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] Updated VIF entry in instance network info cache for port f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:53:25 user nova-compute[73469]: DEBUG nova.network.neutron [req-54319fb4-c5bf-45c6-9d6c-f9f8a54599bb req-90056cde-9851-4f5b-a096-8bc6e6c3537c service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] Updating instance_info_cache with network_info: [{"id": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "address": "fa:16:3e:40:4d:fa", "network": {"id": "10332235-8c40-4287-965d-a31a57873020", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075046749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af59db42fc849efa62fe05f0225084c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a77e8c-e1", "ovs_interfaceid": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:53:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-54319fb4-c5bf-45c6-9d6c-f9f8a54599bb req-90056cde-9851-4f5b-a096-8bc6e6c3537c service nova] Releasing lock "refresh_cache-f478387d-e004-4314-961d-abf4a910e970" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:53:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-94430414-e55e-4d8d-88df-662e5409be2c req-c1d13aa5-c92d-4a55-8ffa-f355827db9e5 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Received event network-vif-plugged-85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-94430414-e55e-4d8d-88df-662e5409be2c req-c1d13aa5-c92d-4a55-8ffa-f355827db9e5 service nova] Acquiring lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-94430414-e55e-4d8d-88df-662e5409be2c req-c1d13aa5-c92d-4a55-8ffa-f355827db9e5 service nova] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-94430414-e55e-4d8d-88df-662e5409be2c req-c1d13aa5-c92d-4a55-8ffa-f355827db9e5 service nova] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-94430414-e55e-4d8d-88df-662e5409be2c req-c1d13aa5-c92d-4a55-8ffa-f355827db9e5 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] No waiting events found dispatching network-vif-plugged-85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:53:27 user nova-compute[73469]: WARNING nova.compute.manager [req-94430414-e55e-4d8d-88df-662e5409be2c req-c1d13aa5-c92d-4a55-8ffa-f355827db9e5 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Received unexpected event network-vif-plugged-85ef805d-a41f-4146-bbed-a2feed61c8bb for instance with vm_state active and task_state None.
Aug 22 02:53:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:53:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 22 02:53:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] There are 0 instances to clean {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 22 02:53:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:53:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 22 02:53:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.compute.manager [req-4bd29b23-9d25-471d-be41-877c38095c78 req-316fd259-88c9-4bbe-89d2-102096ddd5d6 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Received event network-vif-plugged-85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4bd29b23-9d25-471d-be41-877c38095c78 req-316fd259-88c9-4bbe-89d2-102096ddd5d6 service nova] Acquiring lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4bd29b23-9d25-471d-be41-877c38095c78 req-316fd259-88c9-4bbe-89d2-102096ddd5d6 service nova] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4bd29b23-9d25-471d-be41-877c38095c78 req-316fd259-88c9-4bbe-89d2-102096ddd5d6 service nova] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.compute.manager [req-4bd29b23-9d25-471d-be41-877c38095c78 req-316fd259-88c9-4bbe-89d2-102096ddd5d6 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] No waiting events found dispatching network-vif-plugged-85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:53:29 user nova-compute[73469]: WARNING nova.compute.manager [req-4bd29b23-9d25-471d-be41-877c38095c78 req-316fd259-88c9-4bbe-89d2-102096ddd5d6 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Received unexpected event network-vif-plugged-85ef805d-a41f-4146-bbed-a2feed61c8bb for instance with vm_state active and task_state None.
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672809.3465455, f478387d-e004-4314-961d-abf4a910e970 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:53:29 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f478387d-e004-4314-961d-abf4a910e970] VM Resumed (Lifecycle Event)
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:53:29 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: f478387d-e004-4314-961d-abf4a910e970] Instance spawned successfully.
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f478387d-e004-4314-961d-abf4a910e970] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f478387d-e004-4314-961d-abf4a910e970] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:53:29 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f478387d-e004-4314-961d-abf4a910e970] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672809.3505347, f478387d-e004-4314-961d-abf4a910e970 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:53:29 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f478387d-e004-4314-961d-abf4a910e970] VM Started (Lifecycle Event)
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f478387d-e004-4314-961d-abf4a910e970] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f478387d-e004-4314-961d-abf4a910e970] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:53:29 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f478387d-e004-4314-961d-abf4a910e970] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:53:29 user nova-compute[73469]: INFO nova.compute.manager [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Took 7.24 seconds to spawn the instance on the hypervisor.
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f478387d-e004-4314-961d-abf4a910e970] Skipping network cache update for instance because it is Building. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 22 02:53:29 user nova-compute[73469]: INFO nova.compute.manager [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Took 8.54 seconds to build instance.
Aug 22 02:53:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-bda33a54-edf0-4809-9469-f1774fdc5b12" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-bda33a54-edf0-4809-9469-f1774fdc5b12" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid bda33a54-edf0-4809-9469-f1774fdc5b12 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-66207a88-ae7a-4257-b04b-1ea32dea0c73 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "f478387d-e004-4314-961d-abf4a910e970" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.711s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:30 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Updating instance_info_cache with network_info: [{"id": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "address": "fa:16:3e:bb:16:09", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2932ec7b-19", "ovs_interfaceid": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:53:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-bda33a54-edf0-4809-9469-f1774fdc5b12" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:53:30 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 02:53:30 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:53:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:30 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 02:53:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-a4173d4e-7c2c-4014-b690-3bebce161e70 req-8ee86ab5-932a-467c-9508-2fb371f835f8 service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Received event network-vif-plugged-1dffa70d-3c6e-4c82-9c6b-4d182c9f0365 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a4173d4e-7c2c-4014-b690-3bebce161e70 req-8ee86ab5-932a-467c-9508-2fb371f835f8 service nova] Acquiring lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a4173d4e-7c2c-4014-b690-3bebce161e70 req-8ee86ab5-932a-467c-9508-2fb371f835f8 service nova] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a4173d4e-7c2c-4014-b690-3bebce161e70 req-8ee86ab5-932a-467c-9508-2fb371f835f8 service nova] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-a4173d4e-7c2c-4014-b690-3bebce161e70 req-8ee86ab5-932a-467c-9508-2fb371f835f8 service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] No waiting events found dispatching network-vif-plugged-1dffa70d-3c6e-4c82-9c6b-4d182c9f0365 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:53:33 user nova-compute[73469]: WARNING nova.compute.manager [req-a4173d4e-7c2c-4014-b690-3bebce161e70 req-8ee86ab5-932a-467c-9508-2fb371f835f8 service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Received unexpected event network-vif-plugged-1dffa70d-3c6e-4c82-9c6b-4d182c9f0365 for instance with vm_state active and task_state None.
Aug 22 02:53:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:35 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:53:35 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=7525MB free_disk=25.730358123779297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Received event network-vif-plugged-1dffa70d-3c6e-4c82-9c6b-4d182c9f0365 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] Acquiring lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] No waiting events found dispatching network-vif-plugged-1dffa70d-3c6e-4c82-9c6b-4d182c9f0365 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:53:35 user nova-compute[73469]: WARNING nova.compute.manager [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Received unexpected event network-vif-plugged-1dffa70d-3c6e-4c82-9c6b-4d182c9f0365 for instance with vm_state active and task_state None.
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Received event network-vif-plugged-ec723392-c81a-4e29-9b7c-29bfe467419f {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] Acquiring lock "f988e66c-6bd1-49bb-ac43-140008f7c995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] No waiting events found dispatching network-vif-plugged-ec723392-c81a-4e29-9b7c-29bfe467419f {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:53:35 user nova-compute[73469]: WARNING nova.compute.manager [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Received unexpected event network-vif-plugged-ec723392-c81a-4e29-9b7c-29bfe467419f for instance with vm_state active and task_state None.
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Received event network-vif-plugged-ec723392-c81a-4e29-9b7c-29bfe467419f {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] Acquiring lock "f988e66c-6bd1-49bb-ac43-140008f7c995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] No waiting events found dispatching network-vif-plugged-ec723392-c81a-4e29-9b7c-29bfe467419f {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:53:35 user nova-compute[73469]: WARNING nova.compute.manager [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Received unexpected event network-vif-plugged-ec723392-c81a-4e29-9b7c-29bfe467419f for instance with vm_state active and task_state None.
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] Received event network-vif-plugged-f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] Acquiring lock "f478387d-e004-4314-961d-abf4a910e970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] Lock "f478387d-e004-4314-961d-abf4a910e970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] Lock "f478387d-e004-4314-961d-abf4a910e970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] No waiting events found dispatching network-vif-plugged-f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:53:35 user nova-compute[73469]: WARNING nova.compute.manager [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] Received unexpected event network-vif-plugged-f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e for instance with vm_state active and task_state None.
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] Received event network-vif-plugged-f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] Acquiring lock "f478387d-e004-4314-961d-abf4a910e970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] Lock "f478387d-e004-4314-961d-abf4a910e970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] Lock "f478387d-e004-4314-961d-abf4a910e970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] No waiting events found dispatching network-vif-plugged-f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:53:35 user nova-compute[73469]: WARNING nova.compute.manager [req-e322e319-94c5-4faa-9679-56c0fb521fee req-e6b69341-6ecf-4dfb-bd45-7e70e3502fd2 service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] Received unexpected event network-vif-plugged-f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e for instance with vm_state active and task_state None.
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d0668c0-7a49-4857-9b69-541021f18ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance dc3f5545-8ebb-4947-97d0-98a91f67e421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 759d99dd-a48e-489a-bc96-b4365b1fd17f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f5fdf305-bf02-4b53-bb0d-83e939ae1acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f988e66c-6bd1-49bb-ac43-140008f7c995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f478387d-e004-4314-961d-abf4a910e970 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 02:53:35 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 02:53:36 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:53:36 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:53:36 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 02:53:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:36 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:53:36 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:53:36 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:53:36 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:53:36 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:53:36 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:53:36 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:53:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 02:53:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Acquiring lock "71874297-5bc8-4816-b99e-58661ec38500" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "71874297-5bc8-4816-b99e-58661ec38500" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:53:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:53:45 user nova-compute[73469]: INFO nova.compute.claims [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Claim successful on node user
Aug 22 02:53:45 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Refreshing inventories for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 22 02:53:45 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Updating ProviderTree inventory for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 22 02:53:45 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Updating inventory in ProviderTree for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 22 02:53:45 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Refreshing aggregate associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, aggregates: None {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 22 02:53:45 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Refreshing trait associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 22 02:53:45 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:53:45 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:53:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:53:45 user nova-compute[73469]: DEBUG nova.compute.manager [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:53:45 user nova-compute[73469]: DEBUG nova.compute.manager [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:53:45 user nova-compute[73469]: DEBUG nova.network.neutron [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:53:45 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 02:53:45 user nova-compute[73469]: DEBUG nova.compute.manager [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:53:45 user nova-compute[73469]: DEBUG nova.policy [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf5ba5f1c3b147388c043d08d17103c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e945a8b0f0492c9099049690ada404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:53:45 user nova-compute[73469]: INFO nova.virt.block_device [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Booting with volume 6d2463b5-2a45-4447-b1d6-2753a728a0b4 at /dev/vda
Aug 22 02:53:45 user nova-compute[73469]: DEBUG os_brick.utils [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:53:45 user nova-compute[73469]: INFO oslo.privsep.daemon [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpak_4_wuz/privsep.sock']
Aug 22 02:53:45 user sudo[84373]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpak_4_wuz/privsep.sock
Aug 22 02:53:45 user sudo[84373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 22 02:53:46 user nova-compute[73469]: DEBUG nova.network.neutron [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Successfully created port: a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:53:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:47 user nova-compute[73469]: DEBUG nova.network.neutron [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Successfully updated port: a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:53:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Acquiring lock "refresh_cache-71874297-5bc8-4816-b99e-58661ec38500" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:53:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Acquired lock "refresh_cache-71874297-5bc8-4816-b99e-58661ec38500" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:53:47 user nova-compute[73469]: DEBUG nova.network.neutron [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:53:47 user nova-compute[73469]: DEBUG nova.compute.manager [req-ca0c1412-b790-4375-ab86-72c82c342006 req-2988a67b-ae9e-4fdf-b406-1174cc6d453a service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received event network-changed-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:53:47 user nova-compute[73469]: DEBUG nova.compute.manager [req-ca0c1412-b790-4375-ab86-72c82c342006 req-2988a67b-ae9e-4fdf-b406-1174cc6d453a service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Refreshing instance network info cache due to event network-changed-a442f21d-ed03-4b3f-89d7-c5b24175d1f9. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:53:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ca0c1412-b790-4375-ab86-72c82c342006 req-2988a67b-ae9e-4fdf-b406-1174cc6d453a service nova] Acquiring lock "refresh_cache-71874297-5bc8-4816-b99e-58661ec38500" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:53:47 user nova-compute[73469]: DEBUG nova.network.neutron [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:53:47 user nova-compute[73469]: DEBUG nova.network.neutron [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Updating instance_info_cache with network_info: [{"id": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "address": "fa:16:3e:b0:64:29", "network": {"id": "c0ca9d32-e425-4576-8e7a-007b037ac6e2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-953287001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5e945a8b0f0492c9099049690ada404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa442f21d-ed", "ovs_interfaceid": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:53:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Releasing lock "refresh_cache-71874297-5bc8-4816-b99e-58661ec38500" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:53:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Instance network_info: |[{"id": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "address": "fa:16:3e:b0:64:29", "network": {"id": "c0ca9d32-e425-4576-8e7a-007b037ac6e2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-953287001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5e945a8b0f0492c9099049690ada404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa442f21d-ed", "ovs_interfaceid": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:53:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ca0c1412-b790-4375-ab86-72c82c342006 req-2988a67b-ae9e-4fdf-b406-1174cc6d453a service nova] Acquired lock "refresh_cache-71874297-5bc8-4816-b99e-58661ec38500" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:53:47 user nova-compute[73469]: DEBUG nova.network.neutron [req-ca0c1412-b790-4375-ab86-72c82c342006 req-2988a67b-ae9e-4fdf-b406-1174cc6d453a service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Refreshing network info cache for port a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:53:48 user sudo[84373]: pam_unix(sudo:session): session closed for user root
Aug 22 02:53:48 user nova-compute[73469]: INFO oslo.privsep.daemon [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Spawned new privsep daemon via rootwrap
Aug 22 02:53:48 user nova-compute[73469]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 22 02:53:48 user nova-compute[73469]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 22 02:53:48 user nova-compute[73469]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 22 02:53:48 user nova-compute[73469]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84378
Aug 22 02:53:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc86128c-6a8e-4ac0-9f05-ebdf026442cb]: (2,) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e6ce6d-07d9-4c14-9f48-ecc2258cb3c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:53:48 user nova-compute[73469]: WARNING os_brick.initiator.connectors.nvmeof [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 22 02:53:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[76adc530-edb5-48d5-8047-743efe52345c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcd53eb-32b5-4392-a2bd-f6ba4b4e6006]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc175bb6-533c-4894-86a1-52e881be31ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG nova.network.neutron [req-ca0c1412-b790-4375-ab86-72c82c342006 req-2988a67b-ae9e-4fdf-b406-1174cc6d453a service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Updated VIF entry in instance network info cache for port a442f21d-ed03-4b3f-89d7-c5b24175d1f9. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG nova.network.neutron [req-ca0c1412-b790-4375-ab86-72c82c342006 req-2988a67b-ae9e-4fdf-b406-1174cc6d453a service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Updating instance_info_cache with network_info: [{"id": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "address": "fa:16:3e:b0:64:29", "network": {"id": "c0ca9d32-e425-4576-8e7a-007b037ac6e2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-953287001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5e945a8b0f0492c9099049690ada404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa442f21d-ed", "ovs_interfaceid": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:53:48 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 02:53:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca5a1a3-004b-425d-be8d-787bb1528d7d]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG os_brick.utils [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] <== get_connector_properties: return (2510ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Updating existing volume attachment record: 422e22c2-d784-42d9-9f6d-e14aeee80248 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 02:53:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ca0c1412-b790-4375-ab86-72c82c342006 req-2988a67b-ae9e-4fdf-b406-1174cc6d453a service nova] Releasing lock "refresh_cache-71874297-5bc8-4816-b99e-58661ec38500" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:53:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:53:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquiring lock "82db3ec6-ab80-406e-84b2-2714a01a94dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "82db3ec6-ab80-406e-84b2-2714a01a94dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:59 user nova-compute[73469]: DEBUG nova.compute.manager [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:53:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:53:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:53:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:53:59 user nova-compute[73469]: INFO nova.compute.claims [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Claim successful on node user
Aug 22 02:53:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:54:00 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Creating image(s)
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Did not create local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Ensure instance console log exists: /opt/stack/data/nova/instances/71874297-5bc8-4816-b99e-58661ec38500/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Start _get_guest_xml network_info=[{"id": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "address": "fa:16:3e:b0:64:29", "network": {"id": "c0ca9d32-e425-4576-8e7a-007b037ac6e2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-953287001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5e945a8b0f0492c9099049690ada404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa442f21d-ed", "ovs_interfaceid": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '422e22c2-d784-42d9-9f6d-e14aeee80248', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSLPutZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71874297-5bc8-4816-b99e-58661ec38500', 'attached_at': '', 'detached_at': '', 'volume_id': '6d2463b5-2a45-4447-b1d6-2753a728a0b4', 'serial': '6d2463b5-2a45-4447-b1d6-2753a728a0b4'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:54:00 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:54:00 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connector [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Factory for ISCSI on None {{(pid=73469) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSLPutZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:54:00 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:54:00 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:54:00 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca2bf00-f9bd-4b32-992e-d4844a8eb55b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 02:54:00 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea87d50-c6af-465d-9ea4-77159569938a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4] added
Aug 22 02:54:00 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3cc2c3-a861-4144-9736-e088e8e4618b]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca6b6c5-4a44-4b2e-9318-7589f4713fd0]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bSLPutZz {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bSLPutZz" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[71474d4b-1b9a-4b6d-81e1-92843148fa43]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bSLPutZz'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[80532b45-da24-496d-b4f6-233e465a5941]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d68a4b8-be94-4379-b934-7ecafdc39e7e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 22 02:54:00 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 22 02:54:00 user nova-compute[73469]:  {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:54:00 user nova-compute[73469]: WARNING os_brick.initiator.connectors.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 22 02:54:00 user nova-compute[73469]: 
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.network.neutron [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:54:00 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2080a191-e4fc-4470-9275-0a156da87918]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4, portal: 172.16.0.220,3260]
Aug 22 02:54:00 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4, portal: 172.16.0.220,3260] successful.
Aug 22 02:54:00 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68f890d-b47e-4fd1-a3c0-5fefb3408f83]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[58062ca8-bb44-4fc0-8d11-ba00c74bf0ef]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:54:00 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:54:00 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.policy [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7747694d4132438b9d794cb59907a328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd1fcacf5614d0782d38743f0f336e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e79f1d-7987-45a1-a658-5f0eed3a32d8]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:54:00 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Creating image(s)
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquiring lock "/opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "/opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "/opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.179s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.213s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/disk 1073741824" returned: 0 in 0.049s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.169s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Cannot resize image /opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG nova.objects.instance [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lazy-loading 'migration_context' on Instance uuid 82db3ec6-ab80-406e-84b2-2714a01a94dc {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Ensure instance console log exists: /opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG nova.network.neutron [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Successfully created port: 43ab40fd-017d-404c-9456-06880b203b05 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSLPutZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23237363730383232', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237363730383232', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-377659152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-377659152',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKdydlpBpfM8iUKDYqmt+T3Vb9ogb25mCf0t5qBVWqYu7okcZIbqswy9cY7EzBR1ehqgAhMx+2jQu1gM1ufIoHEPIBlAoobLh2iMYLXMFczVAufMp/nR4kSWj02M0KlhA==',key_name='tempest-keypair-904786919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5e945a8b0f0492c9099049690ada404',ramdisk_id='',reservation_id='r-k6v908aw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-436752772',owner_user_name='tempest-ServerActionsV293TestJSON-436752772-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5ba5f1c3b147388c043d08d17103c1',uuid=71874297-5bc8-4816-b99e-58661ec38500,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "address": "fa:16:3e:b0:64:29", "network": {"id": "c0ca9d32-e425-4576-8e7a-007b037ac6e2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-953287001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5e945a8b0f0492c9099049690ada404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa442f21d-ed", "ovs_interfaceid": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Converting VIF {"id": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "address": "fa:16:3e:b0:64:29", "network": {"id": "c0ca9d32-e425-4576-8e7a-007b037ac6e2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-953287001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5e945a8b0f0492c9099049690ada404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa442f21d-ed", "ovs_interfaceid": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:64:29,bridge_name='br-int',has_traffic_filtering=True,id=a442f21d-ed03-4b3f-89d7-c5b24175d1f9,network=Network(c0ca9d32-e425-4576-8e7a-007b037ac6e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa442f21d-ed') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG nova.objects.instance [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lazy-loading 'pci_devices' on Instance uuid 71874297-5bc8-4816-b99e-58661ec38500 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:54:01 user nova-compute[73469]:   <uuid>71874297-5bc8-4816-b99e-58661ec38500</uuid>
Aug 22 02:54:01 user nova-compute[73469]:   <name>instance-00000009</name>
Aug 22 02:54:01 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:54:01 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:54:01 user nova-compute[73469]:   <metadata>
Aug 22 02:54:01 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:54:01 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:54:01 user nova-compute[73469]:       <nova:name>tempest-ServerActionsV293TestJSON-server-377659152</nova:name>
Aug 22 02:54:01 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:54:00</nova:creationTime>
Aug 22 02:54:01 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:54:01 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:54:01 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:54:01 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:54:01 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:54:01 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:54:01 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:54:01 user nova-compute[73469]:       <nova:owner>
Aug 22 02:54:01 user nova-compute[73469]:         <nova:user uuid="cf5ba5f1c3b147388c043d08d17103c1">tempest-ServerActionsV293TestJSON-436752772-project-member</nova:user>
Aug 22 02:54:01 user nova-compute[73469]:         <nova:project uuid="f5e945a8b0f0492c9099049690ada404">tempest-ServerActionsV293TestJSON-436752772</nova:project>
Aug 22 02:54:01 user nova-compute[73469]:       </nova:owner>
Aug 22 02:54:01 user nova-compute[73469]:       <nova:ports>
Aug 22 02:54:01 user nova-compute[73469]:         <nova:port uuid="a442f21d-ed03-4b3f-89d7-c5b24175d1f9">
Aug 22 02:54:01 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 22 02:54:01 user nova-compute[73469]:         </nova:port>
Aug 22 02:54:01 user nova-compute[73469]:       </nova:ports>
Aug 22 02:54:01 user nova-compute[73469]:     </nova:instance>
Aug 22 02:54:01 user nova-compute[73469]:   </metadata>
Aug 22 02:54:01 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:54:01 user nova-compute[73469]:     <system>
Aug 22 02:54:01 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:54:01 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:54:01 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:54:01 user nova-compute[73469]:       <entry name="serial">71874297-5bc8-4816-b99e-58661ec38500</entry>
Aug 22 02:54:01 user nova-compute[73469]:       <entry name="uuid">71874297-5bc8-4816-b99e-58661ec38500</entry>
Aug 22 02:54:01 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:54:01 user nova-compute[73469]:     </system>
Aug 22 02:54:01 user nova-compute[73469]:   </sysinfo>
Aug 22 02:54:01 user nova-compute[73469]:   <os>
Aug 22 02:54:01 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:54:01 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:54:01 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:54:01 user nova-compute[73469]:   </os>
Aug 22 02:54:01 user nova-compute[73469]:   <features>
Aug 22 02:54:01 user nova-compute[73469]:     <acpi/>
Aug 22 02:54:01 user nova-compute[73469]:     <apic/>
Aug 22 02:54:01 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:54:01 user nova-compute[73469]:   </features>
Aug 22 02:54:01 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:54:01 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:54:01 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:54:01 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:54:01 user nova-compute[73469]:   </clock>
Aug 22 02:54:01 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:54:01 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:54:01 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:54:01 user nova-compute[73469]:   </cpu>
Aug 22 02:54:01 user nova-compute[73469]:   <devices>
Aug 22 02:54:01 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 02:54:01 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:54:01 user nova-compute[73469]:       <source dev="/dev/sdb"/>
Aug 22 02:54:01 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:54:01 user nova-compute[73469]:       <serial>6d2463b5-2a45-4447-b1d6-2753a728a0b4</serial>
Aug 22 02:54:01 user nova-compute[73469]:     </disk>
Aug 22 02:54:01 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:54:01 user nova-compute[73469]:       <mac address="fa:16:3e:b0:64:29"/>
Aug 22 02:54:01 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:54:01 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:54:01 user nova-compute[73469]:       <target dev="tapa442f21d-ed"/>
Aug 22 02:54:01 user nova-compute[73469]:     </interface>
Aug 22 02:54:01 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:54:01 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/71874297-5bc8-4816-b99e-58661ec38500/console.log" append="off"/>
Aug 22 02:54:01 user nova-compute[73469]:     </serial>
Aug 22 02:54:01 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:54:01 user nova-compute[73469]:     <video>
Aug 22 02:54:01 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:54:01 user nova-compute[73469]:     </video>
Aug 22 02:54:01 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:54:01 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:54:01 user nova-compute[73469]:     </rng>
Aug 22 02:54:01 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:54:01 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:54:01 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:54:01 user nova-compute[73469]:     </memballoon>
Aug 22 02:54:01 user nova-compute[73469]:   </devices>
Aug 22 02:54:01 user nova-compute[73469]: </domain>
Aug 22 02:54:01 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-377659152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-377659152',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKdydlpBpfM8iUKDYqmt+T3Vb9ogb25mCf0t5qBVWqYu7okcZIbqswy9cY7EzBR1ehqgAhMx+2jQu1gM1ufIoHEPIBlAoobLh2iMYLXMFczVAufMp/nR4kSWj02M0KlhA==',key_name='tempest-keypair-904786919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5e945a8b0f0492c9099049690ada404',ramdisk_id='',reservation_id='r-k6v908aw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-436752772',owner_user_name='tempest-ServerActionsV293TestJSON-436752772-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5ba5f1c3b147388c043d08d17103c1',uuid=71874297-5bc8-4816-b99e-58661ec38500,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "address": "fa:16:3e:b0:64:29", "network": {"id": "c0ca9d32-e425-4576-8e7a-007b037ac6e2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-953287001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5e945a8b0f0492c9099049690ada404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa442f21d-ed", "ovs_interfaceid": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Converting VIF {"id": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "address": "fa:16:3e:b0:64:29", "network": {"id": "c0ca9d32-e425-4576-8e7a-007b037ac6e2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-953287001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5e945a8b0f0492c9099049690ada404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa442f21d-ed", "ovs_interfaceid": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:64:29,bridge_name='br-int',has_traffic_filtering=True,id=a442f21d-ed03-4b3f-89d7-c5b24175d1f9,network=Network(c0ca9d32-e425-4576-8e7a-007b037ac6e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa442f21d-ed') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG os_vif [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:64:29,bridge_name='br-int',has_traffic_filtering=True,id=a442f21d-ed03-4b3f-89d7-c5b24175d1f9,network=Network(c0ca9d32-e425-4576-8e7a-007b037ac6e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa442f21d-ed') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa442f21d-ed, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa442f21d-ed, col_values=(('external_ids', {'iface-id': 'a442f21d-ed03-4b3f-89d7-c5b24175d1f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:64:29', 'vm-uuid': '71874297-5bc8-4816-b99e-58661ec38500'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:01 user nova-compute[73469]: INFO os_vif [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:64:29,bridge_name='br-int',has_traffic_filtering=True,id=a442f21d-ed03-4b3f-89d7-c5b24175d1f9,network=Network(c0ca9d32-e425-4576-8e7a-007b037ac6e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa442f21d-ed')
Aug 22 02:54:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:54:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] No VIF found with MAC fa:16:3e:b0:64:29, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:54:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:02 user nova-compute[73469]: DEBUG nova.network.neutron [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Successfully updated port: 43ab40fd-017d-404c-9456-06880b203b05 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:54:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquiring lock "refresh_cache-82db3ec6-ab80-406e-84b2-2714a01a94dc" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:54:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquired lock "refresh_cache-82db3ec6-ab80-406e-84b2-2714a01a94dc" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:54:02 user nova-compute[73469]: DEBUG nova.network.neutron [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:54:02 user nova-compute[73469]: DEBUG nova.compute.manager [req-e5d9f2de-434e-4ed1-b081-e36adae41420 req-48fe0469-1fb2-4949-b76f-047ca61829ce service nova] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Received event network-changed-43ab40fd-017d-404c-9456-06880b203b05 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:02 user nova-compute[73469]: DEBUG nova.compute.manager [req-e5d9f2de-434e-4ed1-b081-e36adae41420 req-48fe0469-1fb2-4949-b76f-047ca61829ce service nova] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Refreshing instance network info cache due to event network-changed-43ab40fd-017d-404c-9456-06880b203b05. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:54:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e5d9f2de-434e-4ed1-b081-e36adae41420 req-48fe0469-1fb2-4949-b76f-047ca61829ce service nova] Acquiring lock "refresh_cache-82db3ec6-ab80-406e-84b2-2714a01a94dc" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:54:02 user nova-compute[73469]: DEBUG nova.network.neutron [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:54:02 user nova-compute[73469]: DEBUG nova.network.neutron [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Updating instance_info_cache with network_info: [{"id": "43ab40fd-017d-404c-9456-06880b203b05", "address": "fa:16:3e:c5:48:09", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ab40fd-01", "ovs_interfaceid": "43ab40fd-017d-404c-9456-06880b203b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Releasing lock "refresh_cache-82db3ec6-ab80-406e-84b2-2714a01a94dc" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Instance network_info: |[{"id": "43ab40fd-017d-404c-9456-06880b203b05", "address": "fa:16:3e:c5:48:09", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ab40fd-01", "ovs_interfaceid": "43ab40fd-017d-404c-9456-06880b203b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e5d9f2de-434e-4ed1-b081-e36adae41420 req-48fe0469-1fb2-4949-b76f-047ca61829ce service nova] Acquired lock "refresh_cache-82db3ec6-ab80-406e-84b2-2714a01a94dc" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.network.neutron [req-e5d9f2de-434e-4ed1-b081-e36adae41420 req-48fe0469-1fb2-4949-b76f-047ca61829ce service nova] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Refreshing network info cache for port 43ab40fd-017d-404c-9456-06880b203b05 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Start _get_guest_xml network_info=[{"id": "43ab40fd-017d-404c-9456-06880b203b05", "address": "fa:16:3e:c5:48:09", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ab40fd-01", "ovs_interfaceid": "43ab40fd-017d-404c-9456-06880b203b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:54:03 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:54:03 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-368665247',display_name='tempest-VolumesActionsTest-instance-368665247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-368665247',id=10,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fd1fcacf5614d0782d38743f0f336e0',ramdisk_id='',reservation_id='r-pccb681l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1793267254',owner_user_name='tempest-VolumesActionsTest-1793267254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:54:00Z,user_data=None,user_id='7747694d4132438b9d794cb59907a328',uuid=82db3ec6-ab80-406e-84b2-2714a01a94dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43ab40fd-017d-404c-9456-06880b203b05", "address": "fa:16:3e:c5:48:09", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ab40fd-01", "ovs_interfaceid": "43ab40fd-017d-404c-9456-06880b203b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Converting VIF {"id": "43ab40fd-017d-404c-9456-06880b203b05", "address": "fa:16:3e:c5:48:09", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ab40fd-01", "ovs_interfaceid": "43ab40fd-017d-404c-9456-06880b203b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:48:09,bridge_name='br-int',has_traffic_filtering=True,id=43ab40fd-017d-404c-9456-06880b203b05,network=Network(843ceaba-5a3c-4324-bb33-81a695f19d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ab40fd-01') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.objects.instance [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lazy-loading 'pci_devices' on Instance uuid 82db3ec6-ab80-406e-84b2-2714a01a94dc {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:54:03 user nova-compute[73469]:   <uuid>82db3ec6-ab80-406e-84b2-2714a01a94dc</uuid>
Aug 22 02:54:03 user nova-compute[73469]:   <name>instance-0000000a</name>
Aug 22 02:54:03 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:54:03 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:54:03 user nova-compute[73469]:   <metadata>
Aug 22 02:54:03 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:54:03 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:54:03 user nova-compute[73469]:       <nova:name>tempest-VolumesActionsTest-instance-368665247</nova:name>
Aug 22 02:54:03 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:54:03</nova:creationTime>
Aug 22 02:54:03 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:54:03 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:54:03 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:54:03 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:54:03 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:54:03 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:54:03 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:54:03 user nova-compute[73469]:       <nova:owner>
Aug 22 02:54:03 user nova-compute[73469]:         <nova:user uuid="7747694d4132438b9d794cb59907a328">tempest-VolumesActionsTest-1793267254-project-member</nova:user>
Aug 22 02:54:03 user nova-compute[73469]:         <nova:project uuid="9fd1fcacf5614d0782d38743f0f336e0">tempest-VolumesActionsTest-1793267254</nova:project>
Aug 22 02:54:03 user nova-compute[73469]:       </nova:owner>
Aug 22 02:54:03 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:54:03 user nova-compute[73469]:       <nova:ports>
Aug 22 02:54:03 user nova-compute[73469]:         <nova:port uuid="43ab40fd-017d-404c-9456-06880b203b05">
Aug 22 02:54:03 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 22 02:54:03 user nova-compute[73469]:         </nova:port>
Aug 22 02:54:03 user nova-compute[73469]:       </nova:ports>
Aug 22 02:54:03 user nova-compute[73469]:     </nova:instance>
Aug 22 02:54:03 user nova-compute[73469]:   </metadata>
Aug 22 02:54:03 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:54:03 user nova-compute[73469]:     <system>
Aug 22 02:54:03 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:54:03 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:54:03 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:54:03 user nova-compute[73469]:       <entry name="serial">82db3ec6-ab80-406e-84b2-2714a01a94dc</entry>
Aug 22 02:54:03 user nova-compute[73469]:       <entry name="uuid">82db3ec6-ab80-406e-84b2-2714a01a94dc</entry>
Aug 22 02:54:03 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:54:03 user nova-compute[73469]:     </system>
Aug 22 02:54:03 user nova-compute[73469]:   </sysinfo>
Aug 22 02:54:03 user nova-compute[73469]:   <os>
Aug 22 02:54:03 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:54:03 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:54:03 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:54:03 user nova-compute[73469]:   </os>
Aug 22 02:54:03 user nova-compute[73469]:   <features>
Aug 22 02:54:03 user nova-compute[73469]:     <acpi/>
Aug 22 02:54:03 user nova-compute[73469]:     <apic/>
Aug 22 02:54:03 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:54:03 user nova-compute[73469]:   </features>
Aug 22 02:54:03 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:54:03 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:54:03 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:54:03 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:54:03 user nova-compute[73469]:   </clock>
Aug 22 02:54:03 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:54:03 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:54:03 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:54:03 user nova-compute[73469]:   </cpu>
Aug 22 02:54:03 user nova-compute[73469]:   <devices>
Aug 22 02:54:03 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:54:03 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:54:03 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/disk"/>
Aug 22 02:54:03 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:54:03 user nova-compute[73469]:     </disk>
Aug 22 02:54:03 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:54:03 user nova-compute[73469]:       <mac address="fa:16:3e:c5:48:09"/>
Aug 22 02:54:03 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:54:03 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:54:03 user nova-compute[73469]:       <target dev="tap43ab40fd-01"/>
Aug 22 02:54:03 user nova-compute[73469]:     </interface>
Aug 22 02:54:03 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:54:03 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/console.log" append="off"/>
Aug 22 02:54:03 user nova-compute[73469]:     </serial>
Aug 22 02:54:03 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:54:03 user nova-compute[73469]:     <video>
Aug 22 02:54:03 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:54:03 user nova-compute[73469]:     </video>
Aug 22 02:54:03 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:54:03 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:54:03 user nova-compute[73469]:     </rng>
Aug 22 02:54:03 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:54:03 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:54:03 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:54:03 user nova-compute[73469]:     </memballoon>
Aug 22 02:54:03 user nova-compute[73469]:   </devices>
Aug 22 02:54:03 user nova-compute[73469]: </domain>
Aug 22 02:54:03 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-368665247',display_name='tempest-VolumesActionsTest-instance-368665247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-368665247',id=10,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fd1fcacf5614d0782d38743f0f336e0',ramdisk_id='',reservation_id='r-pccb681l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1793267254',owner_user_name='tempest-VolumesActionsTest-1793267254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:54:00Z,user_data=None,user_id='7747694d4132438b9d794cb59907a328',uuid=82db3ec6-ab80-406e-84b2-2714a01a94dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43ab40fd-017d-404c-9456-06880b203b05", "address": "fa:16:3e:c5:48:09", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ab40fd-01", "ovs_interfaceid": "43ab40fd-017d-404c-9456-06880b203b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Converting VIF {"id": "43ab40fd-017d-404c-9456-06880b203b05", "address": "fa:16:3e:c5:48:09", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ab40fd-01", "ovs_interfaceid": "43ab40fd-017d-404c-9456-06880b203b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:48:09,bridge_name='br-int',has_traffic_filtering=True,id=43ab40fd-017d-404c-9456-06880b203b05,network=Network(843ceaba-5a3c-4324-bb33-81a695f19d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ab40fd-01') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG os_vif [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:48:09,bridge_name='br-int',has_traffic_filtering=True,id=43ab40fd-017d-404c-9456-06880b203b05,network=Network(843ceaba-5a3c-4324-bb33-81a695f19d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ab40fd-01') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43ab40fd-01, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap43ab40fd-01, col_values=(('external_ids', {'iface-id': '43ab40fd-017d-404c-9456-06880b203b05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:48:09', 'vm-uuid': '82db3ec6-ab80-406e-84b2-2714a01a94dc'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:03 user nova-compute[73469]: INFO os_vif [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:48:09,bridge_name='br-int',has_traffic_filtering=True,id=43ab40fd-017d-404c-9456-06880b203b05,network=Network(843ceaba-5a3c-4324-bb33-81a695f19d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ab40fd-01')
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] No VIF found with MAC fa:16:3e:c5:48:09, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.compute.manager [req-ee3414f8-42ac-4f4a-8dc1-38dd7355f985 req-6f3553c4-2e36-427a-9672-403c54e98004 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received event network-vif-plugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ee3414f8-42ac-4f4a-8dc1-38dd7355f985 req-6f3553c4-2e36-427a-9672-403c54e98004 service nova] Acquiring lock "71874297-5bc8-4816-b99e-58661ec38500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ee3414f8-42ac-4f4a-8dc1-38dd7355f985 req-6f3553c4-2e36-427a-9672-403c54e98004 service nova] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ee3414f8-42ac-4f4a-8dc1-38dd7355f985 req-6f3553c4-2e36-427a-9672-403c54e98004 service nova] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.compute.manager [req-ee3414f8-42ac-4f4a-8dc1-38dd7355f985 req-6f3553c4-2e36-427a-9672-403c54e98004 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] No waiting events found dispatching network-vif-plugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:54:03 user nova-compute[73469]: WARNING nova.compute.manager [req-ee3414f8-42ac-4f4a-8dc1-38dd7355f985 req-6f3553c4-2e36-427a-9672-403c54e98004 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received unexpected event network-vif-plugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 for instance with vm_state building and task_state spawning.
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.network.neutron [req-e5d9f2de-434e-4ed1-b081-e36adae41420 req-48fe0469-1fb2-4949-b76f-047ca61829ce service nova] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Updated VIF entry in instance network info cache for port 43ab40fd-017d-404c-9456-06880b203b05. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG nova.network.neutron [req-e5d9f2de-434e-4ed1-b081-e36adae41420 req-48fe0469-1fb2-4949-b76f-047ca61829ce service nova] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Updating instance_info_cache with network_info: [{"id": "43ab40fd-017d-404c-9456-06880b203b05", "address": "fa:16:3e:c5:48:09", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ab40fd-01", "ovs_interfaceid": "43ab40fd-017d-404c-9456-06880b203b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e5d9f2de-434e-4ed1-b081-e36adae41420 req-48fe0469-1fb2-4949-b76f-047ca61829ce service nova] Releasing lock "refresh_cache-82db3ec6-ab80-406e-84b2-2714a01a94dc" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:05 user nova-compute[73469]: DEBUG nova.compute.manager [req-4b3b72d7-f4ba-43fc-a20e-3f9e5ff57db9 req-3ba6601a-fe53-44a8-bd2a-d3f680a9f9ba service nova] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Received event network-vif-plugged-43ab40fd-017d-404c-9456-06880b203b05 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4b3b72d7-f4ba-43fc-a20e-3f9e5ff57db9 req-3ba6601a-fe53-44a8-bd2a-d3f680a9f9ba service nova] Acquiring lock "82db3ec6-ab80-406e-84b2-2714a01a94dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4b3b72d7-f4ba-43fc-a20e-3f9e5ff57db9 req-3ba6601a-fe53-44a8-bd2a-d3f680a9f9ba service nova] Lock "82db3ec6-ab80-406e-84b2-2714a01a94dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4b3b72d7-f4ba-43fc-a20e-3f9e5ff57db9 req-3ba6601a-fe53-44a8-bd2a-d3f680a9f9ba service nova] Lock "82db3ec6-ab80-406e-84b2-2714a01a94dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:05 user nova-compute[73469]: DEBUG nova.compute.manager [req-4b3b72d7-f4ba-43fc-a20e-3f9e5ff57db9 req-3ba6601a-fe53-44a8-bd2a-d3f680a9f9ba service nova] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] No waiting events found dispatching network-vif-plugged-43ab40fd-017d-404c-9456-06880b203b05 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:54:05 user nova-compute[73469]: WARNING nova.compute.manager [req-4b3b72d7-f4ba-43fc-a20e-3f9e5ff57db9 req-3ba6601a-fe53-44a8-bd2a-d3f680a9f9ba service nova] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Received unexpected event network-vif-plugged-43ab40fd-017d-404c-9456-06880b203b05 for instance with vm_state building and task_state spawning.
Aug 22 02:54:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:05 user nova-compute[73469]: DEBUG nova.compute.manager [req-1e8e0c0d-ef94-4f07-87c8-7a813513c859 req-4deed1e7-8223-43d8-9e77-01c3c41b1c26 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received event network-vif-plugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1e8e0c0d-ef94-4f07-87c8-7a813513c859 req-4deed1e7-8223-43d8-9e77-01c3c41b1c26 service nova] Acquiring lock "71874297-5bc8-4816-b99e-58661ec38500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1e8e0c0d-ef94-4f07-87c8-7a813513c859 req-4deed1e7-8223-43d8-9e77-01c3c41b1c26 service nova] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1e8e0c0d-ef94-4f07-87c8-7a813513c859 req-4deed1e7-8223-43d8-9e77-01c3c41b1c26 service nova] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:05 user nova-compute[73469]: DEBUG nova.compute.manager [req-1e8e0c0d-ef94-4f07-87c8-7a813513c859 req-4deed1e7-8223-43d8-9e77-01c3c41b1c26 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] No waiting events found dispatching network-vif-plugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:54:05 user nova-compute[73469]: WARNING nova.compute.manager [req-1e8e0c0d-ef94-4f07-87c8-7a813513c859 req-4deed1e7-8223-43d8-9e77-01c3c41b1c26 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received unexpected event network-vif-plugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 for instance with vm_state building and task_state spawning.
Aug 22 02:54:06 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672846.6005955, 71874297-5bc8-4816-b99e-58661ec38500 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:54:06 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 71874297-5bc8-4816-b99e-58661ec38500] VM Resumed (Lifecycle Event)
Aug 22 02:54:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:54:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:54:06 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Instance spawned successfully.
Aug 22 02:54:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:54:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:54:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:54:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:54:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:54:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:54:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:54:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:54:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:54:06 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 71874297-5bc8-4816-b99e-58661ec38500] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:54:06 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672846.6046276, 71874297-5bc8-4816-b99e-58661ec38500 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:54:06 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 71874297-5bc8-4816-b99e-58661ec38500] VM Started (Lifecycle Event)
Aug 22 02:54:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:54:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:54:06 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 71874297-5bc8-4816-b99e-58661ec38500] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:54:06 user nova-compute[73469]: INFO nova.compute.manager [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Took 6.59 seconds to spawn the instance on the hypervisor.
Aug 22 02:54:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:54:06 user nova-compute[73469]: INFO nova.compute.manager [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Took 21.93 seconds to build instance.
Aug 22 02:54:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-81df47b4-9adf-4f3f-a9a9-afdfed97dde9 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "71874297-5bc8-4816-b99e-58661ec38500" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.039s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:07 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672846.999011, 82db3ec6-ab80-406e-84b2-2714a01a94dc => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:54:07 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] VM Resumed (Lifecycle Event)
Aug 22 02:54:07 user nova-compute[73469]: DEBUG nova.compute.manager [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:54:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:54:07 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Instance spawned successfully.
Aug 22 02:54:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:54:07 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:54:07 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:54:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:54:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:54:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:54:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:54:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:54:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:54:07 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:54:07 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672847.000191, 82db3ec6-ab80-406e-84b2-2714a01a94dc => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:54:07 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] VM Started (Lifecycle Event)
Aug 22 02:54:07 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:54:07 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:54:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-12598d76-6692-42ea-b196-78c75e04b6f9 req-9b9eb66b-4395-4d40-bafb-262111640e97 service nova] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Received event network-vif-plugged-43ab40fd-017d-404c-9456-06880b203b05 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-12598d76-6692-42ea-b196-78c75e04b6f9 req-9b9eb66b-4395-4d40-bafb-262111640e97 service nova] Acquiring lock "82db3ec6-ab80-406e-84b2-2714a01a94dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-12598d76-6692-42ea-b196-78c75e04b6f9 req-9b9eb66b-4395-4d40-bafb-262111640e97 service nova] Lock "82db3ec6-ab80-406e-84b2-2714a01a94dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-12598d76-6692-42ea-b196-78c75e04b6f9 req-9b9eb66b-4395-4d40-bafb-262111640e97 service nova] Lock "82db3ec6-ab80-406e-84b2-2714a01a94dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-12598d76-6692-42ea-b196-78c75e04b6f9 req-9b9eb66b-4395-4d40-bafb-262111640e97 service nova] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] No waiting events found dispatching network-vif-plugged-43ab40fd-017d-404c-9456-06880b203b05 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:54:07 user nova-compute[73469]: WARNING nova.compute.manager [req-12598d76-6692-42ea-b196-78c75e04b6f9 req-9b9eb66b-4395-4d40-bafb-262111640e97 service nova] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Received unexpected event network-vif-plugged-43ab40fd-017d-404c-9456-06880b203b05 for instance with vm_state building and task_state spawning.
Aug 22 02:54:07 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:54:07 user nova-compute[73469]: INFO nova.compute.manager [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Took 6.60 seconds to spawn the instance on the hypervisor.
Aug 22 02:54:07 user nova-compute[73469]: DEBUG nova.compute.manager [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:54:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:07 user nova-compute[73469]: INFO nova.compute.manager [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Took 7.41 seconds to build instance.
Aug 22 02:54:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-abd92e97-ebb7-4747-a6ed-69236a8c64c3 tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "82db3ec6-ab80-406e-84b2-2714a01a94dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.524s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:54:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 02:54:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 02:54:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 02:54:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:54:28 user nova-compute[73469]: INFO nova.compute.manager [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] instance snapshotting
Aug 22 02:54:28 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Beginning live snapshot process
Aug 22 02:54:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "28e78814-0990-49e4-a6e7-e209276d2e46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:54:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:54:28 user nova-compute[73469]: INFO nova.compute.claims [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Claim successful on node user
Aug 22 02:54:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json -f qcow2 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json -f qcow2 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:29 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:54:29 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:54:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:54:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.215s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc54u3_wl/09004ee2792b4bbc972ca917cc7b75f0.delta 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc54u3_wl/09004ee2792b4bbc972ca917cc7b75f0.delta 1073741824" returned: 0 in 0.120s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:29 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 22 02:54:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:54:29 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:54:29 user nova-compute[73469]: INFO nova.compute.manager [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Rescuing
Aug 22 02:54:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "refresh_cache-dc3f5545-8ebb-4947-97d0-98a91f67e421" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:54:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquired lock "refresh_cache-dc3f5545-8ebb-4947-97d0-98a91f67e421" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:54:29 user nova-compute[73469]: DEBUG nova.network.neutron [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:54:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73469) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 22 02:54:29 user nova-compute[73469]: INFO nova.virt.libvirt.host [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] UEFI support detected
Aug 22 02:54:29 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 02:54:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:54:29 user nova-compute[73469]: INFO nova.virt.block_device [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Booting with volume 50e35ce7-e3d4-461b-951f-eb26eba9f267 at /dev/vda
Aug 22 02:54:29 user nova-compute[73469]: DEBUG os_brick.utils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:54:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc6d379-890e-4540-ae5e-b6f32db8b26e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5be89a5-77d3-435a-9da5-bd8697d7e5d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3356d7af-53a1-4618-ac5c-571a65e1387b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dae8fc-3492-47c0-80a5-6071bccf55f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG nova.policy [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '794fcc9145b94cbb989309e571bb3f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7630ab68804e4d79b0a136f5c6236ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:54:30 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 02:54:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[49202641-0e75-47e1-a990-41074f6a5555]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG os_brick.utils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Updating existing volume attachment record: c4c5f585-537c-4729-bffd-9e9b0b38f661 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG nova.network.neutron [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Updating instance_info_cache with network_info: [{"id": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "address": "fa:16:3e:89:d7:b7", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ef805d-a4", "ovs_interfaceid": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Releasing lock "refresh_cache-dc3f5545-8ebb-4947-97d0-98a91f67e421" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] COPY block job progress, current cursor: 524288 final cursor: 75497472 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-23eed005-26c2-4af7-9ec4-d341e6053e13 req-dee431a7-abe8-4075-9ac6-b22502a6e297 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Received event network-vif-unplugged-85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-23eed005-26c2-4af7-9ec4-d341e6053e13 req-dee431a7-abe8-4075-9ac6-b22502a6e297 service nova] Acquiring lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-23eed005-26c2-4af7-9ec4-d341e6053e13 req-dee431a7-abe8-4075-9ac6-b22502a6e297 service nova] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-23eed005-26c2-4af7-9ec4-d341e6053e13 req-dee431a7-abe8-4075-9ac6-b22502a6e297 service nova] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-23eed005-26c2-4af7-9ec4-d341e6053e13 req-dee431a7-abe8-4075-9ac6-b22502a6e297 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] No waiting events found dispatching network-vif-unplugged-85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:54:30 user nova-compute[73469]: WARNING nova.compute.manager [req-23eed005-26c2-4af7-9ec4-d341e6053e13 req-dee431a7-abe8-4075-9ac6-b22502a6e297 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Received unexpected event network-vif-unplugged-85ef805d-a41f-4146-bbed-a2feed61c8bb for instance with vm_state active and task_state rescuing.
Aug 22 02:54:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] COPY block job progress, current cursor: 23265280 final cursor: 75497472 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:54:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Instance destroyed successfully.
Aug 22 02:54:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Attempting rescue
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73469) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Instance directory exists: not creating {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 22 02:54:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Creating image(s)
Aug 22 02:54:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "/opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "/opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.objects.instance [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'trusted_certs' on Instance uuid dc3f5545-8ebb-4947-97d0-98a91f67e421 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Successfully created port: d4d8e796-6ff5-4094-aab4-3efd059b5645 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.201s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue" returned: 0 in 0.051s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.objects.instance [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'migration_context' on Instance uuid dc3f5545-8ebb-4947-97d0-98a91f67e421 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Start _get_guest_xml network_info=[{"id": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "address": "fa:16:3e:89:d7:b7", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "vif_mac": "fa:16:3e:89:d7:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ef805d-a4", "ovs_interfaceid": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.objects.instance [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'resources' on Instance uuid dc3f5545-8ebb-4947-97d0-98a91f67e421 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.objects.instance [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'numa_topology' on Instance uuid dc3f5545-8ebb-4947-97d0-98a91f67e421 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:54:31 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:54:31 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.objects.instance [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'vcpu_model' on Instance uuid dc3f5545-8ebb-4947-97d0-98a91f67e421 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:52:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-393165444',display_name='tempest-ServerRescueNegativeTestJSON-server-393165444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-393165444',id=3,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:52:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46cd52eb0f2642bc95dbf216ae280e12',ramdisk_id='',reservation_id='r-odxnfkyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2020570120',owner_user_name='tempest-ServerRescueNegativeTestJSON-2020570120-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:52:58Z,user_data=None,user_id='64b023ffba814ac5b6a3bc4666107767',uuid=dc3f5545-8ebb-4947-97d0-98a91f67e421,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "address": "fa:16:3e:89:d7:b7", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "vif_mac": "fa:16:3e:89:d7:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ef805d-a4", "ovs_interfaceid": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converting VIF {"id": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "address": "fa:16:3e:89:d7:b7", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "vif_mac": "fa:16:3e:89:d7:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ef805d-a4", "ovs_interfaceid": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:d7:b7,bridge_name='br-int',has_traffic_filtering=True,id=85ef805d-a41f-4146-bbed-a2feed61c8bb,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ef805d-a4') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.objects.instance [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'pci_devices' on Instance uuid dc3f5545-8ebb-4947-97d0-98a91f67e421 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:54:31 user nova-compute[73469]:   <uuid>dc3f5545-8ebb-4947-97d0-98a91f67e421</uuid>
Aug 22 02:54:31 user nova-compute[73469]:   <name>instance-00000003</name>
Aug 22 02:54:31 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:54:31 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:54:31 user nova-compute[73469]:   <metadata>
Aug 22 02:54:31 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:54:31 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:54:31 user nova-compute[73469]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-393165444</nova:name>
Aug 22 02:54:31 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:54:31</nova:creationTime>
Aug 22 02:54:31 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:54:31 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:54:31 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:54:31 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:54:31 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:54:31 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:54:31 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:54:31 user nova-compute[73469]:       <nova:owner>
Aug 22 02:54:31 user nova-compute[73469]:         <nova:user uuid="64b023ffba814ac5b6a3bc4666107767">tempest-ServerRescueNegativeTestJSON-2020570120-project-member</nova:user>
Aug 22 02:54:31 user nova-compute[73469]:         <nova:project uuid="46cd52eb0f2642bc95dbf216ae280e12">tempest-ServerRescueNegativeTestJSON-2020570120</nova:project>
Aug 22 02:54:31 user nova-compute[73469]:       </nova:owner>
Aug 22 02:54:31 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:54:31 user nova-compute[73469]:       <nova:ports>
Aug 22 02:54:31 user nova-compute[73469]:         <nova:port uuid="85ef805d-a41f-4146-bbed-a2feed61c8bb">
Aug 22 02:54:31 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 22 02:54:31 user nova-compute[73469]:         </nova:port>
Aug 22 02:54:31 user nova-compute[73469]:       </nova:ports>
Aug 22 02:54:31 user nova-compute[73469]:     </nova:instance>
Aug 22 02:54:31 user nova-compute[73469]:   </metadata>
Aug 22 02:54:31 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:54:31 user nova-compute[73469]:     <system>
Aug 22 02:54:31 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:54:31 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:54:31 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:54:31 user nova-compute[73469]:       <entry name="serial">dc3f5545-8ebb-4947-97d0-98a91f67e421</entry>
Aug 22 02:54:31 user nova-compute[73469]:       <entry name="uuid">dc3f5545-8ebb-4947-97d0-98a91f67e421</entry>
Aug 22 02:54:31 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:54:31 user nova-compute[73469]:     </system>
Aug 22 02:54:31 user nova-compute[73469]:   </sysinfo>
Aug 22 02:54:31 user nova-compute[73469]:   <os>
Aug 22 02:54:31 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:54:31 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:54:31 user nova-compute[73469]:   </os>
Aug 22 02:54:31 user nova-compute[73469]:   <features>
Aug 22 02:54:31 user nova-compute[73469]:     <acpi/>
Aug 22 02:54:31 user nova-compute[73469]:     <apic/>
Aug 22 02:54:31 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:54:31 user nova-compute[73469]:   </features>
Aug 22 02:54:31 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:54:31 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:54:31 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:54:31 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:54:31 user nova-compute[73469]:   </clock>
Aug 22 02:54:31 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:54:31 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:54:31 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:54:31 user nova-compute[73469]:   </cpu>
Aug 22 02:54:31 user nova-compute[73469]:   <devices>
Aug 22 02:54:31 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:54:31 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:54:31 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue"/>
Aug 22 02:54:31 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:54:31 user nova-compute[73469]:     </disk>
Aug 22 02:54:31 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:54:31 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:54:31 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk"/>
Aug 22 02:54:31 user nova-compute[73469]:       <target dev="vdb" bus="virtio"/>
Aug 22 02:54:31 user nova-compute[73469]:     </disk>
Aug 22 02:54:31 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:54:31 user nova-compute[73469]:       <mac address="fa:16:3e:89:d7:b7"/>
Aug 22 02:54:31 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:54:31 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:54:31 user nova-compute[73469]:       <target dev="tap85ef805d-a4"/>
Aug 22 02:54:31 user nova-compute[73469]:     </interface>
Aug 22 02:54:31 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:54:31 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/console.log" append="off"/>
Aug 22 02:54:31 user nova-compute[73469]:     </serial>
Aug 22 02:54:31 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:54:31 user nova-compute[73469]:     <video>
Aug 22 02:54:31 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:54:31 user nova-compute[73469]:     </video>
Aug 22 02:54:31 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:54:31 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:54:31 user nova-compute[73469]:     </rng>
Aug 22 02:54:31 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:54:31 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:54:31 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:54:31 user nova-compute[73469]:     </memballoon>
Aug 22 02:54:31 user nova-compute[73469]:   </devices>
Aug 22 02:54:31 user nova-compute[73469]: </domain>
Aug 22 02:54:31 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:54:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 22 02:54:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Instance destroyed successfully.
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.privsep.utils [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc54u3_wl/09004ee2792b4bbc972ca917cc7b75f0.delta /opt/stack/data/nova/instances/snapshots/tmpc54u3_wl/09004ee2792b4bbc972ca917cc7b75f0 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] No VIF found with MAC fa:16:3e:89:d7:b7, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:54:31 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Successfully created port: 0f58efb2-2fd2-42d0-a2db-f7b821677d19 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:54:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:32 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Updating instance_info_cache with network_info: [{"id": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "address": "fa:16:3e:8e:27:47", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6148435c-1c", "ovs_interfaceid": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:54:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc54u3_wl/09004ee2792b4bbc972ca917cc7b75f0.delta /opt/stack/data/nova/instances/snapshots/tmpc54u3_wl/09004ee2792b4bbc972ca917cc7b75f0" returned: 0 in 0.552s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:32 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Snapshot extracted, beginning image upload
Aug 22 02:54:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:54:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 02:54:32 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:54:32 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:54:32 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:54:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:32 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 02:54:32 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Successfully created port: 4f06a837-3e8c-4362-814a-3b9cd8085a05 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:54:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-674c1d2d-342d-41ba-bc10-050c13b6ea28 req-89c872c7-5ef6-4922-b9c8-041789115e3b service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Received event network-vif-plugged-85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-674c1d2d-342d-41ba-bc10-050c13b6ea28 req-89c872c7-5ef6-4922-b9c8-041789115e3b service nova] Acquiring lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-674c1d2d-342d-41ba-bc10-050c13b6ea28 req-89c872c7-5ef6-4922-b9c8-041789115e3b service nova] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-674c1d2d-342d-41ba-bc10-050c13b6ea28 req-89c872c7-5ef6-4922-b9c8-041789115e3b service nova] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-674c1d2d-342d-41ba-bc10-050c13b6ea28 req-89c872c7-5ef6-4922-b9c8-041789115e3b service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] No waiting events found dispatching network-vif-plugged-85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:54:32 user nova-compute[73469]: WARNING nova.compute.manager [req-674c1d2d-342d-41ba-bc10-050c13b6ea28 req-89c872c7-5ef6-4922-b9c8-041789115e3b service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Received unexpected event network-vif-plugged-85ef805d-a41f-4146-bbed-a2feed61c8bb for instance with vm_state active and task_state rescuing.
Aug 22 02:54:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:33 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Successfully created port: 45e4812b-ca27-47b3-b289-63089cb11e00 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:54:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:34 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Successfully created port: cbc301cc-bb85-4871-b3bf-d4dfc54c99ba {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:54:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-65d4f466-1a4e-4cad-ad79-59113c6aaaa1 req-10cc7cc0-a39f-447c-8183-99069ab49994 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Received event network-vif-plugged-85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-65d4f466-1a4e-4cad-ad79-59113c6aaaa1 req-10cc7cc0-a39f-447c-8183-99069ab49994 service nova] Acquiring lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-65d4f466-1a4e-4cad-ad79-59113c6aaaa1 req-10cc7cc0-a39f-447c-8183-99069ab49994 service nova] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-65d4f466-1a4e-4cad-ad79-59113c6aaaa1 req-10cc7cc0-a39f-447c-8183-99069ab49994 service nova] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-65d4f466-1a4e-4cad-ad79-59113c6aaaa1 req-10cc7cc0-a39f-447c-8183-99069ab49994 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] No waiting events found dispatching network-vif-plugged-85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:54:34 user nova-compute[73469]: WARNING nova.compute.manager [req-65d4f466-1a4e-4cad-ad79-59113c6aaaa1 req-10cc7cc0-a39f-447c-8183-99069ab49994 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Received unexpected event network-vif-plugged-85ef805d-a41f-4146-bbed-a2feed61c8bb for instance with vm_state active and task_state rescuing.
Aug 22 02:54:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-65d4f466-1a4e-4cad-ad79-59113c6aaaa1 req-10cc7cc0-a39f-447c-8183-99069ab49994 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Received event network-vif-plugged-85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-65d4f466-1a4e-4cad-ad79-59113c6aaaa1 req-10cc7cc0-a39f-447c-8183-99069ab49994 service nova] Acquiring lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-65d4f466-1a4e-4cad-ad79-59113c6aaaa1 req-10cc7cc0-a39f-447c-8183-99069ab49994 service nova] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-65d4f466-1a4e-4cad-ad79-59113c6aaaa1 req-10cc7cc0-a39f-447c-8183-99069ab49994 service nova] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-65d4f466-1a4e-4cad-ad79-59113c6aaaa1 req-10cc7cc0-a39f-447c-8183-99069ab49994 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] No waiting events found dispatching network-vif-plugged-85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:54:34 user nova-compute[73469]: WARNING nova.compute.manager [req-65d4f466-1a4e-4cad-ad79-59113c6aaaa1 req-10cc7cc0-a39f-447c-8183-99069ab49994 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Received unexpected event network-vif-plugged-85ef805d-a41f-4146-bbed-a2feed61c8bb for instance with vm_state active and task_state rescuing.
Aug 22 02:54:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:35 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Snapshot image upload complete
Aug 22 02:54:35 user nova-compute[73469]: INFO nova.compute.manager [None req-de964339-216d-4722-842d-ffa2bb2b5e73 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Took 6.81 seconds to snapshot the instance on the hypervisor.
Aug 22 02:54:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:35 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Successfully updated port: d4d8e796-6ff5-4094-aab4-3efd059b5645 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:54:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-b8129ac3-5a5a-45b3-ae80-6ac230293572 req-1f8f6d52-a3a6-4d1c-8f53-24f144e33ad4 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-changed-d4d8e796-6ff5-4094-aab4-3efd059b5645 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-b8129ac3-5a5a-45b3-ae80-6ac230293572 req-1f8f6d52-a3a6-4d1c-8f53-24f144e33ad4 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Refreshing instance network info cache due to event network-changed-d4d8e796-6ff5-4094-aab4-3efd059b5645. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:54:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b8129ac3-5a5a-45b3-ae80-6ac230293572 req-1f8f6d52-a3a6-4d1c-8f53-24f144e33ad4 service nova] Acquiring lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:54:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b8129ac3-5a5a-45b3-ae80-6ac230293572 req-1f8f6d52-a3a6-4d1c-8f53-24f144e33ad4 service nova] Acquired lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:54:35 user nova-compute[73469]: DEBUG nova.network.neutron [req-b8129ac3-5a5a-45b3-ae80-6ac230293572 req-1f8f6d52-a3a6-4d1c-8f53-24f144e33ad4 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Refreshing network info cache for port d4d8e796-6ff5-4094-aab4-3efd059b5645 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:54:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Removed pending event for dc3f5545-8ebb-4947-97d0-98a91f67e421 due to event {{(pid=73469) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 22 02:54:36 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672876.0134954, dc3f5545-8ebb-4947-97d0-98a91f67e421 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:54:36 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] VM Resumed (Lifecycle Event)
Aug 22 02:54:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-891a6621-44a9-40d5-8470-603be587f37a tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:54:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:54:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:54:36 user nova-compute[73469]: DEBUG nova.network.neutron [req-b8129ac3-5a5a-45b3-ae80-6ac230293572 req-1f8f6d52-a3a6-4d1c-8f53-24f144e33ad4 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:54:36 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 22 02:54:36 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672876.0141077, dc3f5545-8ebb-4947-97d0-98a91f67e421 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:54:36 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] VM Started (Lifecycle Event)
Aug 22 02:54:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:54:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:54:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:36 user nova-compute[73469]: DEBUG nova.network.neutron [req-b8129ac3-5a5a-45b3-ae80-6ac230293572 req-1f8f6d52-a3a6-4d1c-8f53-24f144e33ad4 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:54:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b8129ac3-5a5a-45b3-ae80-6ac230293572 req-1f8f6d52-a3a6-4d1c-8f53-24f144e33ad4 service nova] Releasing lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:54:36 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Successfully updated port: f962364e-a4e1-4d88-b7b5-5dcc07eb8220 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:54:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Acquiring lock "759d99dd-a48e-489a-bc96-b4365b1fd17f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lazy-loading 'flavor' on Instance uuid 759d99dd-a48e-489a-bc96-b4365b1fd17f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.149s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Acquiring lock "759d99dd-a48e-489a-bc96-b4365b1fd17f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:37 user nova-compute[73469]: INFO nova.compute.manager [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Attaching volume ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 to /dev/vdb
Aug 22 02:54:37 user nova-compute[73469]: DEBUG os_brick.utils [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[112d6588-e0eb-4b02-8c7f-6d879ba0ee31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a242202-61ec-40cd-8364-4e73e79538bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ab7895-2a7d-4a8b-8875-d3f2b25fa47d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bebb9ff-87f5-4c8a-ac53-0df7d32278f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:54:37 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f83d304-99c9-41ef-b565-e43dcbd28a32]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG os_brick.utils [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Updating existing volume attachment record: cafc534b-cf9b-4cb7-a3ca-6b0a5632f225 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Successfully updated port: 6af318a1-2ecf-4320-933c-4836f592367a {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG nova.compute.manager [req-05c01648-55d2-4909-9893-3a4343476325 req-52e2df2c-25a5-461c-a29e-fb489d4c97ba service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-changed-f962364e-a4e1-4d88-b7b5-5dcc07eb8220 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG nova.compute.manager [req-05c01648-55d2-4909-9893-3a4343476325 req-52e2df2c-25a5-461c-a29e-fb489d4c97ba service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Refreshing instance network info cache due to event network-changed-f962364e-a4e1-4d88-b7b5-5dcc07eb8220. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-05c01648-55d2-4909-9893-3a4343476325 req-52e2df2c-25a5-461c-a29e-fb489d4c97ba service nova] Acquiring lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-05c01648-55d2-4909-9893-3a4343476325 req-52e2df2c-25a5-461c-a29e-fb489d4c97ba service nova] Acquired lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:54:37 user nova-compute[73469]: DEBUG nova.network.neutron [req-05c01648-55d2-4909-9893-3a4343476325 req-52e2df2c-25a5-461c-a29e-fb489d4c97ba service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Refreshing network info cache for port f962364e-a4e1-4d88-b7b5-5dcc07eb8220 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG nova.network.neutron [req-05c01648-55d2-4909-9893-3a4343476325 req-52e2df2c-25a5-461c-a29e-fb489d4c97ba service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG nova.network.neutron [req-05c01648-55d2-4909-9893-3a4343476325 req-52e2df2c-25a5-461c-a29e-fb489d4c97ba service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-05c01648-55d2-4909-9893-3a4343476325 req-52e2df2c-25a5-461c-a29e-fb489d4c97ba service nova] Releasing lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-05c01648-55d2-4909-9893-3a4343476325 req-52e2df2c-25a5-461c-a29e-fb489d4c97ba service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-changed-6af318a1-2ecf-4320-933c-4836f592367a {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-05c01648-55d2-4909-9893-3a4343476325 req-52e2df2c-25a5-461c-a29e-fb489d4c97ba service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Refreshing instance network info cache due to event network-changed-6af318a1-2ecf-4320-933c-4836f592367a. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-05c01648-55d2-4909-9893-3a4343476325 req-52e2df2c-25a5-461c-a29e-fb489d4c97ba service nova] Acquiring lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-05c01648-55d2-4909-9893-3a4343476325 req-52e2df2c-25a5-461c-a29e-fb489d4c97ba service nova] Acquired lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG nova.network.neutron [req-05c01648-55d2-4909-9893-3a4343476325 req-52e2df2c-25a5-461c-a29e-fb489d4c97ba service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Refreshing network info cache for port 6af318a1-2ecf-4320-933c-4836f592367a {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG nova.network.neutron [req-05c01648-55d2-4909-9893-3a4343476325 req-52e2df2c-25a5-461c-a29e-fb489d4c97ba service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG nova.network.neutron [req-05c01648-55d2-4909-9893-3a4343476325 req-52e2df2c-25a5-461c-a29e-fb489d4c97ba service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-05c01648-55d2-4909-9893-3a4343476325 req-52e2df2c-25a5-461c-a29e-fb489d4c97ba service nova] Releasing lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:54:38 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Successfully updated port: 0f58efb2-2fd2-42d0-a2db-f7b821677d19 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:54:39 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:54:39 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:54:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=6944MB free_disk=25.526046752929688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 02:54:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:54:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f5fdf305-bf02-4b53-bb0d-83e939ae1acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:54:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 759d99dd-a48e-489a-bc96-b4365b1fd17f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:54:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d0668c0-7a49-4857-9b69-541021f18ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:54:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance dc3f5545-8ebb-4947-97d0-98a91f67e421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:54:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f478387d-e004-4314-961d-abf4a910e970 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:54:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 28e78814-0990-49e4-a6e7-e209276d2e46 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:54:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82db3ec6-ab80-406e-84b2-2714a01a94dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:54:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:54:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f988e66c-6bd1-49bb-ac43-140008f7c995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:54:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 71874297-5bc8-4816-b99e-58661ec38500 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:54:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 02:54:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 02:54:39 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:54:39 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:54:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 02:54:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:40 user nova-compute[73469]: DEBUG nova.compute.manager [req-4655ae37-fadd-4d8e-bb92-b99b8379f9e2 req-2cce1e34-63a6-4031-80d3-44d1c902b4f9 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-changed-0f58efb2-2fd2-42d0-a2db-f7b821677d19 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:40 user nova-compute[73469]: DEBUG nova.compute.manager [req-4655ae37-fadd-4d8e-bb92-b99b8379f9e2 req-2cce1e34-63a6-4031-80d3-44d1c902b4f9 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Refreshing instance network info cache due to event network-changed-0f58efb2-2fd2-42d0-a2db-f7b821677d19. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:54:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4655ae37-fadd-4d8e-bb92-b99b8379f9e2 req-2cce1e34-63a6-4031-80d3-44d1c902b4f9 service nova] Acquiring lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:54:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4655ae37-fadd-4d8e-bb92-b99b8379f9e2 req-2cce1e34-63a6-4031-80d3-44d1c902b4f9 service nova] Acquired lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:54:40 user nova-compute[73469]: DEBUG nova.network.neutron [req-4655ae37-fadd-4d8e-bb92-b99b8379f9e2 req-2cce1e34-63a6-4031-80d3-44d1c902b4f9 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Refreshing network info cache for port 0f58efb2-2fd2-42d0-a2db-f7b821677d19 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:54:40 user nova-compute[73469]: DEBUG nova.network.neutron [req-4655ae37-fadd-4d8e-bb92-b99b8379f9e2 req-2cce1e34-63a6-4031-80d3-44d1c902b4f9 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:54:40 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Successfully updated port: 4f06a837-3e8c-4362-814a-3b9cd8085a05 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:54:40 user nova-compute[73469]: DEBUG nova.network.neutron [req-4655ae37-fadd-4d8e-bb92-b99b8379f9e2 req-2cce1e34-63a6-4031-80d3-44d1c902b4f9 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:54:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4655ae37-fadd-4d8e-bb92-b99b8379f9e2 req-2cce1e34-63a6-4031-80d3-44d1c902b4f9 service nova] Releasing lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:54:40 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:54:40 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:54:40 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:54:40 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:54:40 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:54:40 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:54:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 02:54:41 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Successfully updated port: 45e4812b-ca27-47b3-b289-63089cb11e00 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:54:42 user nova-compute[73469]: DEBUG nova.compute.manager [req-1fa53aaa-6e0d-411e-ac8f-f902b7006668 req-568877c1-6e9e-47dc-b553-dc3be5a4587a service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-changed-4f06a837-3e8c-4362-814a-3b9cd8085a05 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:42 user nova-compute[73469]: DEBUG nova.compute.manager [req-1fa53aaa-6e0d-411e-ac8f-f902b7006668 req-568877c1-6e9e-47dc-b553-dc3be5a4587a service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Refreshing instance network info cache due to event network-changed-4f06a837-3e8c-4362-814a-3b9cd8085a05. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:54:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1fa53aaa-6e0d-411e-ac8f-f902b7006668 req-568877c1-6e9e-47dc-b553-dc3be5a4587a service nova] Acquiring lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:54:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1fa53aaa-6e0d-411e-ac8f-f902b7006668 req-568877c1-6e9e-47dc-b553-dc3be5a4587a service nova] Acquired lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:54:42 user nova-compute[73469]: DEBUG nova.network.neutron [req-1fa53aaa-6e0d-411e-ac8f-f902b7006668 req-568877c1-6e9e-47dc-b553-dc3be5a4587a service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Refreshing network info cache for port 4f06a837-3e8c-4362-814a-3b9cd8085a05 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:54:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:42 user nova-compute[73469]: DEBUG nova.network.neutron [req-1fa53aaa-6e0d-411e-ac8f-f902b7006668 req-568877c1-6e9e-47dc-b553-dc3be5a4587a service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:54:42 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Successfully updated port: cbc301cc-bb85-4871-b3bf-d4dfc54c99ba {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:54:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Acquiring lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:54:42 user nova-compute[73469]: DEBUG nova.network.neutron [req-1fa53aaa-6e0d-411e-ac8f-f902b7006668 req-568877c1-6e9e-47dc-b553-dc3be5a4587a service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:54:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1fa53aaa-6e0d-411e-ac8f-f902b7006668 req-568877c1-6e9e-47dc-b553-dc3be5a4587a service nova] Releasing lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:54:42 user nova-compute[73469]: DEBUG nova.compute.manager [req-1fa53aaa-6e0d-411e-ac8f-f902b7006668 req-568877c1-6e9e-47dc-b553-dc3be5a4587a service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-changed-45e4812b-ca27-47b3-b289-63089cb11e00 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:42 user nova-compute[73469]: DEBUG nova.compute.manager [req-1fa53aaa-6e0d-411e-ac8f-f902b7006668 req-568877c1-6e9e-47dc-b553-dc3be5a4587a service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Refreshing instance network info cache due to event network-changed-45e4812b-ca27-47b3-b289-63089cb11e00. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:54:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1fa53aaa-6e0d-411e-ac8f-f902b7006668 req-568877c1-6e9e-47dc-b553-dc3be5a4587a service nova] Acquiring lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:54:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1fa53aaa-6e0d-411e-ac8f-f902b7006668 req-568877c1-6e9e-47dc-b553-dc3be5a4587a service nova] Acquired lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:54:42 user nova-compute[73469]: DEBUG nova.network.neutron [req-1fa53aaa-6e0d-411e-ac8f-f902b7006668 req-568877c1-6e9e-47dc-b553-dc3be5a4587a service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Refreshing network info cache for port 45e4812b-ca27-47b3-b289-63089cb11e00 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:54:43 user nova-compute[73469]: DEBUG nova.network.neutron [req-1fa53aaa-6e0d-411e-ac8f-f902b7006668 req-568877c1-6e9e-47dc-b553-dc3be5a4587a service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:54:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:43 user nova-compute[73469]: DEBUG nova.network.neutron [req-1fa53aaa-6e0d-411e-ac8f-f902b7006668 req-568877c1-6e9e-47dc-b553-dc3be5a4587a service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:54:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1fa53aaa-6e0d-411e-ac8f-f902b7006668 req-568877c1-6e9e-47dc-b553-dc3be5a4587a service nova] Releasing lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:54:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Acquired lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:54:43 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:54:43 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:54:44 user nova-compute[73469]: DEBUG nova.compute.manager [req-0bd3f7da-32d1-4ebc-bff7-97aaa4871b18 req-5549f61f-1426-41dc-bf67-76f06d41a0e8 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-changed-cbc301cc-bb85-4871-b3bf-d4dfc54c99ba {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:44 user nova-compute[73469]: DEBUG nova.compute.manager [req-0bd3f7da-32d1-4ebc-bff7-97aaa4871b18 req-5549f61f-1426-41dc-bf67-76f06d41a0e8 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Refreshing instance network info cache due to event network-changed-cbc301cc-bb85-4871-b3bf-d4dfc54c99ba. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:54:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0bd3f7da-32d1-4ebc-bff7-97aaa4871b18 req-5549f61f-1426-41dc-bf67-76f06d41a0e8 service nova] Acquiring lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:54:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:46 user nova-compute[73469]: INFO nova.virt.block_device [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Booting with volume 2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 at /dev/vdb
Aug 22 02:54:46 user nova-compute[73469]: DEBUG os_brick.utils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8807c9-264a-4768-b3ea-4e48a993ac96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36d1503-0177-468a-8a5f-988a7e3d000d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce090cca-26d0-4ad6-a997-e283cb64f70e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[54769dbe-f856-4972-84ba-89111b2a9429]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:54:46 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 02:54:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff08adeb-af0a-4897-bd13-afeca4ec104e]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG os_brick.utils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:54:46 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Updating existing volume attachment record: 73ee7d2e-3d95-473f-a476-a2e301ff4b7c {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 02:54:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:47 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Updating instance_info_cache with network_info: [{"id": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "address": "fa:16:3e:d4:b8:e1", "network": {"id": "f37e6636-5a5f-4465-91c5-6f305460d1d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903703061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d8e796-6f", "ovs_interfaceid": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "address": "fa:16:3e:97:ea:4f", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf962364e-a4", "ovs_interfaceid": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6af318a1-2ecf-4320-933c-4836f592367a", "address": "fa:16:3e:08:32:58", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af318a1-2e", "ovs_interfaceid": "6af318a1-2ecf-4320-933c-4836f592367a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "address": "fa:16:3e:fe:42:04", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f58efb2-2f", "ovs_interfaceid": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "address": "fa:16:3e:fc:e2:5d", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f06a837-3e", "ovs_interfaceid": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45e4812b-ca27-47b3-b289-63089cb11e00", "address": "fa:16:3e:a7:8f:57", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e4812b-ca", "ovs_interfaceid": "45e4812b-ca27-47b3-b289-63089cb11e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "address": "fa:16:3e:d6:db:55", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc301cc-bb", "ovs_interfaceid": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:54:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Releasing lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:54:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Instance network_info: |[{"id": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "address": "fa:16:3e:d4:b8:e1", "network": {"id": "f37e6636-5a5f-4465-91c5-6f305460d1d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903703061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d8e796-6f", "ovs_interfaceid": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "address": "fa:16:3e:97:ea:4f", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf962364e-a4", "ovs_interfaceid": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6af318a1-2ecf-4320-933c-4836f592367a", "address": "fa:16:3e:08:32:58", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af318a1-2e", "ovs_interfaceid": "6af318a1-2ecf-4320-933c-4836f592367a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "address": "fa:16:3e:fe:42:04", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f58efb2-2f", "ovs_interfaceid": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "address": "fa:16:3e:fc:e2:5d", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f06a837-3e", "ovs_interfaceid": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45e4812b-ca27-47b3-b289-63089cb11e00", "address": "fa:16:3e:a7:8f:57", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e4812b-ca", "ovs_interfaceid": "45e4812b-ca27-47b3-b289-63089cb11e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "address": "fa:16:3e:d6:db:55", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc301cc-bb", "ovs_interfaceid": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:54:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0bd3f7da-32d1-4ebc-bff7-97aaa4871b18 req-5549f61f-1426-41dc-bf67-76f06d41a0e8 service nova] Acquired lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:54:47 user nova-compute[73469]: DEBUG nova.network.neutron [req-0bd3f7da-32d1-4ebc-bff7-97aaa4871b18 req-5549f61f-1426-41dc-bf67-76f06d41a0e8 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Refreshing network info cache for port cbc301cc-bb85-4871-b3bf-d4dfc54c99ba {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:54:48 user nova-compute[73469]: DEBUG nova.network.neutron [req-0bd3f7da-32d1-4ebc-bff7-97aaa4871b18 req-5549f61f-1426-41dc-bf67-76f06d41a0e8 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Updated VIF entry in instance network info cache for port cbc301cc-bb85-4871-b3bf-d4dfc54c99ba. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:54:48 user nova-compute[73469]: DEBUG nova.network.neutron [req-0bd3f7da-32d1-4ebc-bff7-97aaa4871b18 req-5549f61f-1426-41dc-bf67-76f06d41a0e8 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Updating instance_info_cache with network_info: [{"id": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "address": "fa:16:3e:d4:b8:e1", "network": {"id": "f37e6636-5a5f-4465-91c5-6f305460d1d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903703061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d8e796-6f", "ovs_interfaceid": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "address": "fa:16:3e:97:ea:4f", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf962364e-a4", "ovs_interfaceid": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6af318a1-2ecf-4320-933c-4836f592367a", "address": "fa:16:3e:08:32:58", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af318a1-2e", "ovs_interfaceid": "6af318a1-2ecf-4320-933c-4836f592367a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "address": "fa:16:3e:fe:42:04", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f58efb2-2f", "ovs_interfaceid": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "address": "fa:16:3e:fc:e2:5d", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f06a837-3e", "ovs_interfaceid": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45e4812b-ca27-47b3-b289-63089cb11e00", "address": "fa:16:3e:a7:8f:57", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e4812b-ca", "ovs_interfaceid": "45e4812b-ca27-47b3-b289-63089cb11e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "address": "fa:16:3e:d6:db:55", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc301cc-bb", "ovs_interfaceid": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:54:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0bd3f7da-32d1-4ebc-bff7-97aaa4871b18 req-5549f61f-1426-41dc-bf67-76f06d41a0e8 service nova] Releasing lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:54:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qHyeWQEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:54:50 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:54:50 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:54:50 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b521a94b-e85a-402e-9fe8-e4d7592a52a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 02:54:50 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8299985-44cf-4d3f-8c31-bb054ed52057]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69] added
Aug 22 02:54:50 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4c7a81-1879-44c3-9f97-233f4669e4aa]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fa6fec-008e-45c8-a59d-c80624e84080]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qHyeWQEk {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qHyeWQEk" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e9c87e-1f26-407e-9aa9-e6d2307d5f94]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qHyeWQEk'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[65da2105-4ba2-404d-ad2f-a3a1bfd92578]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed2cd65-40a3-4c4f-8963-e68ad5097f1c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:54:50 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:54:50 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a122dc-7944-48ed-be22-39c1ec9c6b09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69, portal: 172.16.0.220,3260]
Aug 22 02:54:50 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69, portal: 172.16.0.220,3260] successful.
Aug 22 02:54:50 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7a60cd-7833-4fd3-89bf-0f45dba3ab4b]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[019c9260-fa27-46e9-ab0b-357068e4f822]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:54:50 user nova-compute[73469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 (non-flash)
Aug 22 02:54:50 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:54:50 user nova-compute[73469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 (non-flash)
Aug 22 02:54:50 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b962694-fbe4-4e9c-87cd-afc48bda17ec]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:54:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qHyeWQEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 02:54:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:54:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23939303139363737', 'path': '/dev/sdc'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:54:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939303139363737', 'path': '/dev/sdc'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 02:54:51 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lazy-loading 'flavor' on Instance uuid 759d99dd-a48e-489a-bc96-b4365b1fd17f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:54:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 02:54:51 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:54:51 user nova-compute[73469]:   <source dev="/dev/sdc"/>
Aug 22 02:54:51 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 02:54:51 user nova-compute[73469]:   <serial>ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69</serial>
Aug 22 02:54:51 user nova-compute[73469]: </disk>
Aug 22 02:54:51 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 02:54:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:52 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:54:52 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:54:52 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] No VIF found with MAC fa:16:3e:cc:8b:35, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:54:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec71456f-7b9f-4cd1-a096-116ceb1594ec tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.094s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:52 user nova-compute[73469]: DEBUG nova.compute.manager [req-9ca28c74-a375-42e4-b672-f9f276fb6914 req-70e530d6-2328-4c00-b08d-e0511ab7a54a service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Received event network-changed-1dffa70d-3c6e-4c82-9c6b-4d182c9f0365 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:52 user nova-compute[73469]: DEBUG nova.compute.manager [req-9ca28c74-a375-42e4-b672-f9f276fb6914 req-70e530d6-2328-4c00-b08d-e0511ab7a54a service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Refreshing instance network info cache due to event network-changed-1dffa70d-3c6e-4c82-9c6b-4d182c9f0365. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:54:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9ca28c74-a375-42e4-b672-f9f276fb6914 req-70e530d6-2328-4c00-b08d-e0511ab7a54a service nova] Acquiring lock "refresh_cache-f5fdf305-bf02-4b53-bb0d-83e939ae1acb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:54:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9ca28c74-a375-42e4-b672-f9f276fb6914 req-70e530d6-2328-4c00-b08d-e0511ab7a54a service nova] Acquired lock "refresh_cache-f5fdf305-bf02-4b53-bb0d-83e939ae1acb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:54:52 user nova-compute[73469]: DEBUG nova.network.neutron [req-9ca28c74-a375-42e4-b672-f9f276fb6914 req-70e530d6-2328-4c00-b08d-e0511ab7a54a service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Refreshing network info cache for port 1dffa70d-3c6e-4c82-9c6b-4d182c9f0365 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:54:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Acquiring lock "759d99dd-a48e-489a-bc96-b4365b1fd17f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Acquiring lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:52 user nova-compute[73469]: INFO nova.compute.manager [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Terminating instance
Aug 22 02:54:52 user nova-compute[73469]: DEBUG nova.compute.manager [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 02:54:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG nova.compute.manager [req-67783f00-5dba-4a54-8d33-f16667463259 req-565fbe3f-c883-4ddf-a78a-4a9c50f32a92 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Received event network-vif-unplugged-d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-67783f00-5dba-4a54-8d33-f16667463259 req-565fbe3f-c883-4ddf-a78a-4a9c50f32a92 service nova] Acquiring lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-67783f00-5dba-4a54-8d33-f16667463259 req-565fbe3f-c883-4ddf-a78a-4a9c50f32a92 service nova] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-67783f00-5dba-4a54-8d33-f16667463259 req-565fbe3f-c883-4ddf-a78a-4a9c50f32a92 service nova] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG nova.compute.manager [req-67783f00-5dba-4a54-8d33-f16667463259 req-565fbe3f-c883-4ddf-a78a-4a9c50f32a92 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] No waiting events found dispatching network-vif-unplugged-d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG nova.compute.manager [req-67783f00-5dba-4a54-8d33-f16667463259 req-565fbe3f-c883-4ddf-a78a-4a9c50f32a92 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Received event network-vif-unplugged-d38956d2-634a-4523-9111-e113654418ad for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:53 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Instance destroyed successfully.
Aug 22 02:54:53 user nova-compute[73469]: DEBUG nova.objects.instance [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lazy-loading 'resources' on Instance uuid 759d99dd-a48e-489a-bc96-b4365b1fd17f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1632433254',display_name='tempest-DeleteServersTestJSON-server-1632433254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1632433254',id=4,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:52:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fb5668009ac4dc9bbce7142275795ad',ramdisk_id='',reservation_id='r-ufp9nxti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1883805460',owner_user_name='tempest-DeleteServersTestJSON-1883805460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:52:58Z,user_data=None,user_id='cc7a13ca907b44ac805814e070afb9d1',uuid=759d99dd-a48e-489a-bc96-b4365b1fd17f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d38956d2-634a-4523-9111-e113654418ad", "address": "fa:16:3e:cc:8b:35", "network": {"id": "a7b64e12-abb3-4a23-87ea-1991927b957d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214261658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb5668009ac4dc9bbce7142275795ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38956d2-63", "ovs_interfaceid": "d38956d2-634a-4523-9111-e113654418ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Converting VIF {"id": "d38956d2-634a-4523-9111-e113654418ad", "address": "fa:16:3e:cc:8b:35", "network": {"id": "a7b64e12-abb3-4a23-87ea-1991927b957d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214261658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb5668009ac4dc9bbce7142275795ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38956d2-63", "ovs_interfaceid": "d38956d2-634a-4523-9111-e113654418ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:8b:35,bridge_name='br-int',has_traffic_filtering=True,id=d38956d2-634a-4523-9111-e113654418ad,network=Network(a7b64e12-abb3-4a23-87ea-1991927b957d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38956d2-63') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG os_vif [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:8b:35,bridge_name='br-int',has_traffic_filtering=True,id=d38956d2-634a-4523-9111-e113654418ad,network=Network(a7b64e12-abb3-4a23-87ea-1991927b957d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38956d2-63') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd38956d2-63, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:54:53 user nova-compute[73469]: INFO os_vif [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:8b:35,bridge_name='br-int',has_traffic_filtering=True,id=d38956d2-634a-4523-9111-e113654418ad,network=Network(a7b64e12-abb3-4a23-87ea-1991927b957d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38956d2-63')
Aug 22 02:54:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qHyeWQEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:54:53 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:54:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06ab273-1d64-4da5-afa3-bbd3c8200c96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba395ac-a40b-43ce-b9a6-a14290f2d89b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:54:53 user nova-compute[73469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 (non-flash)
Aug 22 02:54:53 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:54:53 user nova-compute[73469]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 (non-flash)
Aug 22 02:54:53 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4662170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69'): ({'sdc'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Removing single pathed devices sdc {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94a1bc2-2996-4e11-8f59-1ad0bacb7e48]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.035s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f086e2-21fd-4871-ae27-fe7bff5340cf]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Flushing IO for device /dev/sdc {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46dea7f-8959-40d3-bddd-bcd5aa4b7428]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad607dd-575d-419c-ac2f-9e58784fb08b]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a930069-a40b-427a-b699-6e5ce2998679]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG nova.network.neutron [req-9ca28c74-a375-42e4-b672-f9f276fb6914 req-70e530d6-2328-4c00-b08d-e0511ab7a54a service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Updated VIF entry in instance network info cache for port 1dffa70d-3c6e-4c82-9c6b-4d182c9f0365. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG nova.network.neutron [req-9ca28c74-a375-42e4-b672-f9f276fb6914 req-70e530d6-2328-4c00-b08d-e0511ab7a54a service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Updating instance_info_cache with network_info: [{"id": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "address": "fa:16:3e:70:a3:62", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dffa70d-3c", "ovs_interfaceid": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:54:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9ca28c74-a375-42e4-b672-f9f276fb6914 req-70e530d6-2328-4c00-b08d-e0511ab7a54a service nova] Releasing lock "refresh_cache-f5fdf305-bf02-4b53-bb0d-83e939ae1acb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:54:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --logout" returned: 0 in 0.210s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:54 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0760095f-bc8b-4b30-ae94-eb93f51ca441]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69, portal: 172.16.0.220,3260]
Aug 22 02:54:54 user nova-compute[73469]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69, portal: 172.16.0.220,3260] successful.
Aug 22 02:54:54 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:54:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff1c75d3-a5ca-4c8f-9223-c61e6fe64a69 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:54 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df4f432-5f61-4e0e-94e6-ee660df7c9cf]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:54:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.480s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:54:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] <== disconnect_volume: return (482ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:54:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 02:54:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Deleting instance files /opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f_del
Aug 22 02:54:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Deletion of /opt/stack/data/nova/instances/759d99dd-a48e-489a-bc96-b4365b1fd17f_del complete
Aug 22 02:54:54 user nova-compute[73469]: INFO nova.compute.manager [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Took 1.47 seconds to destroy the instance on the hypervisor.
Aug 22 02:54:54 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 02:54:54 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 02:54:54 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 02:54:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:54:55 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Took 0.72 seconds to deallocate network for instance.
Aug 22 02:54:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-32d3e5ff-ead9-4979-bd6c-0c2627c537fb req-2b2122bb-e65e-49c7-8819-272017e8ebe7 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Received event network-vif-deleted-d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Received event network-vif-plugged-d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] Acquiring lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] No waiting events found dispatching network-vif-plugged-d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:54:55 user nova-compute[73469]: WARNING nova.compute.manager [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Received unexpected event network-vif-plugged-d38956d2-634a-4523-9111-e113654418ad for instance with vm_state active and task_state deleting.
Aug 22 02:54:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Received event network-vif-plugged-d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] Acquiring lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] No waiting events found dispatching network-vif-plugged-d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:54:55 user nova-compute[73469]: WARNING nova.compute.manager [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Received unexpected event network-vif-plugged-d38956d2-634a-4523-9111-e113654418ad for instance with vm_state active and task_state deleting.
Aug 22 02:54:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Received event network-vif-plugged-d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] Acquiring lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] No waiting events found dispatching network-vif-plugged-d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:54:55 user nova-compute[73469]: WARNING nova.compute.manager [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Received unexpected event network-vif-plugged-d38956d2-634a-4523-9111-e113654418ad for instance with vm_state active and task_state deleting.
Aug 22 02:54:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Received event network-vif-unplugged-d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] Acquiring lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] No waiting events found dispatching network-vif-unplugged-d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Received event network-vif-unplugged-d38956d2-634a-4523-9111-e113654418ad for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Received event network-vif-plugged-d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] Acquiring lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] No waiting events found dispatching network-vif-plugged-d38956d2-634a-4523-9111-e113654418ad {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:54:55 user nova-compute[73469]: WARNING nova.compute.manager [req-09c75959-c134-4c22-b06a-bb22aa3775ef req-27f683c6-2d70-4250-91de-e0450f721212 service nova] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Received unexpected event network-vif-plugged-d38956d2-634a-4523-9111-e113654418ad for instance with vm_state active and task_state deleting.
Aug 22 02:54:55 user nova-compute[73469]: INFO nova.compute.manager [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Took 0.80 seconds to detach 1 volumes for instance.
Aug 22 02:54:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:56 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:54:56 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:54:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:56 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Deleted allocations for instance 759d99dd-a48e-489a-bc96-b4365b1fd17f
Aug 22 02:54:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:54:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-937f720d-5c74-4fd2-9e9e-ba71b927d6f8 tempest-DeleteServersTestJSON-1883805460 tempest-DeleteServersTestJSON-1883805460-project-member] Lock "759d99dd-a48e-489a-bc96-b4365b1fd17f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.637s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:54:56 user nova-compute[73469]: INFO nova.compute.claims [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Claim successful on node user
Aug 22 02:54:56 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:54:56 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG nova.network.neutron [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:54:57 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 02:54:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG nova.policy [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f03cf449ec504132b4ea50a033bdf2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec928b9a04840b18974870663be0d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:54:57 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Creating image(s)
Aug 22 02:54:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "/opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "/opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "ca0536a4d5400c1f5093e19d00b02c8cdde318b3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "ca0536a4d5400c1f5093e19d00b02c8cdde318b3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3.part --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lazy-loading 'flavor' on Instance uuid f5fdf305-bf02-4b53-bb0d-83e939ae1acb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3.part --force-share --output=json" returned: 0 in 0.249s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG nova.virt.images [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] 5ba380b7-0fb3-46e0-952a-fad052275037 was qcow2, converting to raw {{(pid=73469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG nova.privsep.utils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 22 02:54:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3.part /opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3.converted {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG nova.network.neutron [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Successfully created port: 18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:58 user nova-compute[73469]: INFO nova.compute.manager [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Attaching volume 80510ad0-2c7e-4a61-a35b-645f6b7cd190 to /dev/vdb
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3.part /opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3.converted" returned: 0 in 0.213s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3.converted --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG os_brick.utils [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[01affa9f-bc3a-45af-9f91-cfa4f5cfbd0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3.converted --force-share --output=json" returned: 0 in 0.169s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "ca0536a4d5400c1f5093e19d00b02c8cdde318b3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.163s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[204a5987-c169-42e4-b1f3-d16108417d45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3 --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d8e95e-70bb-41b6-804f-856cdb7626b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[440b8a18-efe3-4a8f-8496-7f415b24413a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:54:58 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b157f9-d9c2-458b-9c79-13f8a456abf9]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG os_brick.utils [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Updating existing volume attachment record: 29bd1a57-61e8-4fac-bbd1-e093579227f7 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3 --force-share --output=json" returned: 0 in 0.190s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "ca0536a4d5400c1f5093e19d00b02c8cdde318b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "ca0536a4d5400c1f5093e19d00b02c8cdde318b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3 --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3 --force-share --output=json" returned: 0 in 0.207s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3,backing_fmt=raw /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG nova.compute.manager [req-32834a4b-4f0e-44d1-b294-127b1d322358 req-e109c12b-7961-4873-8cf3-f96928cd38fc service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Received event network-changed-52040c67-b1ad-4eea-86b2-43143b75acb5 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG nova.compute.manager [req-32834a4b-4f0e-44d1-b294-127b1d322358 req-e109c12b-7961-4873-8cf3-f96928cd38fc service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Refreshing instance network info cache due to event network-changed-52040c67-b1ad-4eea-86b2-43143b75acb5. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-32834a4b-4f0e-44d1-b294-127b1d322358 req-e109c12b-7961-4873-8cf3-f96928cd38fc service nova] Acquiring lock "refresh_cache-e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-32834a4b-4f0e-44d1-b294-127b1d322358 req-e109c12b-7961-4873-8cf3-f96928cd38fc service nova] Acquired lock "refresh_cache-e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG nova.network.neutron [req-32834a4b-4f0e-44d1-b294-127b1d322358 req-e109c12b-7961-4873-8cf3-f96928cd38fc service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Refreshing network info cache for port 52040c67-b1ad-4eea-86b2-43143b75acb5 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3,backing_fmt=raw /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk 1073741824" returned: 0 in 0.064s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "ca0536a4d5400c1f5093e19d00b02c8cdde318b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3 --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG nova.network.neutron [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Successfully updated port: 18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquired lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG nova.network.neutron [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG nova.compute.manager [req-5704c2ee-90da-4dd6-9823-45adea65780f req-c3b2e3b2-135b-49ec-90a5-615de2d2779e service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received event network-changed-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG nova.compute.manager [req-5704c2ee-90da-4dd6-9823-45adea65780f req-c3b2e3b2-135b-49ec-90a5-615de2d2779e service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Refreshing instance network info cache due to event network-changed-18fedb7c-3d67-4417-b0a3-d98b54df5150. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5704c2ee-90da-4dd6-9823-45adea65780f req-c3b2e3b2-135b-49ec-90a5-615de2d2779e service nova] Acquiring lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:54:58 user nova-compute[73469]: DEBUG nova.network.neutron [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Acquiring lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.objects.instance [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Lazy-loading 'flavor' on Instance uuid e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3 --force-share --output=json" returned: 0 in 0.188s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.125s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Cannot resize image /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.objects.instance [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lazy-loading 'migration_context' on Instance uuid 3ade8cba-6c34-4457-9ad3-484a604dbdb6 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Ensure instance console log exists: /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.network.neutron [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Updating instance_info_cache with network_info: [{"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Acquiring lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:54:59 user nova-compute[73469]: INFO nova.compute.manager [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Attaching volume e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 to /dev/vdb
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Releasing lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.compute.manager [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Instance network_info: |[{"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5704c2ee-90da-4dd6-9823-45adea65780f req-c3b2e3b2-135b-49ec-90a5-615de2d2779e service nova] Acquired lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.network.neutron [req-5704c2ee-90da-4dd6-9823-45adea65780f req-c3b2e3b2-135b-49ec-90a5-615de2d2779e service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Refreshing network info cache for port 18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Start _get_guest_xml network_info=[{"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:54:53Z,direct_url=<?>,disk_format='qcow2',id=5ba380b7-0fb3-46e0-952a-fad052275037,min_disk=0,min_ram=0,name='tempest-scenario-img--1001913800',owner='1ec928b9a04840b18974870663be0d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:54:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '5ba380b7-0fb3-46e0-952a-fad052275037'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:54:59 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:54:59 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:54:53Z,direct_url=<?>,disk_format='qcow2',id=5ba380b7-0fb3-46e0-952a-fad052275037,min_disk=0,min_ram=0,name='tempest-scenario-img--1001913800',owner='1ec928b9a04840b18974870663be0d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:54:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:54:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-494971023',display_name='tempest-TestMinimumBasicScenario-server-494971023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-494971023',id=12,image_ref='5ba380b7-0fb3-46e0-952a-fad052275037',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxDsMHfXNUJeghB3W0xA7prRk5BeY6oPMAoJykL4RIDk/xEWSZdAtjpo9CxUxeo233tXdy8WnJzPXcbeh3MhyjdPrmU9fA1+DWQ5M4dHqRiQKFKIkjSwtPUa1cuC/c6gw==',key_name='tempest-TestMinimumBasicScenario-286068567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ec928b9a04840b18974870663be0d44',ramdisk_id='',reservation_id='r-obngx040',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ba380b7-0fb3-46e0-952a-fad052275037',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-619227623',owner_user_name='tempest-TestMinimumBasicScenario-619227623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:54:57Z,user_data=None,user_id='f03cf449ec504132b4ea50a033bdf2c0',uuid=3ade8cba-6c34-4457-9ad3-484a604dbdb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Converting VIF {"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c1:aa,bridge_name='br-int',has_traffic_filtering=True,id=18fedb7c-3d67-4417-b0a3-d98b54df5150,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fedb7c-3d') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.objects.instance [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ade8cba-6c34-4457-9ad3-484a604dbdb6 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG os_brick.utils [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:54:59 user nova-compute[73469]:   <uuid>3ade8cba-6c34-4457-9ad3-484a604dbdb6</uuid>
Aug 22 02:54:59 user nova-compute[73469]:   <name>instance-0000000c</name>
Aug 22 02:54:59 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:54:59 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:54:59 user nova-compute[73469]:   <metadata>
Aug 22 02:54:59 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:54:59 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:54:59 user nova-compute[73469]:       <nova:name>tempest-TestMinimumBasicScenario-server-494971023</nova:name>
Aug 22 02:54:59 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:54:59</nova:creationTime>
Aug 22 02:54:59 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:54:59 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:54:59 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:54:59 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:54:59 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:54:59 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:54:59 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:54:59 user nova-compute[73469]:       <nova:owner>
Aug 22 02:54:59 user nova-compute[73469]:         <nova:user uuid="f03cf449ec504132b4ea50a033bdf2c0">tempest-TestMinimumBasicScenario-619227623-project-member</nova:user>
Aug 22 02:54:59 user nova-compute[73469]:         <nova:project uuid="1ec928b9a04840b18974870663be0d44">tempest-TestMinimumBasicScenario-619227623</nova:project>
Aug 22 02:54:59 user nova-compute[73469]:       </nova:owner>
Aug 22 02:54:59 user nova-compute[73469]:       <nova:root type="image" uuid="5ba380b7-0fb3-46e0-952a-fad052275037"/>
Aug 22 02:54:59 user nova-compute[73469]:       <nova:ports>
Aug 22 02:54:59 user nova-compute[73469]:         <nova:port uuid="18fedb7c-3d67-4417-b0a3-d98b54df5150">
Aug 22 02:54:59 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 22 02:54:59 user nova-compute[73469]:         </nova:port>
Aug 22 02:54:59 user nova-compute[73469]:       </nova:ports>
Aug 22 02:54:59 user nova-compute[73469]:     </nova:instance>
Aug 22 02:54:59 user nova-compute[73469]:   </metadata>
Aug 22 02:54:59 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:54:59 user nova-compute[73469]:     <system>
Aug 22 02:54:59 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:54:59 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:54:59 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:54:59 user nova-compute[73469]:       <entry name="serial">3ade8cba-6c34-4457-9ad3-484a604dbdb6</entry>
Aug 22 02:54:59 user nova-compute[73469]:       <entry name="uuid">3ade8cba-6c34-4457-9ad3-484a604dbdb6</entry>
Aug 22 02:54:59 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:54:59 user nova-compute[73469]:     </system>
Aug 22 02:54:59 user nova-compute[73469]:   </sysinfo>
Aug 22 02:54:59 user nova-compute[73469]:   <os>
Aug 22 02:54:59 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:54:59 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:54:59 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:54:59 user nova-compute[73469]:   </os>
Aug 22 02:54:59 user nova-compute[73469]:   <features>
Aug 22 02:54:59 user nova-compute[73469]:     <acpi/>
Aug 22 02:54:59 user nova-compute[73469]:     <apic/>
Aug 22 02:54:59 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:54:59 user nova-compute[73469]:   </features>
Aug 22 02:54:59 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:54:59 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:54:59 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:54:59 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:54:59 user nova-compute[73469]:   </clock>
Aug 22 02:54:59 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:54:59 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:54:59 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:54:59 user nova-compute[73469]:   </cpu>
Aug 22 02:54:59 user nova-compute[73469]:   <devices>
Aug 22 02:54:59 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:54:59 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:54:59 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk"/>
Aug 22 02:54:59 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:54:59 user nova-compute[73469]:     </disk>
Aug 22 02:54:59 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:54:59 user nova-compute[73469]:       <mac address="fa:16:3e:ef:c1:aa"/>
Aug 22 02:54:59 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:54:59 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:54:59 user nova-compute[73469]:       <target dev="tap18fedb7c-3d"/>
Aug 22 02:54:59 user nova-compute[73469]:     </interface>
Aug 22 02:54:59 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:54:59 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/console.log" append="off"/>
Aug 22 02:54:59 user nova-compute[73469]:     </serial>
Aug 22 02:54:59 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:54:59 user nova-compute[73469]:     <video>
Aug 22 02:54:59 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:54:59 user nova-compute[73469]:     </video>
Aug 22 02:54:59 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:54:59 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:54:59 user nova-compute[73469]:     </rng>
Aug 22 02:54:59 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:54:59 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:54:59 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:54:59 user nova-compute[73469]:     </memballoon>
Aug 22 02:54:59 user nova-compute[73469]:   </devices>
Aug 22 02:54:59 user nova-compute[73469]: </domain>
Aug 22 02:54:59 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:54:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-494971023',display_name='tempest-TestMinimumBasicScenario-server-494971023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-494971023',id=12,image_ref='5ba380b7-0fb3-46e0-952a-fad052275037',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxDsMHfXNUJeghB3W0xA7prRk5BeY6oPMAoJykL4RIDk/xEWSZdAtjpo9CxUxeo233tXdy8WnJzPXcbeh3MhyjdPrmU9fA1+DWQ5M4dHqRiQKFKIkjSwtPUa1cuC/c6gw==',key_name='tempest-TestMinimumBasicScenario-286068567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ec928b9a04840b18974870663be0d44',ramdisk_id='',reservation_id='r-obngx040',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ba380b7-0fb3-46e0-952a-fad052275037',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-619227623',owner_user_name='tempest-TestMinimumBasicScenario-619227623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:54:57Z,user_data=None,user_id='f03cf449ec504132b4ea50a033bdf2c0',uuid=3ade8cba-6c34-4457-9ad3-484a604dbdb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Converting VIF {"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c1:aa,bridge_name='br-int',has_traffic_filtering=True,id=18fedb7c-3d67-4417-b0a3-d98b54df5150,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fedb7c-3d') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG os_vif [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c1:aa,bridge_name='br-int',has_traffic_filtering=True,id=18fedb7c-3d67-4417-b0a3-d98b54df5150,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fedb7c-3d') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6694bb-956c-4bf7-90cd-d93ab0f71832]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18fedb7c-3d, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18fedb7c-3d, col_values=(('external_ids', {'iface-id': '18fedb7c-3d67-4417-b0a3-d98b54df5150', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:c1:aa', 'vm-uuid': '3ade8cba-6c34-4457-9ad3-484a604dbdb6'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1c0c95-fe9b-4f00-a8eb-a22032a6efff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:54:59 user nova-compute[73469]: INFO os_vif [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c1:aa,bridge_name='br-int',has_traffic_filtering=True,id=18fedb7c-3d67-4417-b0a3-d98b54df5150,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fedb7c-3d')
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aff5e46-d959-47d0-bd3a-60b3ef2f6068]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e254bf66-5341-4408-8a26-d338e051542e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.network.neutron [req-32834a4b-4f0e-44d1-b294-127b1d322358 req-e109c12b-7961-4873-8cf3-f96928cd38fc service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Updated VIF entry in instance network info cache for port 52040c67-b1ad-4eea-86b2-43143b75acb5. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.network.neutron [req-32834a4b-4f0e-44d1-b294-127b1d322358 req-e109c12b-7961-4873-8cf3-f96928cd38fc service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Updating instance_info_cache with network_info: [{"id": "52040c67-b1ad-4eea-86b2-43143b75acb5", "address": "fa:16:3e:2b:aa:81", "network": {"id": "2731bb0f-0af6-4f92-ad67-294ad45891b7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1587989028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2998d1c629d446cfbf70d34b254ad473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52040c67-b1", "ovs_interfaceid": "52040c67-b1ad-4eea-86b2-43143b75acb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:54:59 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5cd5f1-88f7-49b4-b497-efe63f20858f]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG os_brick.utils [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Updating existing volume attachment record: 15fff28a-0e04-4b60-b414-12f356592ac6 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-32834a4b-4f0e-44d1-b294-127b1d322358 req-e109c12b-7961-4873-8cf3-f96928cd38fc service nova] Releasing lock "refresh_cache-e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] No VIF found with MAC fa:16:3e:ef:c1:aa, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.network.neutron [req-5704c2ee-90da-4dd6-9823-45adea65780f req-c3b2e3b2-135b-49ec-90a5-615de2d2779e service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Updated VIF entry in instance network info cache for port 18fedb7c-3d67-4417-b0a3-d98b54df5150. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG nova.network.neutron [req-5704c2ee-90da-4dd6-9823-45adea65780f req-c3b2e3b2-135b-49ec-90a5-615de2d2779e service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Updating instance_info_cache with network_info: [{"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:54:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5704c2ee-90da-4dd6-9823-45adea65780f req-c3b2e3b2-135b-49ec-90a5-615de2d2779e service nova] Releasing lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:55:00 user nova-compute[73469]: DEBUG nova.compute.manager [req-f040efa8-f4b3-49e0-be70-54281ca57bc3 req-88f49001-3857-43ee-a737-9137c01786d3 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Received event network-changed-ec723392-c81a-4e29-9b7c-29bfe467419f {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:00 user nova-compute[73469]: DEBUG nova.compute.manager [req-f040efa8-f4b3-49e0-be70-54281ca57bc3 req-88f49001-3857-43ee-a737-9137c01786d3 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Refreshing instance network info cache due to event network-changed-ec723392-c81a-4e29-9b7c-29bfe467419f. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:55:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f040efa8-f4b3-49e0-be70-54281ca57bc3 req-88f49001-3857-43ee-a737-9137c01786d3 service nova] Acquiring lock "refresh_cache-f988e66c-6bd1-49bb-ac43-140008f7c995" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:55:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f040efa8-f4b3-49e0-be70-54281ca57bc3 req-88f49001-3857-43ee-a737-9137c01786d3 service nova] Acquired lock "refresh_cache-f988e66c-6bd1-49bb-ac43-140008f7c995" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:55:00 user nova-compute[73469]: DEBUG nova.network.neutron [req-f040efa8-f4b3-49e0-be70-54281ca57bc3 req-88f49001-3857-43ee-a737-9137c01786d3 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Refreshing network info cache for port ec723392-c81a-4e29-9b7c-29bfe467419f {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:55:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:01 user nova-compute[73469]: DEBUG nova.network.neutron [req-f040efa8-f4b3-49e0-be70-54281ca57bc3 req-88f49001-3857-43ee-a737-9137c01786d3 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Updated VIF entry in instance network info cache for port ec723392-c81a-4e29-9b7c-29bfe467419f. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:55:01 user nova-compute[73469]: DEBUG nova.network.neutron [req-f040efa8-f4b3-49e0-be70-54281ca57bc3 req-88f49001-3857-43ee-a737-9137c01786d3 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Updating instance_info_cache with network_info: [{"id": "ec723392-c81a-4e29-9b7c-29bfe467419f", "address": "fa:16:3e:b1:f4:12", "network": {"id": "44ec7375-8521-4a64-a172-6677f74183e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-546521769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea11f6b107064d67925facec50a49fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec723392-c8", "ovs_interfaceid": "ec723392-c81a-4e29-9b7c-29bfe467419f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:55:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f040efa8-f4b3-49e0-be70-54281ca57bc3 req-88f49001-3857-43ee-a737-9137c01786d3 service nova] Releasing lock "refresh_cache-f988e66c-6bd1-49bb-ac43-140008f7c995" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:55:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:02 user nova-compute[73469]: DEBUG nova.compute.manager [req-103d08a8-d626-424f-8e86-054665de2043 req-6e9a9fb5-c8ba-42f3-8004-b4ec0715e924 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received event network-vif-plugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-103d08a8-d626-424f-8e86-054665de2043 req-6e9a9fb5-c8ba-42f3-8004-b4ec0715e924 service nova] Acquiring lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-103d08a8-d626-424f-8e86-054665de2043 req-6e9a9fb5-c8ba-42f3-8004-b4ec0715e924 service nova] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-103d08a8-d626-424f-8e86-054665de2043 req-6e9a9fb5-c8ba-42f3-8004-b4ec0715e924 service nova] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:02 user nova-compute[73469]: DEBUG nova.compute.manager [req-103d08a8-d626-424f-8e86-054665de2043 req-6e9a9fb5-c8ba-42f3-8004-b4ec0715e924 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] No waiting events found dispatching network-vif-plugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:02 user nova-compute[73469]: WARNING nova.compute.manager [req-103d08a8-d626-424f-8e86-054665de2043 req-6e9a9fb5-c8ba-42f3-8004-b4ec0715e924 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received unexpected event network-vif-plugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 for instance with vm_state building and task_state spawning.
Aug 22 02:55:02 user nova-compute[73469]: DEBUG nova.compute.manager [req-103d08a8-d626-424f-8e86-054665de2043 req-6e9a9fb5-c8ba-42f3-8004-b4ec0715e924 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received event network-vif-plugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-103d08a8-d626-424f-8e86-054665de2043 req-6e9a9fb5-c8ba-42f3-8004-b4ec0715e924 service nova] Acquiring lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-103d08a8-d626-424f-8e86-054665de2043 req-6e9a9fb5-c8ba-42f3-8004-b4ec0715e924 service nova] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-103d08a8-d626-424f-8e86-054665de2043 req-6e9a9fb5-c8ba-42f3-8004-b4ec0715e924 service nova] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:02 user nova-compute[73469]: DEBUG nova.compute.manager [req-103d08a8-d626-424f-8e86-054665de2043 req-6e9a9fb5-c8ba-42f3-8004-b4ec0715e924 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] No waiting events found dispatching network-vif-plugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:02 user nova-compute[73469]: WARNING nova.compute.manager [req-103d08a8-d626-424f-8e86-054665de2043 req-6e9a9fb5-c8ba-42f3-8004-b4ec0715e924 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received unexpected event network-vif-plugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 for instance with vm_state building and task_state spawning.
Aug 22 02:55:03 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672903.359044, 3ade8cba-6c34-4457-9ad3-484a604dbdb6 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:55:03 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] VM Resumed (Lifecycle Event)
Aug 22 02:55:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:55:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:55:03 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Instance spawned successfully.
Aug 22 02:55:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:55:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:55:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:55:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:55:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:55:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:55:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:55:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:55:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:55:03 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:55:03 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672903.3610775, 3ade8cba-6c34-4457-9ad3-484a604dbdb6 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:55:03 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] VM Started (Lifecycle Event)
Aug 22 02:55:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:55:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:55:03 user nova-compute[73469]: INFO nova.compute.manager [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Took 6.36 seconds to spawn the instance on the hypervisor.
Aug 22 02:55:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:55:03 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:55:03 user nova-compute[73469]: INFO nova.compute.manager [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Took 7.17 seconds to build instance.
Aug 22 02:55:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-077c57e9-6172-435d-b787-3a6e878d74cc tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.270s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:08 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692672893.6701415, 759d99dd-a48e-489a-bc96-b4365b1fd17f => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:55:08 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] VM Stopped (Lifecycle Event)
Aug 22 02:55:08 user nova-compute[73469]: DEBUG nova.compute.manager [None req-259eb4eb-7e35-4b5b-9aad-6c632beec5c0 None None] [instance: 759d99dd-a48e-489a-bc96-b4365b1fd17f] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:55:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mXbhpuAG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:10 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:10 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:10 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede29082-f53e-473f-841b-a011f0c48479]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 02:55:10 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[071b568d-575d-4a1c-aa4a-6fe635b4cbdd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190] added
Aug 22 02:55:10 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d92e2bf-4aae-4742-a226-866cc3704c8e]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec197e63-6d77-4c1c-b2f9-d2512e3f03d6]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mXbhpuAG {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mXbhpuAG" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[021054e0-d221-4382-b380-af9f14d06225]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mXbhpuAG'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a25176-c987-4cc1-aaf3-d551047c33d0]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb41dd67-6580-4e1c-b0b9-a90971680544]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:10 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:10 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1986bc-caa9-4527-a11e-1e0a16553b75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190, portal: 172.16.0.220,3260]
Aug 22 02:55:10 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190, portal: 172.16.0.220,3260] successful.
Aug 22 02:55:10 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e30c83-629d-478b-884e-70b648249a0f]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffd10e7-8fa7-46f1-b957-42347585115e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:10 user nova-compute[73469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 (non-flash)
Aug 22 02:55:10 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:10 user nova-compute[73469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 (non-flash)
Aug 22 02:55:10 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8b59fc-3ccb-4ed5-8b3b-3ce8a6798a37]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:10 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: None {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EUNRgnWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:11 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mXbhpuAG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26166346665623563', 'path': '/dev/sdc'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166346665623563', 'path': '/dev/sdc'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.403s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:11 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:11 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lazy-loading 'flavor' on Instance uuid f5fdf305-bf02-4b53-bb0d-83e939ae1acb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[29152d52-1b52-4604-b490-6750f074d5dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 02:55:11 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 02:55:11 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:55:11 user nova-compute[73469]:   <source dev="/dev/sdc"/>
Aug 22 02:55:11 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 02:55:11 user nova-compute[73469]:   <serial>80510ad0-2c7e-4a61-a35b-645f6b7cd190</serial>
Aug 22 02:55:11 user nova-compute[73469]: </disk>
Aug 22 02:55:11 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f99f499-574d-4849-95db-674825237555]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2] added
Aug 22 02:55:11 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce98a15e-728c-4203-b93e-81179c0543f4]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afcbe68-2a85-48c6-8f4f-87876e9800ce]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EUNRgnWT {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EUNRgnWT" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e6509e-d6f2-4741-a9fe-8a0dd7413440]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EUNRgnWT'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00a9712-5792-4c1d-b89e-a482a50b3dfe]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cac3d9c-ec7e-4a08-87d1-95133a3947e4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:11 user nova-compute[73469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 (non-flash)
Aug 22 02:55:11 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:11 user nova-compute[73469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 (non-flash)
Aug 22 02:55:11 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da98917-1adf-4d42-9836-c6a52118237b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2, portal: 172.16.0.220,3260]
Aug 22 02:55:11 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2, portal: 172.16.0.220,3260] successful.
Aug 22 02:55:11 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ace5a21-c800-40fb-ba79-9efa6fcbc369]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e5891e-ad87-40ea-902f-af6620740575]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:11 user nova-compute[73469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 (non-flash)
Aug 22 02:55:11 user nova-compute[73469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 (non-flash)
Aug 22 02:55:11 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:11 user nova-compute[73469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 (non-flash)
Aug 22 02:55:11 user nova-compute[73469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 (non-flash)
Aug 22 02:55:11 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ab1090-e079-46f6-88aa-e035bb9f917e]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:55:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EUNRgnWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 02:55:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:55:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:55:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] No VIF found with MAC fa:16:3e:70:a3:62, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:55:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ab0de01d-4cf1-4a4c-86e8-8fa306e25ac4 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.112s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:12 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:12 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] <== connect_volume: return (1726ms) {'type': 'block', 'scsi_wwn': '23837326231323366', 'path': '/dev/sdd'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837326231323366', 'path': '/dev/sdd'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 02:55:12 user nova-compute[73469]: DEBUG nova.objects.instance [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Lazy-loading 'flavor' on Instance uuid e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:55:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] attach device xml: <disk type="block" device="disk">
Aug 22 02:55:12 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:55:12 user nova-compute[73469]:   <source dev="/dev/sdd"/>
Aug 22 02:55:12 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 02:55:12 user nova-compute[73469]:   <serial>e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2</serial>
Aug 22 02:55:12 user nova-compute[73469]: </disk>
Aug 22 02:55:12 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 02:55:12 user nova-compute[73469]: INFO nova.virt.block_device [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Booting with volume a1ed05cb-3e80-4f16-81a7-5849f3dfe722 at /dev/vdc
Aug 22 02:55:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-32cbbefd-2e96-4402-a465-3dfe81fa887c req-43df62b9-2c3f-45fb-a130-1e098a225ca4 service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] Received event network-changed-f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-32cbbefd-2e96-4402-a465-3dfe81fa887c req-43df62b9-2c3f-45fb-a130-1e098a225ca4 service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] Refreshing instance network info cache due to event network-changed-f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-32cbbefd-2e96-4402-a465-3dfe81fa887c req-43df62b9-2c3f-45fb-a130-1e098a225ca4 service nova] Acquiring lock "refresh_cache-f478387d-e004-4314-961d-abf4a910e970" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-32cbbefd-2e96-4402-a465-3dfe81fa887c req-43df62b9-2c3f-45fb-a130-1e098a225ca4 service nova] Acquired lock "refresh_cache-f478387d-e004-4314-961d-abf4a910e970" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG nova.network.neutron [req-32cbbefd-2e96-4402-a465-3dfe81fa887c req-43df62b9-2c3f-45fb-a130-1e098a225ca4 service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] Refreshing network info cache for port f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG os_brick.utils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[16258016-5673-4f70-908e-7fec3fc51a77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[02850878-dad5-435a-9d14-51c149b4bd74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13aaa97-0161-4637-9dff-7d43fff36d02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c86675-8bb1-42b8-8ae4-9f39dffc03fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:55:13 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1a3902-f34e-46a1-8c24-7d339b30fbb7]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG os_brick.utils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Updating existing volume attachment record: d3ab2bd2-3a75-4631-812b-91b96170b52b {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Acquiring lock "f478387d-e004-4314-961d-abf4a910e970" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "f478387d-e004-4314-961d-abf4a910e970" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG nova.objects.instance [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lazy-loading 'flavor' on Instance uuid f478387d-e004-4314-961d-abf4a910e970 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "f478387d-e004-4314-961d-abf4a910e970" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] No VIF found with MAC fa:16:3e:2b:aa:81, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Acquiring lock "f478387d-e004-4314-961d-abf4a910e970" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "f478387d-e004-4314-961d-abf4a910e970" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:13 user nova-compute[73469]: INFO nova.compute.manager [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Attaching volume c7d8979b-2a2d-463f-aef3-fdbf638abe91 to /dev/vdb
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:13 user nova-compute[73469]: INFO nova.compute.manager [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Detaching volume 80510ad0-2c7e-4a61-a35b-645f6b7cd190
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-88b8bb0a-c999-427d-9a87-e56fb59bba05 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.318s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG os_brick.utils [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06f64da-da27-4e85-a2e8-858a0a65c868]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:13 user nova-compute[73469]: INFO nova.virt.block_device [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Attempting to driver detach volume 80510ad0-2c7e-4a61-a35b-645f6b7cd190 from mountpoint /dev/vdb
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a36ec7-cc49-4357-a2de-ba9287b8a7f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Attempting to detach device vdb from instance f5fdf305-bf02-4b53-bb0d-83e939ae1acb from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 02:55:13 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:55:13 user nova-compute[73469]:   <source dev="/dev/sdc"/>
Aug 22 02:55:13 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 02:55:13 user nova-compute[73469]:   <serial>80510ad0-2c7e-4a61-a35b-645f6b7cd190</serial>
Aug 22 02:55:13 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 02:55:13 user nova-compute[73469]: </disk>
Aug 22 02:55:13 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 02:55:13 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Successfully detached device vdb from instance f5fdf305-bf02-4b53-bb0d-83e939ae1acb from the persistent domain config.
Aug 22 02:55:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5fdf305-bf02-4b53-bb0d-83e939ae1acb from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 02:55:13 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:55:13 user nova-compute[73469]:   <source dev="/dev/sdc"/>
Aug 22 02:55:13 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 02:55:13 user nova-compute[73469]:   <serial>80510ad0-2c7e-4a61-a35b-645f6b7cd190</serial>
Aug 22 02:55:13 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 02:55:13 user nova-compute[73469]: </disk>
Aug 22 02:55:13 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddd12ac-7c34-4cb0-9b04-48caf341db7b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d5ac3d-209f-48ae-aa99-ce7e565375bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:55:13 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31de987-364b-47db-bf22-2c3fa428b45f]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG nova.network.neutron [req-32cbbefd-2e96-4402-a465-3dfe81fa887c req-43df62b9-2c3f-45fb-a130-1e098a225ca4 service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] Updated VIF entry in instance network info cache for port f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG nova.network.neutron [req-32cbbefd-2e96-4402-a465-3dfe81fa887c req-43df62b9-2c3f-45fb-a130-1e098a225ca4 service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] Updating instance_info_cache with network_info: [{"id": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "address": "fa:16:3e:40:4d:fa", "network": {"id": "10332235-8c40-4287-965d-a31a57873020", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075046749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af59db42fc849efa62fe05f0225084c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a77e8c-e1", "ovs_interfaceid": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG os_brick.utils [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Updating existing volume attachment record: 3ecd193d-02fb-4645-94ea-860383cbf653 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-32cbbefd-2e96-4402-a465-3dfe81fa887c req-43df62b9-2c3f-45fb-a130-1e098a225ca4 service nova] Releasing lock "refresh_cache-f478387d-e004-4314-961d-abf4a910e970" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:55:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ca93af10-e63c-4060-a612-af5d5dce888b tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] volume_snapshot_create: create_info: {'snapshot_id': '823e5cdd-5196-4b67-b4d9-4b17dd23377d', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73469) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-3e14a953-97bf-4346-b629-e08fd68f3800 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] volume_snapshot_delete: delete_info: {'volume_id': 'e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2'} {{(pid=73469) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [None req-3e14a953-97bf-4346-b629-e08fd68f3800 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Traceback (most recent call last):
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]     if delete_info['type'] != 'qcow2':
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] KeyError: 'type'
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] 
Aug 22 02:55:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692672914.2476916, f5fdf305-bf02-4b53-bb0d-83e939ae1acb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ca93af10-e63c-4060-a612-af5d5dce888b tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] snap xml: <domainsnapshot>
Aug 22 02:55:14 user nova-compute[73469]:   <disks>
Aug 22 02:55:14 user nova-compute[73469]:     <disk name="/dev/sdd" snapshot="external" type="file">
Aug 22 02:55:14 user nova-compute[73469]:       <source file="/dev/new_file"/>
Aug 22 02:55:14 user nova-compute[73469]:     </disk>
Aug 22 02:55:14 user nova-compute[73469]:     <disk name="vda" snapshot="no"/>
Aug 22 02:55:14 user nova-compute[73469]:   </disks>
Aug 22 02:55:14 user nova-compute[73469]: </domainsnapshot>
Aug 22 02:55:14 user nova-compute[73469]:  {{(pid=73469) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ca93af10-e63c-4060-a612-af5d5dce888b tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Lazy-loading 'system_metadata' on Instance uuid e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5fdf305-bf02-4b53-bb0d-83e939ae1acb {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 02:55:14 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Successfully detached device vdb from instance f5fdf305-bf02-4b53-bb0d-83e939ae1acb from the live domain config.
Aug 22 02:55:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mXbhpuAG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:14 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f0e331-27d4-4c3f-9ee9-228bf69ce00b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[68670f34-53e0-43e7-b537-203911b11291]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:14 user nova-compute[73469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 (non-flash)
Aug 22 02:55:14 user nova-compute[73469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 (non-flash)
Aug 22 02:55:14 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:14 user nova-compute[73469]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 (non-flash)
Aug 22 02:55:14 user nova-compute[73469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 (non-flash)
Aug 22 02:55:14 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a45ee0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190'): ({'sdc'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Removing single pathed devices sdc {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [None req-3e14a953-97bf-4346-b629-e08fd68f3800 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver 
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver 
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-1917bb2e-69ba-4eb2-960b-bdb25558dd99)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver 
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver 
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver 
Aug 22 02:55:14 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ca93af10-e63c-4060-a612-af5d5dce888b tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server [None req-3e14a953-97bf-4346-b629-e08fd68f3800 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Exception during message handling: KeyError: 'type'
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server 
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[46453e8f-5d83-4e8c-ae59-26401883d57b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [None req-ca93af10-e63c-4060-a612-af5d5dce888b tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Traceback (most recent call last):
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]     rv = execute(f, *args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]     six.reraise(c, e, tb)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]     raise value
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]     rv = meth(*args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] 
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [None req-ca93af10-e63c-4060-a612-af5d5dce888b tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Traceback (most recent call last):
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]     self._volume_snapshot_create(context, instance, guest,
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]     rv = execute(f, *args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]     six.reraise(c, e, tb)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]     raise value
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]     rv = meth(*args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] 
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8387784d-31c3-459d-8882-3707886b3ba9]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Flushing IO for device /dev/sdc {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver [None req-ca93af10-e63c-4060-a612-af5d5dce888b tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 823e5cdd-5196-4b67-b4d9-4b17dd23377d could not be found.
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     raise value
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver 
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver 
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 823e5cdd-5196-4b67-b4d9-4b17dd23377d could not be found. (HTTP 404) (Request-ID: req-fb83bd26-a50e-47ac-bf6b-9b1d420674b2)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver 
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver 
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 823e5cdd-5196-4b67-b4d9-4b17dd23377d could not be found.
Aug 22 02:55:14 user nova-compute[73469]: ERROR nova.virt.libvirt.driver 
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server [None req-ca93af10-e63c-4060-a612-af5d5dce888b tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     raise value
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 22 02:55:14 user nova-compute[73469]: ERROR oslo_messaging.rpc.server 
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77f35e6-ae4a-4e3a-98df-b67ec7ef1678]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Acquiring lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:14 user nova-compute[73469]: INFO nova.compute.manager [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Detaching volume e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bc90da-7a03-4b1b-b529-16cb07036f1d]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1de0425-a444-4e5c-b0d4-293abda38d1b]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:14 user nova-compute[73469]: INFO nova.virt.block_device [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Attempting to driver detach volume e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 from mountpoint /dev/vdb
Aug 22 02:55:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Attempting to detach device vdb from instance e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] detach device xml: <disk type="block" device="disk">
Aug 22 02:55:14 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:55:14 user nova-compute[73469]:   <source dev="/dev/sdd"/>
Aug 22 02:55:14 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 02:55:14 user nova-compute[73469]:   <serial>e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2</serial>
Aug 22 02:55:14 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 02:55:14 user nova-compute[73469]: </disk>
Aug 22 02:55:14 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c16761-c114-43ae-8b86-9aed39a4d3c8]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190, portal: 172.16.0.220,3260]
Aug 22 02:55:14 user nova-compute[73469]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190, portal: 172.16.0.220,3260] successful.
Aug 22 02:55:14 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:14 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Successfully detached device vdb from instance e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 from the persistent domain config.
Aug 22 02:55:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] detach device xml: <disk type="block" device="disk">
Aug 22 02:55:14 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:55:14 user nova-compute[73469]:   <source dev="/dev/sdd"/>
Aug 22 02:55:14 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 02:55:14 user nova-compute[73469]:   <serial>e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2</serial>
Aug 22 02:55:14 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 02:55:14 user nova-compute[73469]: </disk>
Aug 22 02:55:14 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80510ad0-2c7e-4a61-a35b-645f6b7cd190 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79249d6-b2fb-499c-beac-f9eb7cbf96d0]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] <== disconnect_volume: return (395ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692672915.0854151, e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 02:55:15 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Successfully detached device vdb from instance e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 from the live domain config.
Aug 22 02:55:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EUNRgnWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:15 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef882ef-0248-4d2c-a02e-660ac995067c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b339134-f7a0-44ad-9536-60481c00c631]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:15 user nova-compute[73469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 (non-flash)
Aug 22 02:55:15 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:15 user nova-compute[73469]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 (non-flash)
Aug 22 02:55:15 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4645870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2'): ({'sdd'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Removing single pathed devices sdd {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4021df47-65ce-4574-b66e-5a89a25e6ef8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc64ae2f-c0a4-40ab-862c-dd118f0fa34a]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Flushing IO for device /dev/sdd {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3f8a7c-33dd-4ca9-ac2c-0521de56c8d8]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[765b6048-aac9-4c30-be8d-79e977ab9a94]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dd337c-f04d-42b5-b32e-979612cd5c00]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e904ba2-0ab9-4e96-a0f3-182bac8d0bde]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2, portal: 172.16.0.220,3260]
Aug 22 02:55:15 user nova-compute[73469]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2, portal: 172.16.0.220,3260] successful.
Aug 22 02:55:15 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4834aaf-fdeb-4795-9ffb-bad7a10c8ae2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fc87a9-20a8-4bb0-940e-37ce659f9bc6]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] <== disconnect_volume: return (315ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG nova.objects.instance [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lazy-loading 'flavor' on Instance uuid f5fdf305-bf02-4b53-bb0d-83e939ae1acb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:55:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6221819d-6816-4fcc-8e18-72c3dc7cbd22 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.184s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:16 user nova-compute[73469]: DEBUG nova.objects.instance [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Lazy-loading 'flavor' on Instance uuid e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:55:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c7cc7364-4c5f-475a-aac0-0a480ca058f5 tempest-VolumesAssistedSnapshotsTest-464852343 tempest-VolumesAssistedSnapshotsTest-464852343-project-admin] Lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.100s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Acquiring lock "f988e66c-6bd1-49bb-ac43-140008f7c995" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:16 user nova-compute[73469]: DEBUG nova.objects.instance [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lazy-loading 'flavor' on Instance uuid f988e66c-6bd1-49bb-ac43-140008f7c995 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:55:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Acquiring lock "f988e66c-6bd1-49bb-ac43-140008f7c995" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:16 user nova-compute[73469]: INFO nova.compute.manager [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Attaching volume 6450fe87-90ad-4484-a809-4f9d1fe67115 to /dev/sdc
Aug 22 02:55:17 user nova-compute[73469]: DEBUG os_brick.utils [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4ace43-2146-427e-9603-db443e219619]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61754e4-bdba-4b9a-ba94-5c4cb40fbf88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb4d9d7-4581-4621-b281-f51728393a77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6591df3-0164-4dfa-b270-0e6ff104aaaf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:55:17 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 02:55:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4898e1de-6916-4ea6-8310-fa842dfd62b0]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG os_brick.utils [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Updating existing volume attachment record: ec3f723c-339e-461f-91ae-718e47f5ebb7 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 02:55:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFIKOAiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:25 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:25 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:25 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f119e186-3248-4f00-b7e3-402214feac87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 02:55:25 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[25190f36-a318-4d69-8a63-b2dc304d5ad6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91] added
Aug 22 02:55:25 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[40963f73-2289-4395-992d-b7654332fba4]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7b9f8c-acba-46fa-96b1-7268dd3a4fac]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VFIKOAiN {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VFIKOAiN" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d668ea5-128c-408e-9ff7-cd6170330db4]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VFIKOAiN'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e1b3af-03d7-4f00-a7c1-1830f1928486]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d41ddff-2ed1-4abe-9ea1-5951653c2f77]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:25 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:25 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f219a1c9-0a4d-4561-a8e0-08b00165b86e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91, portal: 172.16.0.220,3260]
Aug 22 02:55:26 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91, portal: 172.16.0.220,3260] successful.
Aug 22 02:55:26 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b882ed-aecd-49f1-8762-0ebc0976e634]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5794083a-9f51-450d-a79d-10d7b8339a0e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:26 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:26 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:26 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:26 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] HCTL ('34', '-', '-', 0) found on session 6 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac740654-5f72-4447-9185-caf7ed1c820a]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:26 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Searching for a device in session 6 and hctl ['34', '*', '*', 0] yield: None {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:55:27 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Searching for a device in session 6 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:55:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFIKOAiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 02:55:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23439343036653663', 'path': '/dev/sdc'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439343036653663', 'path': '/dev/sdc'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 02:55:27 user nova-compute[73469]: DEBUG nova.objects.instance [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lazy-loading 'flavor' on Instance uuid f478387d-e004-4314-961d-abf4a910e970 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:55:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 02:55:27 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:55:27 user nova-compute[73469]:   <source dev="/dev/sdc"/>
Aug 22 02:55:27 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 02:55:27 user nova-compute[73469]:   <serial>c7d8979b-2a2d-463f-aef3-fdbf638abe91</serial>
Aug 22 02:55:27 user nova-compute[73469]: </disk>
Aug 22 02:55:27 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 02:55:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:55:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:55:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] No VIF found with MAC fa:16:3e:40:4d:fa, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:55:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-da1d933a-70cb-4f7f-9647-e7dbcf1283d6 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "f478387d-e004-4314-961d-abf4a910e970" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.259s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Acquiring lock "f478387d-e004-4314-961d-abf4a910e970" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Lock "f478387d-e004-4314-961d-abf4a910e970" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG os_brick.utils [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e9a7ef-0423-424f-b0f8-1a2e81c7f0d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1648ad45-2eba-4651-91d3-b871f2ff29e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8944939-f02e-4d1f-b0ca-6a85c19ecb89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f20c6e-3c45-486d-8640-342c4535e26d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:55:28 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 02:55:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7369e0-f074-46d7-be54-2179427a7e52]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 02:55:28 user nova-compute[73469]: DEBUG os_brick.utils [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:28 user nova-compute[73469]: INFO nova.compute.manager [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] [instance: f478387d-e004-4314-961d-abf4a910e970] Swapping volume c7d8979b-2a2d-463f-aef3-fdbf638abe91 for 27390dcd-4591-49a9-96ef-7f40e3b19735
Aug 22 02:55:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'apuDCexj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:29 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:29 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:29 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[999043c6-ac5f-4a7d-9f25-8090793c6fe1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 02:55:29 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4179cd7-0dd1-4c81-8732-a92a979591cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115] added
Aug 22 02:55:29 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3712b599-ea36-45ca-afd4-6f6ad407b819]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[679a7471-fc5c-4f8a-afeb-822f27e4ca01]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v apuDCexj {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v apuDCexj" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14377f6-adb0-4443-b703-ade061770052]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'apuDCexj'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e981d3ff-2db0-4ccc-be70-2342c40c80f4]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[45964f95-288c-40df-8f6c-a88183d76c73]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:29 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:29 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:29 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:29 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9949a9d0-dbe4-4798-a263-308defee5b82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115, portal: 172.16.0.220,3260]
Aug 22 02:55:29 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115, portal: 172.16.0.220,3260] successful.
Aug 22 02:55:29 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1637749-111d-47d5-8b93-56f161c4d06a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[115e7545-7530-4366-8c7d-ef7b55ae75b8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:29 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:29 user nova-compute[73469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 (non-flash)
Aug 22 02:55:29 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:29 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:29 user nova-compute[73469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 (non-flash)
Aug 22 02:55:29 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] HCTL ('35', '-', '-', 0) found on session 7 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.033s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06ddbfd-249a-44a2-8992-04b1ca066f2f]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Searching for a device in session 7 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:55:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'apuDCexj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:55:30 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Creating image(s)
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Did not create local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Ensure instance console log exists: /opt/stack/data/nova/instances/28e78814-0990-49e4-a6e7-e209276d2e46/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Start _get_guest_xml network_info=[{"id": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "address": "fa:16:3e:d4:b8:e1", "network": {"id": "f37e6636-5a5f-4465-91c5-6f305460d1d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903703061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d8e796-6f", "ovs_interfaceid": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "address": "fa:16:3e:97:ea:4f", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf962364e-a4", "ovs_interfaceid": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6af318a1-2ecf-4320-933c-4836f592367a", "address": "fa:16:3e:08:32:58", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af318a1-2e", "ovs_interfaceid": "6af318a1-2ecf-4320-933c-4836f592367a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "address": "fa:16:3e:fe:42:04", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f58efb2-2f", "ovs_interfaceid": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "address": "fa:16:3e:fc:e2:5d", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f06a837-3e", "ovs_interfaceid": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45e4812b-ca27-47b3-b289-63089cb11e00", "address": "fa:16:3e:a7:8f:57", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e4812b-ca", "ovs_interfaceid": "45e4812b-ca27-47b3-b289-63089cb11e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "address": "fa:16:3e:d6:db:55", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc301cc-bb", "ovs_interfaceid": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'c4c5f585-537c-4729-bffd-9e9b0b38f661', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGqbYmEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '28e78814-0990-49e4-a6e7-e209276d2e46', 'attached_at': '', 'detached_at': '', 'volume_id': '50e35ce7-e3d4-461b-951f-eb26eba9f267', 'serial': '50e35ce7-e3d4-461b-951f-eb26eba9f267'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None}, {'device_type': 'disk', 'boot_index': 1, 'disk_bus': 'virtio', 'attachment_id': '73ee7d2e-3d95-473f-a476-a2e301ff4b7c', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgyCUJwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '28e78814-0990-49e4-a6e7-e209276d2e46', 'attached_at': '', 'detached_at': '', 'volume_id': '2e845e74-8f7f-47c1-8c6c-421d00a5e5c6', 'serial': '2e845e74-8f7f-47c1-8c6c-421d00a5e5c6'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None}, {'device_type': 'disk', 'boot_index': 2, 'disk_bus': 'virtio', 'attachment_id': 'd3ab2bd2-3a75-4631-812b-91b96170b52b', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dFcLxEvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '28e78814-0990-49e4-a6e7-e209276d2e46', 'attached_at': '', 'detached_at': '', 'volume_id': 'a1ed05cb-3e80-4f16-81a7-5849f3dfe722', 'serial': 'a1ed05cb-3e80-4f16-81a7-5849f3dfe722'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:55:30 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:55:30 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26564643031653333', 'path': '/dev/sdd'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564643031653333', 'path': '/dev/sdd'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGqbYmEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:30 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:30 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:30 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.objects.instance [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lazy-loading 'flavor' on Instance uuid f988e66c-6bd1-49bb-ac43-140008f7c995 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d10282d-2731-4a92-8ebe-5564205c9359]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 02:55:30 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 02:55:30 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:55:30 user nova-compute[73469]:   <source dev="/dev/sdd"/>
Aug 22 02:55:30 user nova-compute[73469]:   <target dev="sdc" bus="scsi"/>
Aug 22 02:55:30 user nova-compute[73469]:   <serial>6450fe87-90ad-4484-a809-4f9d1fe67115</serial>
Aug 22 02:55:30 user nova-compute[73469]:   <address type="drive" controller="0" unit="2"/>
Aug 22 02:55:30 user nova-compute[73469]: </disk>
Aug 22 02:55:30 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[853b2500-c077-465b-9609-748f49850ad3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267] added
Aug 22 02:55:30 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c9c0af-2210-4df8-b44b-cdeb398ad72f]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[377cb61f-ee67-4c10-8d3a-4bd1a552a329]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JGqbYmEc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JGqbYmEc" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c784e43e-3297-495a-b53b-32dc34d3967a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JGqbYmEc'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1ef6ed-6523-4809-8a03-bf875a025a9d]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ebad46-ff36-4809-892e-2ae322bb4c5c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:31 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:31 user nova-compute[73469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 (non-flash)
Aug 22 02:55:31 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:31 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:31 user nova-compute[73469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 (non-flash)
Aug 22 02:55:31 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[81af8d1d-b4c6-46a6-a720-4f034051b023]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267, portal: 172.16.0.220,3260]
Aug 22 02:55:31 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267, portal: 172.16.0.220,3260] successful.
Aug 22 02:55:31 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[475ded87-d67f-4fc3-a888-55bdd55f85b2]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a010aa22-2b49-4ec9-92d9-cd29ac53f74c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:31 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:31 user nova-compute[73469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 (non-flash)
Aug 22 02:55:31 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:31 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:31 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:31 user nova-compute[73469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 (non-flash)
Aug 22 02:55:31 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:31 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] HCTL ('36', '-', '-', 0) found on session 8 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0082171-c276-4fe9-b5b1-c96b5cc9b3d6]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Searching for a device in session 8 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGqbYmEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] No BDM found with device name sda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] No VIF found with MAC fa:16:3e:b1:f4:12, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-be369835-881e-427c-a869-f6fb4b239b09 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.614s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Acquiring lock "f988e66c-6bd1-49bb-ac43-140008f7c995" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:32 user nova-compute[73469]: INFO nova.compute.manager [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Detaching volume 6450fe87-90ad-4484-a809-4f9d1fe67115
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26431356663323935', 'path': '/dev/sde'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431356663323935', 'path': '/dev/sde'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgyCUJwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:32 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:32 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:32 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:32 user nova-compute[73469]: INFO nova.virt.block_device [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Attempting to driver detach volume 6450fe87-90ad-4484-a809-4f9d1fe67115 from mountpoint /dev/sdc
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[736e0c7a-fb34-4ced-bea1-e6fa5737576d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 02:55:32 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Attempting to detach device sdc from instance f988e66c-6bd1-49bb-ac43-140008f7c995 from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 02:55:32 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:55:32 user nova-compute[73469]:   <source dev="/dev/sdd"/>
Aug 22 02:55:32 user nova-compute[73469]:   <target dev="sdc" bus="scsi"/>
Aug 22 02:55:32 user nova-compute[73469]:   <serial>6450fe87-90ad-4484-a809-4f9d1fe67115</serial>
Aug 22 02:55:32 user nova-compute[73469]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 22 02:55:32 user nova-compute[73469]: </disk>
Aug 22 02:55:32 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 02:55:32 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Successfully detached device sdc from instance f988e66c-6bd1-49bb-ac43-140008f7c995 from the persistent domain config.
Aug 22 02:55:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance f988e66c-6bd1-49bb-ac43-140008f7c995 from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 02:55:32 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:55:32 user nova-compute[73469]:   <source dev="/dev/sdd"/>
Aug 22 02:55:32 user nova-compute[73469]:   <target dev="sdc" bus="scsi"/>
Aug 22 02:55:32 user nova-compute[73469]:   <serial>6450fe87-90ad-4484-a809-4f9d1fe67115</serial>
Aug 22 02:55:32 user nova-compute[73469]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 22 02:55:32 user nova-compute[73469]: </disk>
Aug 22 02:55:32 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61a3212-f594-4b0d-a91a-d27a9631d666]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6] added
Aug 22 02:55:32 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c9a9bc-b5aa-4814-bb10-372ab718c9d4]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6519947d-dbb7-4bf4-8479-6bb726525402]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rgyCUJwK {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rgyCUJwK" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7841dc38-d68a-4c32-98ed-010500c7843d]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rgyCUJwK'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1105cf0a-6512-4d18-8044-8db13272cd13]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99e28f9-558b-4154-9f6b-24c980e4f293]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:32 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:32 user nova-compute[73469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 (non-flash)
Aug 22 02:55:32 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:32 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:32 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:32 user nova-compute[73469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 (non-flash)
Aug 22 02:55:32 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:32 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6a69d3-b2f5-48a5-85c2-bbc73a92c8bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6, portal: 172.16.0.220,3260]
Aug 22 02:55:32 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6, portal: 172.16.0.220,3260] successful.
Aug 22 02:55:32 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0585dead-4849-4dd3-b141-bbe332708f4a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[39df53fa-09c4-4130-9765-d0299512ecea]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:32 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:32 user nova-compute[73469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 (non-flash)
Aug 22 02:55:32 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:32 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:32 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:32 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:32 user nova-compute[73469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 (non-flash)
Aug 22 02:55:32 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:32 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:32 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[987a2ceb-3520-4b3e-8d8a-51cf7721ebe3]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgyCUJwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692672932.6538422, f988e66c-6bd1-49bb-ac43-140008f7c995 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance f988e66c-6bd1-49bb-ac43-140008f7c995 {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:32 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Successfully detached device sdc from instance f988e66c-6bd1-49bb-ac43-140008f7c995 from the live domain config.
Aug 22 02:55:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'apuDCexj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:32 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26166383965373866', 'path': '/dev/sdf'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166383965373866', 'path': '/dev/sdf'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.863s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[05727301-b666-43e6-a3c4-d89198dda537]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dFcLxEvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:33 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[312f5e23-5610-43cb-aef1-255f6cec832e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:33 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:33 user nova-compute[73469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 (non-flash)
Aug 22 02:55:33 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:33 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:33 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:33 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:33 user nova-compute[73469]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 (non-flash)
Aug 22 02:55:33 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:33 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:33 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a46452d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115'): ({'sdd'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Removing single pathed devices sdd {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1faf2be-d63e-4e6f-809d-65772b7feb02]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe08d27c-8fd0-4776-bf33-7b447e3c88e5]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Flushing IO for device /dev/sdd {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[81538d3a-9c87-47b1-94bc-7a69499b65e7]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[46519e7b-abf7-4bfb-ae1f-473cf4889347]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9fffe3-219e-4517-8c21-f0942be1bac2]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[233bdccd-a96d-442a-ad12-3fbca9dcc03b]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115, portal: 172.16.0.220,3260]
Aug 22 02:55:33 user nova-compute[73469]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115, portal: 172.16.0.220,3260] successful.
Aug 22 02:55:33 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450fe87-90ad-4484-a809-4f9d1fe67115 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[219de38d-0f88-484f-b0b4-f74da0b696d5]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] <== disconnect_volume: return (1189ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.283s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:33 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:33 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a77165-cc96-44a6-8549-f01b72e80014]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 02:55:33 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e452ae2-7bea-4249-aabe-37f558c06e14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722] added
Aug 22 02:55:33 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf588d6-b3f4-46c0-9e1f-e7b9a7814c99]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31abc03-df06-452e-ac7f-42fdd174fc6e]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dFcLxEvG {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dFcLxEvG" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6997d61b-1547-49bc-aece-7cbaf4887813]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dFcLxEvG'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab13cf50-f722-4ccb-a742-5c7c937d0e8a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1223c24-2d68-46d8-8faf-c9e189952579]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:34 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:34 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:34 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:34 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:34 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:34 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:34 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:34 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad698f5-63eb-4d26-b234-608935d1d453]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722, portal: 172.16.0.220,3260]
Aug 22 02:55:34 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722, portal: 172.16.0.220,3260] successful.
Aug 22 02:55:34 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[12353f05-d25b-4fb2-9b63-590f793708fb]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fde2bbc-c6d4-4187-ab85-eb429b058a0e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:55:34 user nova-compute[73469]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:34 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:34 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:34 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:34 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:55:34 user nova-compute[73469]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:34 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:34 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:34 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:34 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] HCTL ('35', '-', '-', 0) found on session 10 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e2a23e-a299-4331-80b6-95c7660a371d]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Searching for a device in session 10 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dFcLxEvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG nova.objects.instance [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lazy-loading 'flavor' on Instance uuid f988e66c-6bd1-49bb-ac43-140008f7c995 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2a90d977-4930-44f4-8fb7-fa39960b00a9 tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.665s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] <== connect_volume: return (1665ms) {'type': 'block', 'scsi_wwn': '23135326637633735', 'path': '/dev/sdd'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135326637633735', 'path': '/dev/sdd'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "address": "fa:16:3e:d4:b8:e1", "network": {"id": "f37e6636-5a5f-4465-91c5-6f305460d1d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903703061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d8e796-6f", "ovs_interfaceid": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "address": "fa:16:3e:d4:b8:e1", "network": {"id": "f37e6636-5a5f-4465-91c5-6f305460d1d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903703061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d8e796-6f", "ovs_interfaceid": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:b8:e1,bridge_name='br-int',has_traffic_filtering=True,id=d4d8e796-6ff5-4094-aab4-3efd059b5645,network=Network(f37e6636-5a5f-4465-91c5-6f305460d1d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d8e796-6f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "address": "fa:16:3e:97:ea:4f", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf962364e-a4", "ovs_interfaceid": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "address": "fa:16:3e:97:ea:4f", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf962364e-a4", "ovs_interfaceid": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:ea:4f,bridge_name='br-int',has_traffic_filtering=True,id=f962364e-a4e1-4d88-b7b5-5dcc07eb8220,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf962364e-a4') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6af318a1-2ecf-4320-933c-4836f592367a", "address": "fa:16:3e:08:32:58", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af318a1-2e", "ovs_interfaceid": "6af318a1-2ecf-4320-933c-4836f592367a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "6af318a1-2ecf-4320-933c-4836f592367a", "address": "fa:16:3e:08:32:58", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af318a1-2e", "ovs_interfaceid": "6af318a1-2ecf-4320-933c-4836f592367a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:32:58,bridge_name='br-int',has_traffic_filtering=True,id=6af318a1-2ecf-4320-933c-4836f592367a,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6af318a1-2e') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "address": "fa:16:3e:fe:42:04", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f58efb2-2f", "ovs_interfaceid": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "address": "fa:16:3e:fe:42:04", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f58efb2-2f", "ovs_interfaceid": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:42:04,bridge_name='br-int',has_traffic_filtering=True,id=0f58efb2-2fd2-42d0-a2db-f7b821677d19,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f58efb2-2f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "address": "fa:16:3e:fc:e2:5d", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f06a837-3e", "ovs_interfaceid": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "address": "fa:16:3e:fc:e2:5d", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f06a837-3e", "ovs_interfaceid": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:e2:5d,bridge_name='br-int',has_traffic_filtering=True,id=4f06a837-3e8c-4362-814a-3b9cd8085a05,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f06a837-3e') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45e4812b-ca27-47b3-b289-63089cb11e00", "address": "fa:16:3e:a7:8f:57", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e4812b-ca", "ovs_interfaceid": "45e4812b-ca27-47b3-b289-63089cb11e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "45e4812b-ca27-47b3-b289-63089cb11e00", "address": "fa:16:3e:a7:8f:57", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e4812b-ca", "ovs_interfaceid": "45e4812b-ca27-47b3-b289-63089cb11e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:8f:57,bridge_name='br-int',has_traffic_filtering=True,id=45e4812b-ca27-47b3-b289-63089cb11e00,network=Network(eece3552-98b8-41f1-ae19-9575fb5529b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e4812b-ca') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "address": "fa:16:3e:d6:db:55", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc301cc-bb", "ovs_interfaceid": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "address": "fa:16:3e:d6:db:55", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc301cc-bb", "ovs_interfaceid": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:db:55,bridge_name='br-int',has_traffic_filtering=True,id=cbc301cc-bb85-4871-b3bf-d4dfc54c99ba,network=Network(eece3552-98b8-41f1-ae19-9575fb5529b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc301cc-bb') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.objects.instance [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lazy-loading 'pci_devices' on Instance uuid 28e78814-0990-49e4-a6e7-e209276d2e46 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:55:35 user nova-compute[73469]:   <uuid>28e78814-0990-49e4-a6e7-e209276d2e46</uuid>
Aug 22 02:55:35 user nova-compute[73469]:   <name>instance-0000000b</name>
Aug 22 02:55:35 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:55:35 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:55:35 user nova-compute[73469]:   <metadata>
Aug 22 02:55:35 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:55:35 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:55:35 user nova-compute[73469]:       <nova:name>tempest-device-tagging-server-1352986397</nova:name>
Aug 22 02:55:35 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:55:30</nova:creationTime>
Aug 22 02:55:35 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:55:35 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:55:35 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:55:35 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:55:35 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:55:35 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:55:35 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:55:35 user nova-compute[73469]:       <nova:owner>
Aug 22 02:55:35 user nova-compute[73469]:         <nova:user uuid="794fcc9145b94cbb989309e571bb3f1c">tempest-TaggedBootDevicesTest-98908978-project-member</nova:user>
Aug 22 02:55:35 user nova-compute[73469]:         <nova:project uuid="7630ab68804e4d79b0a136f5c6236ea4">tempest-TaggedBootDevicesTest-98908978</nova:project>
Aug 22 02:55:35 user nova-compute[73469]:       </nova:owner>
Aug 22 02:55:35 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:55:35 user nova-compute[73469]:       <nova:ports>
Aug 22 02:55:35 user nova-compute[73469]:         <nova:port uuid="d4d8e796-6ff5-4094-aab4-3efd059b5645">
Aug 22 02:55:35 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 22 02:55:35 user nova-compute[73469]:         </nova:port>
Aug 22 02:55:35 user nova-compute[73469]:         <nova:port uuid="f962364e-a4e1-4d88-b7b5-5dcc07eb8220">
Aug 22 02:55:35 user nova-compute[73469]:           <nova:ip type="fixed" address="10.1.1.122" ipVersion="4"/>
Aug 22 02:55:35 user nova-compute[73469]:         </nova:port>
Aug 22 02:55:35 user nova-compute[73469]:         <nova:port uuid="6af318a1-2ecf-4320-933c-4836f592367a">
Aug 22 02:55:35 user nova-compute[73469]:           <nova:ip type="fixed" address="10.1.1.216" ipVersion="4"/>
Aug 22 02:55:35 user nova-compute[73469]:         </nova:port>
Aug 22 02:55:35 user nova-compute[73469]:         <nova:port uuid="0f58efb2-2fd2-42d0-a2db-f7b821677d19">
Aug 22 02:55:35 user nova-compute[73469]:           <nova:ip type="fixed" address="10.1.1.138" ipVersion="4"/>
Aug 22 02:55:35 user nova-compute[73469]:         </nova:port>
Aug 22 02:55:35 user nova-compute[73469]:         <nova:port uuid="4f06a837-3e8c-4362-814a-3b9cd8085a05">
Aug 22 02:55:35 user nova-compute[73469]:           <nova:ip type="fixed" address="10.1.1.101" ipVersion="4"/>
Aug 22 02:55:35 user nova-compute[73469]:         </nova:port>
Aug 22 02:55:35 user nova-compute[73469]:         <nova:port uuid="45e4812b-ca27-47b3-b289-63089cb11e00">
Aug 22 02:55:35 user nova-compute[73469]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 22 02:55:35 user nova-compute[73469]:         </nova:port>
Aug 22 02:55:35 user nova-compute[73469]:         <nova:port uuid="cbc301cc-bb85-4871-b3bf-d4dfc54c99ba">
Aug 22 02:55:35 user nova-compute[73469]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 22 02:55:35 user nova-compute[73469]:         </nova:port>
Aug 22 02:55:35 user nova-compute[73469]:       </nova:ports>
Aug 22 02:55:35 user nova-compute[73469]:     </nova:instance>
Aug 22 02:55:35 user nova-compute[73469]:   </metadata>
Aug 22 02:55:35 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:55:35 user nova-compute[73469]:     <system>
Aug 22 02:55:35 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:55:35 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:55:35 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:55:35 user nova-compute[73469]:       <entry name="serial">28e78814-0990-49e4-a6e7-e209276d2e46</entry>
Aug 22 02:55:35 user nova-compute[73469]:       <entry name="uuid">28e78814-0990-49e4-a6e7-e209276d2e46</entry>
Aug 22 02:55:35 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:55:35 user nova-compute[73469]:     </system>
Aug 22 02:55:35 user nova-compute[73469]:   </sysinfo>
Aug 22 02:55:35 user nova-compute[73469]:   <os>
Aug 22 02:55:35 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:55:35 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:55:35 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:55:35 user nova-compute[73469]:   </os>
Aug 22 02:55:35 user nova-compute[73469]:   <features>
Aug 22 02:55:35 user nova-compute[73469]:     <acpi/>
Aug 22 02:55:35 user nova-compute[73469]:     <apic/>
Aug 22 02:55:35 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:55:35 user nova-compute[73469]:   </features>
Aug 22 02:55:35 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:55:35 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:55:35 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:55:35 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:55:35 user nova-compute[73469]:   </clock>
Aug 22 02:55:35 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:55:35 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:55:35 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:55:35 user nova-compute[73469]:   </cpu>
Aug 22 02:55:35 user nova-compute[73469]:   <devices>
Aug 22 02:55:35 user nova-compute[73469]:     <disk type="file" device="cdrom">
Aug 22 02:55:35 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none"/>
Aug 22 02:55:35 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/28e78814-0990-49e4-a6e7-e209276d2e46/disk.config"/>
Aug 22 02:55:35 user nova-compute[73469]:       <target dev="hda" bus="ide"/>
Aug 22 02:55:35 user nova-compute[73469]:     </disk>
Aug 22 02:55:35 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 02:55:35 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:55:35 user nova-compute[73469]:       <source dev="/dev/sde"/>
Aug 22 02:55:35 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:55:35 user nova-compute[73469]:       <serial>50e35ce7-e3d4-461b-951f-eb26eba9f267</serial>
Aug 22 02:55:35 user nova-compute[73469]:     </disk>
Aug 22 02:55:35 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 02:55:35 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:55:35 user nova-compute[73469]:       <source dev="/dev/sdf"/>
Aug 22 02:55:35 user nova-compute[73469]:       <target dev="vdb" bus="virtio"/>
Aug 22 02:55:35 user nova-compute[73469]:       <serial>2e845e74-8f7f-47c1-8c6c-421d00a5e5c6</serial>
Aug 22 02:55:35 user nova-compute[73469]:     </disk>
Aug 22 02:55:35 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 02:55:35 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:55:35 user nova-compute[73469]:       <source dev="/dev/sdd"/>
Aug 22 02:55:35 user nova-compute[73469]:       <target dev="vdc" bus="virtio"/>
Aug 22 02:55:35 user nova-compute[73469]:       <serial>a1ed05cb-3e80-4f16-81a7-5849f3dfe722</serial>
Aug 22 02:55:35 user nova-compute[73469]:     </disk>
Aug 22 02:55:35 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:55:35 user nova-compute[73469]:       <mac address="fa:16:3e:d4:b8:e1"/>
Aug 22 02:55:35 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:55:35 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:55:35 user nova-compute[73469]:       <target dev="tapd4d8e796-6f"/>
Aug 22 02:55:35 user nova-compute[73469]:     </interface>
Aug 22 02:55:35 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:55:35 user nova-compute[73469]:       <mac address="fa:16:3e:97:ea:4f"/>
Aug 22 02:55:35 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:55:35 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:55:35 user nova-compute[73469]:       <target dev="tapf962364e-a4"/>
Aug 22 02:55:35 user nova-compute[73469]:     </interface>
Aug 22 02:55:35 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:55:35 user nova-compute[73469]:       <mac address="fa:16:3e:08:32:58"/>
Aug 22 02:55:35 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:55:35 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:55:35 user nova-compute[73469]:       <target dev="tap6af318a1-2e"/>
Aug 22 02:55:35 user nova-compute[73469]:     </interface>
Aug 22 02:55:35 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:55:35 user nova-compute[73469]:       <mac address="fa:16:3e:fe:42:04"/>
Aug 22 02:55:35 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:55:35 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:55:35 user nova-compute[73469]:       <target dev="tap0f58efb2-2f"/>
Aug 22 02:55:35 user nova-compute[73469]:     </interface>
Aug 22 02:55:35 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:55:35 user nova-compute[73469]:       <mac address="fa:16:3e:fc:e2:5d"/>
Aug 22 02:55:35 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:55:35 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:55:35 user nova-compute[73469]:       <target dev="tap4f06a837-3e"/>
Aug 22 02:55:35 user nova-compute[73469]:     </interface>
Aug 22 02:55:35 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:55:35 user nova-compute[73469]:       <mac address="fa:16:3e:a7:8f:57"/>
Aug 22 02:55:35 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:55:35 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:55:35 user nova-compute[73469]:       <target dev="tap45e4812b-ca"/>
Aug 22 02:55:35 user nova-compute[73469]:     </interface>
Aug 22 02:55:35 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:55:35 user nova-compute[73469]:       <mac address="fa:16:3e:d6:db:55"/>
Aug 22 02:55:35 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:55:35 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:55:35 user nova-compute[73469]:       <target dev="tapcbc301cc-bb"/>
Aug 22 02:55:35 user nova-compute[73469]:     </interface>
Aug 22 02:55:35 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:55:35 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/28e78814-0990-49e4-a6e7-e209276d2e46/console.log" append="off"/>
Aug 22 02:55:35 user nova-compute[73469]:     </serial>
Aug 22 02:55:35 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:55:35 user nova-compute[73469]:     <video>
Aug 22 02:55:35 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:55:35 user nova-compute[73469]:     </video>
Aug 22 02:55:35 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:55:35 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:55:35 user nova-compute[73469]:     </rng>
Aug 22 02:55:35 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:55:35 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:55:35 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:55:35 user nova-compute[73469]:     </memballoon>
Aug 22 02:55:35 user nova-compute[73469]:   </devices>
Aug 22 02:55:35 user nova-compute[73469]: </domain>
Aug 22 02:55:35 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "address": "fa:16:3e:d4:b8:e1", "network": {"id": "f37e6636-5a5f-4465-91c5-6f305460d1d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903703061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d8e796-6f", "ovs_interfaceid": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "address": "fa:16:3e:d4:b8:e1", "network": {"id": "f37e6636-5a5f-4465-91c5-6f305460d1d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903703061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d8e796-6f", "ovs_interfaceid": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:b8:e1,bridge_name='br-int',has_traffic_filtering=True,id=d4d8e796-6ff5-4094-aab4-3efd059b5645,network=Network(f37e6636-5a5f-4465-91c5-6f305460d1d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d8e796-6f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG os_vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:b8:e1,bridge_name='br-int',has_traffic_filtering=True,id=d4d8e796-6ff5-4094-aab4-3efd059b5645,network=Network(f37e6636-5a5f-4465-91c5-6f305460d1d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d8e796-6f') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4d8e796-6f, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4d8e796-6f, col_values=(('external_ids', {'iface-id': 'd4d8e796-6ff5-4094-aab4-3efd059b5645', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:b8:e1', 'vm-uuid': '28e78814-0990-49e4-a6e7-e209276d2e46'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: INFO os_vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:b8:e1,bridge_name='br-int',has_traffic_filtering=True,id=d4d8e796-6ff5-4094-aab4-3efd059b5645,network=Network(f37e6636-5a5f-4465-91c5-6f305460d1d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d8e796-6f')
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "address": "fa:16:3e:97:ea:4f", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf962364e-a4", "ovs_interfaceid": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "address": "fa:16:3e:97:ea:4f", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf962364e-a4", "ovs_interfaceid": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:ea:4f,bridge_name='br-int',has_traffic_filtering=True,id=f962364e-a4e1-4d88-b7b5-5dcc07eb8220,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf962364e-a4') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG os_vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:ea:4f,bridge_name='br-int',has_traffic_filtering=True,id=f962364e-a4e1-4d88-b7b5-5dcc07eb8220,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf962364e-a4') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf962364e-a4, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf962364e-a4, col_values=(('external_ids', {'iface-id': 'f962364e-a4e1-4d88-b7b5-5dcc07eb8220', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:ea:4f', 'vm-uuid': '28e78814-0990-49e4-a6e7-e209276d2e46'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: INFO os_vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:ea:4f,bridge_name='br-int',has_traffic_filtering=True,id=f962364e-a4e1-4d88-b7b5-5dcc07eb8220,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf962364e-a4')
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6af318a1-2ecf-4320-933c-4836f592367a", "address": "fa:16:3e:08:32:58", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af318a1-2e", "ovs_interfaceid": "6af318a1-2ecf-4320-933c-4836f592367a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "6af318a1-2ecf-4320-933c-4836f592367a", "address": "fa:16:3e:08:32:58", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af318a1-2e", "ovs_interfaceid": "6af318a1-2ecf-4320-933c-4836f592367a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:32:58,bridge_name='br-int',has_traffic_filtering=True,id=6af318a1-2ecf-4320-933c-4836f592367a,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6af318a1-2e') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG os_vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:32:58,bridge_name='br-int',has_traffic_filtering=True,id=6af318a1-2ecf-4320-933c-4836f592367a,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6af318a1-2e') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6af318a1-2e, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6af318a1-2e, col_values=(('external_ids', {'iface-id': '6af318a1-2ecf-4320-933c-4836f592367a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:32:58', 'vm-uuid': '28e78814-0990-49e4-a6e7-e209276d2e46'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: INFO os_vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:32:58,bridge_name='br-int',has_traffic_filtering=True,id=6af318a1-2ecf-4320-933c-4836f592367a,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6af318a1-2e')
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "address": "fa:16:3e:fe:42:04", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f58efb2-2f", "ovs_interfaceid": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "address": "fa:16:3e:fe:42:04", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f58efb2-2f", "ovs_interfaceid": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:42:04,bridge_name='br-int',has_traffic_filtering=True,id=0f58efb2-2fd2-42d0-a2db-f7b821677d19,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f58efb2-2f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG os_vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:42:04,bridge_name='br-int',has_traffic_filtering=True,id=0f58efb2-2fd2-42d0-a2db-f7b821677d19,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f58efb2-2f') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f58efb2-2f, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0f58efb2-2f, col_values=(('external_ids', {'iface-id': '0f58efb2-2fd2-42d0-a2db-f7b821677d19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:42:04', 'vm-uuid': '28e78814-0990-49e4-a6e7-e209276d2e46'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: INFO os_vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:42:04,bridge_name='br-int',has_traffic_filtering=True,id=0f58efb2-2fd2-42d0-a2db-f7b821677d19,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f58efb2-2f')
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "address": "fa:16:3e:fc:e2:5d", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f06a837-3e", "ovs_interfaceid": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "address": "fa:16:3e:fc:e2:5d", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f06a837-3e", "ovs_interfaceid": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:e2:5d,bridge_name='br-int',has_traffic_filtering=True,id=4f06a837-3e8c-4362-814a-3b9cd8085a05,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f06a837-3e') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG os_vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:e2:5d,bridge_name='br-int',has_traffic_filtering=True,id=4f06a837-3e8c-4362-814a-3b9cd8085a05,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f06a837-3e') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f06a837-3e, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f06a837-3e, col_values=(('external_ids', {'iface-id': '4f06a837-3e8c-4362-814a-3b9cd8085a05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:e2:5d', 'vm-uuid': '28e78814-0990-49e4-a6e7-e209276d2e46'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: INFO os_vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:e2:5d,bridge_name='br-int',has_traffic_filtering=True,id=4f06a837-3e8c-4362-814a-3b9cd8085a05,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f06a837-3e')
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45e4812b-ca27-47b3-b289-63089cb11e00", "address": "fa:16:3e:a7:8f:57", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e4812b-ca", "ovs_interfaceid": "45e4812b-ca27-47b3-b289-63089cb11e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "45e4812b-ca27-47b3-b289-63089cb11e00", "address": "fa:16:3e:a7:8f:57", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e4812b-ca", "ovs_interfaceid": "45e4812b-ca27-47b3-b289-63089cb11e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:8f:57,bridge_name='br-int',has_traffic_filtering=True,id=45e4812b-ca27-47b3-b289-63089cb11e00,network=Network(eece3552-98b8-41f1-ae19-9575fb5529b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e4812b-ca') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG os_vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:8f:57,bridge_name='br-int',has_traffic_filtering=True,id=45e4812b-ca27-47b3-b289-63089cb11e00,network=Network(eece3552-98b8-41f1-ae19-9575fb5529b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e4812b-ca') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45e4812b-ca, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap45e4812b-ca, col_values=(('external_ids', {'iface-id': '45e4812b-ca27-47b3-b289-63089cb11e00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:8f:57', 'vm-uuid': '28e78814-0990-49e4-a6e7-e209276d2e46'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:36 user nova-compute[73469]: INFO os_vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:8f:57,bridge_name='br-int',has_traffic_filtering=True,id=45e4812b-ca27-47b3-b289-63089cb11e00,network=Network(eece3552-98b8-41f1-ae19-9575fb5529b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e4812b-ca')
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "address": "fa:16:3e:d6:db:55", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc301cc-bb", "ovs_interfaceid": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "address": "fa:16:3e:d6:db:55", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc301cc-bb", "ovs_interfaceid": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:db:55,bridge_name='br-int',has_traffic_filtering=True,id=cbc301cc-bb85-4871-b3bf-d4dfc54c99ba,network=Network(eece3552-98b8-41f1-ae19-9575fb5529b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc301cc-bb') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG os_vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:db:55,bridge_name='br-int',has_traffic_filtering=True,id=cbc301cc-bb85-4871-b3bf-d4dfc54c99ba,network=Network(eece3552-98b8-41f1-ae19-9575fb5529b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc301cc-bb') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbc301cc-bb, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcbc301cc-bb, col_values=(('external_ids', {'iface-id': 'cbc301cc-bb85-4871-b3bf-d4dfc54c99ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:db:55', 'vm-uuid': '28e78814-0990-49e4-a6e7-e209276d2e46'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Acquiring lock "f988e66c-6bd1-49bb-ac43-140008f7c995" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Acquiring lock "f988e66c-6bd1-49bb-ac43-140008f7c995-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:36 user nova-compute[73469]: INFO nova.compute.manager [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Terminating instance
Aug 22 02:55:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 02:55:36 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:55:36 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=7067MB free_disk=25.44256591796875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:36 user nova-compute[73469]: INFO os_vif [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:db:55,bridge_name='br-int',has_traffic_filtering=True,id=cbc301cc-bb85-4871-b3bf-d4dfc54c99ba,network=Network(eece3552-98b8-41f1-ae19-9575fb5529b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc301cc-bb')
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] No BDM found with device name hda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] No VIF found with MAC fa:16:3e:d4:b8:e1, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] No VIF found with MAC fa:16:3e:fc:e2:5d, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:55:36 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Using config drive
Aug 22 02:55:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d0668c0-7a49-4857-9b69-541021f18ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance dc3f5545-8ebb-4947-97d0-98a91f67e421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f5fdf305-bf02-4b53-bb0d-83e939ae1acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f988e66c-6bd1-49bb-ac43-140008f7c995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f478387d-e004-4314-961d-abf4a910e970 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 71874297-5bc8-4816-b99e-58661ec38500 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82db3ec6-ab80-406e-84b2-2714a01a94dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 28e78814-0990-49e4-a6e7-e209276d2e46 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 3ade8cba-6c34-4457-9ad3-484a604dbdb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-306fef03-feb7-4b3c-b4aa-efc6648e06cb req-61fe75ff-0777-4854-8162-2037998de485 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received event network-changed-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-306fef03-feb7-4b3c-b4aa-efc6648e06cb req-61fe75ff-0777-4854-8162-2037998de485 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Refreshing instance network info cache due to event network-changed-a442f21d-ed03-4b3f-89d7-c5b24175d1f9. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-306fef03-feb7-4b3c-b4aa-efc6648e06cb req-61fe75ff-0777-4854-8162-2037998de485 service nova] Acquiring lock "refresh_cache-71874297-5bc8-4816-b99e-58661ec38500" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-306fef03-feb7-4b3c-b4aa-efc6648e06cb req-61fe75ff-0777-4854-8162-2037998de485 service nova] Acquired lock "refresh_cache-71874297-5bc8-4816-b99e-58661ec38500" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.network.neutron [req-306fef03-feb7-4b3c-b4aa-efc6648e06cb req-61fe75ff-0777-4854-8162-2037998de485 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Refreshing network info cache for port a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:36 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Creating config drive at /opt/stack/data/nova/instances/28e78814-0990-49e4-a6e7-e209276d2e46/disk.config
Aug 22 02:55:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/28e78814-0990-49e4-a6e7-e209276d2e46/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnk11fme1 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/28e78814-0990-49e4-a6e7-e209276d2e46/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnk11fme1" returned: 0 in 0.057s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 02:55:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.687s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG nova.network.neutron [req-306fef03-feb7-4b3c-b4aa-efc6648e06cb req-61fe75ff-0777-4854-8162-2037998de485 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Updated VIF entry in instance network info cache for port a442f21d-ed03-4b3f-89d7-c5b24175d1f9. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG nova.network.neutron [req-306fef03-feb7-4b3c-b4aa-efc6648e06cb req-61fe75ff-0777-4854-8162-2037998de485 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Updating instance_info_cache with network_info: [{"id": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "address": "fa:16:3e:b0:64:29", "network": {"id": "c0ca9d32-e425-4576-8e7a-007b037ac6e2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-953287001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5e945a8b0f0492c9099049690ada404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa442f21d-ed", "ovs_interfaceid": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-306fef03-feb7-4b3c-b4aa-efc6648e06cb req-61fe75ff-0777-4854-8162-2037998de485 service nova] Releasing lock "refresh_cache-71874297-5bc8-4816-b99e-58661ec38500" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG nova.compute.manager [req-5dbc190b-3f78-4c13-b870-3ee45f8ab7ac req-061bfac2-8b3a-42be-bafb-057c64becf10 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Received event network-vif-unplugged-ec723392-c81a-4e29-9b7c-29bfe467419f {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5dbc190b-3f78-4c13-b870-3ee45f8ab7ac req-061bfac2-8b3a-42be-bafb-057c64becf10 service nova] Acquiring lock "f988e66c-6bd1-49bb-ac43-140008f7c995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5dbc190b-3f78-4c13-b870-3ee45f8ab7ac req-061bfac2-8b3a-42be-bafb-057c64becf10 service nova] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5dbc190b-3f78-4c13-b870-3ee45f8ab7ac req-061bfac2-8b3a-42be-bafb-057c64becf10 service nova] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG nova.compute.manager [req-5dbc190b-3f78-4c13-b870-3ee45f8ab7ac req-061bfac2-8b3a-42be-bafb-057c64becf10 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] No waiting events found dispatching network-vif-unplugged-ec723392-c81a-4e29-9b7c-29bfe467419f {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG nova.compute.manager [req-5dbc190b-3f78-4c13-b870-3ee45f8ab7ac req-061bfac2-8b3a-42be-bafb-057c64becf10 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Received event network-vif-unplugged-ec723392-c81a-4e29-9b7c-29bfe467419f for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:37 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Instance destroyed successfully.
Aug 22 02:55:37 user nova-compute[73469]: DEBUG nova.objects.instance [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lazy-loading 'resources' on Instance uuid f988e66c-6bd1-49bb-ac43-140008f7c995 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:53:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-609542542',display_name='tempest-AttachSCSIVolumeTestJSON-server-609542542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-609542542',id=7,image_ref='31c48251-7534-48de-b2b4-d8d4d18d595f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0M+3FuT1yOxrBv6NKuI4r7yvfUIUwIr2xOLHOz1RaTlWriFPmHJ6u84K0wWbYYxpB901RsPKGl+54I6yfFJHKR5MjEy4puP9PAUBG46aET6Lr17VKbZDWq9CnrQecRfQ==',key_name='tempest-keypair-853967548',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:53:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea11f6b107064d67925facec50a49fb7',ramdisk_id='',reservation_id='r-n4zhb4dx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='31c48251-7534-48de-b2b4-d8d4d18d595f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1011330548',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1011330548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:53:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2578791264c145369cdfdec5b4b697da',uuid=f988e66c-6bd1-49bb-ac43-140008f7c995,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec723392-c81a-4e29-9b7c-29bfe467419f", "address": "fa:16:3e:b1:f4:12", "network": {"id": "44ec7375-8521-4a64-a172-6677f74183e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-546521769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea11f6b107064d67925facec50a49fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec723392-c8", "ovs_interfaceid": "ec723392-c81a-4e29-9b7c-29bfe467419f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Converting VIF {"id": "ec723392-c81a-4e29-9b7c-29bfe467419f", "address": "fa:16:3e:b1:f4:12", "network": {"id": "44ec7375-8521-4a64-a172-6677f74183e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-546521769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea11f6b107064d67925facec50a49fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec723392-c8", "ovs_interfaceid": "ec723392-c81a-4e29-9b7c-29bfe467419f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:f4:12,bridge_name='br-int',has_traffic_filtering=True,id=ec723392-c81a-4e29-9b7c-29bfe467419f,network=Network(44ec7375-8521-4a64-a172-6677f74183e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec723392-c8') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG os_vif [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:f4:12,bridge_name='br-int',has_traffic_filtering=True,id=ec723392-c81a-4e29-9b7c-29bfe467419f,network=Network(44ec7375-8521-4a64-a172-6677f74183e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec723392-c8') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec723392-c8, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:37 user nova-compute[73469]: INFO os_vif [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:f4:12,bridge_name='br-int',has_traffic_filtering=True,id=ec723392-c81a-4e29-9b7c-29bfe467419f,network=Network(44ec7375-8521-4a64-a172-6677f74183e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec723392-c8')
Aug 22 02:55:37 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Deleting instance files /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995_del
Aug 22 02:55:37 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Deletion of /opt/stack/data/nova/instances/f988e66c-6bd1-49bb-ac43-140008f7c995_del complete
Aug 22 02:55:37 user nova-compute[73469]: INFO nova.compute.manager [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 22 02:55:37 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 02:55:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:38 user nova-compute[73469]: INFO nova.compute.manager [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Rebuilding instance
Aug 22 02:55:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG nova.objects.instance [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lazy-loading 'trusted_certs' on Instance uuid 71874297-5bc8-4816-b99e-58661ec38500 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG nova.objects.instance [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lazy-loading 'pci_requests' on Instance uuid 71874297-5bc8-4816-b99e-58661ec38500 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG nova.objects.instance [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lazy-loading 'pci_devices' on Instance uuid 71874297-5bc8-4816-b99e-58661ec38500 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG nova.objects.instance [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lazy-loading 'resources' on Instance uuid 71874297-5bc8-4816-b99e-58661ec38500 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG nova.objects.instance [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lazy-loading 'migration_context' on Instance uuid 71874297-5bc8-4816-b99e-58661ec38500 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG nova.objects.instance [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73469) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:55:38 user nova-compute[73469]: INFO nova.compute.claims [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Claim successful on node user
Aug 22 02:55:38 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 02:55:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-b068f5f0-c171-47bf-ade7-ada31bda3f00 req-e3f1e24d-9f4f-4844-9d45-09e5b00b315a service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-d4d8e796-6ff5-4094-aab4-3efd059b5645 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b068f5f0-c171-47bf-ade7-ada31bda3f00 req-e3f1e24d-9f4f-4844-9d45-09e5b00b315a service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b068f5f0-c171-47bf-ade7-ada31bda3f00 req-e3f1e24d-9f4f-4844-9d45-09e5b00b315a service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b068f5f0-c171-47bf-ade7-ada31bda3f00 req-e3f1e24d-9f4f-4844-9d45-09e5b00b315a service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-b068f5f0-c171-47bf-ade7-ada31bda3f00 req-e3f1e24d-9f4f-4844-9d45-09e5b00b315a service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-d4d8e796-6ff5-4094-aab4-3efd059b5645 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:39 user nova-compute[73469]: WARNING nova.compute.manager [req-b068f5f0-c171-47bf-ade7-ada31bda3f00 req-e3f1e24d-9f4f-4844-9d45-09e5b00b315a service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-d4d8e796-6ff5-4094-aab4-3efd059b5645 for instance with vm_state building and task_state spawning.
Aug 22 02:55:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-dc3f5545-8ebb-4947-97d0-98a91f67e421" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-dc3f5545-8ebb-4947-97d0-98a91f67e421" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-40d8f9a6-1e64-48b3-b6a1-c317360ec0b4 req-1b3fac6f-4b3a-4237-a1ab-a3df76d19cdc service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Received event network-vif-plugged-ec723392-c81a-4e29-9b7c-29bfe467419f {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-40d8f9a6-1e64-48b3-b6a1-c317360ec0b4 req-1b3fac6f-4b3a-4237-a1ab-a3df76d19cdc service nova] Acquiring lock "f988e66c-6bd1-49bb-ac43-140008f7c995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-40d8f9a6-1e64-48b3-b6a1-c317360ec0b4 req-1b3fac6f-4b3a-4237-a1ab-a3df76d19cdc service nova] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-40d8f9a6-1e64-48b3-b6a1-c317360ec0b4 req-1b3fac6f-4b3a-4237-a1ab-a3df76d19cdc service nova] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-40d8f9a6-1e64-48b3-b6a1-c317360ec0b4 req-1b3fac6f-4b3a-4237-a1ab-a3df76d19cdc service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] No waiting events found dispatching network-vif-plugged-ec723392-c81a-4e29-9b7c-29bfe467419f {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:39 user nova-compute[73469]: WARNING nova.compute.manager [req-40d8f9a6-1e64-48b3-b6a1-c317360ec0b4 req-1b3fac6f-4b3a-4237-a1ab-a3df76d19cdc service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Received unexpected event network-vif-plugged-ec723392-c81a-4e29-9b7c-29bfe467419f for instance with vm_state active and task_state deleting.
Aug 22 02:55:39 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-5d51a38b-da7c-4f95-8611-39314ad3a3c5 req-c6957ea1-c35b-4e4b-bd77-d31be98c7154 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received event network-vif-unplugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5d51a38b-da7c-4f95-8611-39314ad3a3c5 req-c6957ea1-c35b-4e4b-bd77-d31be98c7154 service nova] Acquiring lock "71874297-5bc8-4816-b99e-58661ec38500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5d51a38b-da7c-4f95-8611-39314ad3a3c5 req-c6957ea1-c35b-4e4b-bd77-d31be98c7154 service nova] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5d51a38b-da7c-4f95-8611-39314ad3a3c5 req-c6957ea1-c35b-4e4b-bd77-d31be98c7154 service nova] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-5d51a38b-da7c-4f95-8611-39314ad3a3c5 req-c6957ea1-c35b-4e4b-bd77-d31be98c7154 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] No waiting events found dispatching network-vif-unplugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:39 user nova-compute[73469]: WARNING nova.compute.manager [req-5d51a38b-da7c-4f95-8611-39314ad3a3c5 req-c6957ea1-c35b-4e4b-bd77-d31be98c7154 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received unexpected event network-vif-unplugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 for instance with vm_state active and task_state rebuilding.
Aug 22 02:55:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:39 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Took 1.86 seconds to deallocate network for instance.
Aug 22 02:55:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.688s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG nova.compute.manager [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.097s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG nova.compute.manager [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG nova.network.neutron [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:55:39 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 02:55:39 user nova-compute[73469]: DEBUG nova.compute.manager [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:39 user nova-compute[73469]: DEBUG nova.policy [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7b228f99c9e4d058e128a5a99636b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9131cb883044191931dc31e51e94766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:55:39 user nova-compute[73469]: INFO nova.virt.block_device [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Booting with blank volume at /dev/vda
Aug 22 02:55:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Updating instance_info_cache with network_info: [{"id": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "address": "fa:16:3e:89:d7:b7", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ef805d-a4", "ovs_interfaceid": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-dc3f5545-8ebb-4947-97d0-98a91f67e421" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.656s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:40 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Instance destroyed successfully.
Aug 22 02:55:40 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Deleted allocations for instance f988e66c-6bd1-49bb-ac43-140008f7c995
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:40 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Instance destroyed successfully.
Aug 22 02:55:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1381787490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-377659152',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKdydlpBpfM8iUKDYqmt+T3Vb9ogb25mCf0t5qBVWqYu7okcZIbqswy9cY7EzBR1ehqgAhMx+2jQu1gM1ufIoHEPIBlAoobLh2iMYLXMFczVAufMp/nR4kSWj02M0KlhA==',key_name='tempest-keypair-904786919',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:54:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f5e945a8b0f0492c9099049690ada404',ramdisk_id='',reservation_id='r-k6v908aw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-436752772',owner_user_name='tempest-ServerActionsV293TestJSON-436752772-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:55:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5ba5f1c3b147388c043d08d17103c1',uuid=71874297-5bc8-4816-b99e-58661ec38500,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "address": "fa:16:3e:b0:64:29", "network": {"id": "c0ca9d32-e425-4576-8e7a-007b037ac6e2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-953287001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5e945a8b0f0492c9099049690ada404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa442f21d-ed", "ovs_interfaceid": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Converting VIF {"id": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "address": "fa:16:3e:b0:64:29", "network": {"id": "c0ca9d32-e425-4576-8e7a-007b037ac6e2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-953287001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5e945a8b0f0492c9099049690ada404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa442f21d-ed", "ovs_interfaceid": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:64:29,bridge_name='br-int',has_traffic_filtering=True,id=a442f21d-ed03-4b3f-89d7-c5b24175d1f9,network=Network(c0ca9d32-e425-4576-8e7a-007b037ac6e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa442f21d-ed') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG os_vif [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:64:29,bridge_name='br-int',has_traffic_filtering=True,id=a442f21d-ed03-4b3f-89d7-c5b24175d1f9,network=Network(c0ca9d32-e425-4576-8e7a-007b037ac6e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa442f21d-ed') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa442f21d-ed, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:40 user nova-compute[73469]: INFO os_vif [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:64:29,bridge_name='br-int',has_traffic_filtering=True,id=a442f21d-ed03-4b3f-89d7-c5b24175d1f9,network=Network(c0ca9d32-e425-4576-8e7a-007b037ac6e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa442f21d-ed')
Aug 22 02:55:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSLPutZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:40 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 22 02:55:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dfab4db9-e806-416c-8a10-febc01dc4d2c tempest-AttachSCSIVolumeTestJSON-1011330548 tempest-AttachSCSIVolumeTestJSON-1011330548-project-member] Lock "f988e66c-6bd1-49bb-ac43-140008f7c995" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.159s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2905ff77-2a3d-4baa-ab02-70d9376093fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6323f82-b6a1-4a0e-962f-ca17dd0184df]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:55:40 user nova-compute[73469]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:40 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:40 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:40 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:40 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:55:40 user nova-compute[73469]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:55:40 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:40 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:40 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:40 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4646950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae87c8ca-5361-4601-a522-be89caa62c0b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.038s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d59f8c-4fbc-4432-a345-ae3dc9940bec]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f9ea7a-f6ff-4bf9-8ad6-237a8d14ae76]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.090s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25a6b5a-d7e9-415b-b9b5-69623b88a8ad]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80b17aa-e63f-4716-af75-e407542d4718]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.132s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a7ac15-3cf5-44e3-9bd4-e22d376d6ac5]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4, portal: 172.16.0.220,3260]
Aug 22 02:55:40 user nova-compute[73469]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4, portal: 172.16.0.220,3260] successful.
Aug 22 02:55:40 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[229d9076-1e01-4911-addc-35badc1dbbe4]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.496s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] <== disconnect_volume: return (498ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 02:55:40 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Deleting instance files /opt/stack/data/nova/instances/71874297-5bc8-4816-b99e-58661ec38500_del
Aug 22 02:55:40 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Deletion of /opt/stack/data/nova/instances/71874297-5bc8-4816-b99e-58661ec38500_del complete
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-78e434e9-e786-4095-9126-62ff94b6c1c7 req-6cf30cd0-304a-413c-aa04-0de0a4979bc1 service nova] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Received event network-vif-deleted-ec723392-c81a-4e29-9b7c-29bfe467419f {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-78e434e9-e786-4095-9126-62ff94b6c1c7 req-6cf30cd0-304a-413c-aa04-0de0a4979bc1 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-d4d8e796-6ff5-4094-aab4-3efd059b5645 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-78e434e9-e786-4095-9126-62ff94b6c1c7 req-6cf30cd0-304a-413c-aa04-0de0a4979bc1 service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-78e434e9-e786-4095-9126-62ff94b6c1c7 req-6cf30cd0-304a-413c-aa04-0de0a4979bc1 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-78e434e9-e786-4095-9126-62ff94b6c1c7 req-6cf30cd0-304a-413c-aa04-0de0a4979bc1 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-78e434e9-e786-4095-9126-62ff94b6c1c7 req-6cf30cd0-304a-413c-aa04-0de0a4979bc1 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-d4d8e796-6ff5-4094-aab4-3efd059b5645 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:41 user nova-compute[73469]: WARNING nova.compute.manager [req-78e434e9-e786-4095-9126-62ff94b6c1c7 req-6cf30cd0-304a-413c-aa04-0de0a4979bc1 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-d4d8e796-6ff5-4094-aab4-3efd059b5645 for instance with vm_state building and task_state spawning.
Aug 22 02:55:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-78e434e9-e786-4095-9126-62ff94b6c1c7 req-6cf30cd0-304a-413c-aa04-0de0a4979bc1 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-0f58efb2-2fd2-42d0-a2db-f7b821677d19 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-78e434e9-e786-4095-9126-62ff94b6c1c7 req-6cf30cd0-304a-413c-aa04-0de0a4979bc1 service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-78e434e9-e786-4095-9126-62ff94b6c1c7 req-6cf30cd0-304a-413c-aa04-0de0a4979bc1 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-78e434e9-e786-4095-9126-62ff94b6c1c7 req-6cf30cd0-304a-413c-aa04-0de0a4979bc1 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-78e434e9-e786-4095-9126-62ff94b6c1c7 req-6cf30cd0-304a-413c-aa04-0de0a4979bc1 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-0f58efb2-2fd2-42d0-a2db-f7b821677d19 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:41 user nova-compute[73469]: WARNING nova.compute.manager [req-78e434e9-e786-4095-9126-62ff94b6c1c7 req-6cf30cd0-304a-413c-aa04-0de0a4979bc1 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-0f58efb2-2fd2-42d0-a2db-f7b821677d19 for instance with vm_state building and task_state spawning.
Aug 22 02:55:41 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 71874297-5bc8-4816-b99e-58661ec38500 could not be found.
Aug 22 02:55:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSLPutZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:41 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 22 02:55:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ff50a4-473f-4e64-93ed-f6a67626cc84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6415b16d-eae3-48e5-9415-ec0080e81f27]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:55:41 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:41 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:41 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:41 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:55:41 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:41 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:41 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:41 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4549fc0>, {}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Disconnecting from: [] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] <== disconnect_volume: return (84ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-58b09f7c-2eb0-4915-bb99-cf7f46000609 req-b795a9c7-b3cc-4ff1-969d-14445dc38286 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-f962364e-a4e1-4d88-b7b5-5dcc07eb8220 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-58b09f7c-2eb0-4915-bb99-cf7f46000609 req-b795a9c7-b3cc-4ff1-969d-14445dc38286 service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-58b09f7c-2eb0-4915-bb99-cf7f46000609 req-b795a9c7-b3cc-4ff1-969d-14445dc38286 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-58b09f7c-2eb0-4915-bb99-cf7f46000609 req-b795a9c7-b3cc-4ff1-969d-14445dc38286 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-58b09f7c-2eb0-4915-bb99-cf7f46000609 req-b795a9c7-b3cc-4ff1-969d-14445dc38286 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-f962364e-a4e1-4d88-b7b5-5dcc07eb8220 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:41 user nova-compute[73469]: WARNING nova.compute.manager [req-58b09f7c-2eb0-4915-bb99-cf7f46000609 req-b795a9c7-b3cc-4ff1-969d-14445dc38286 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-f962364e-a4e1-4d88-b7b5-5dcc07eb8220 for instance with vm_state building and task_state spawning.
Aug 22 02:55:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-58b09f7c-2eb0-4915-bb99-cf7f46000609 req-b795a9c7-b3cc-4ff1-969d-14445dc38286 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-f962364e-a4e1-4d88-b7b5-5dcc07eb8220 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-58b09f7c-2eb0-4915-bb99-cf7f46000609 req-b795a9c7-b3cc-4ff1-969d-14445dc38286 service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-58b09f7c-2eb0-4915-bb99-cf7f46000609 req-b795a9c7-b3cc-4ff1-969d-14445dc38286 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-58b09f7c-2eb0-4915-bb99-cf7f46000609 req-b795a9c7-b3cc-4ff1-969d-14445dc38286 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-58b09f7c-2eb0-4915-bb99-cf7f46000609 req-b795a9c7-b3cc-4ff1-969d-14445dc38286 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-f962364e-a4e1-4d88-b7b5-5dcc07eb8220 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:41 user nova-compute[73469]: WARNING nova.compute.manager [req-58b09f7c-2eb0-4915-bb99-cf7f46000609 req-b795a9c7-b3cc-4ff1-969d-14445dc38286 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-f962364e-a4e1-4d88-b7b5-5dcc07eb8220 for instance with vm_state building and task_state spawning.
Aug 22 02:55:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-108f1f68-bfca-4fe1-a025-444f580cfc25 req-6046e9b9-a308-4d45-b2f0-c0073607e585 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received event network-vif-plugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-108f1f68-bfca-4fe1-a025-444f580cfc25 req-6046e9b9-a308-4d45-b2f0-c0073607e585 service nova] Acquiring lock "71874297-5bc8-4816-b99e-58661ec38500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-108f1f68-bfca-4fe1-a025-444f580cfc25 req-6046e9b9-a308-4d45-b2f0-c0073607e585 service nova] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-108f1f68-bfca-4fe1-a025-444f580cfc25 req-6046e9b9-a308-4d45-b2f0-c0073607e585 service nova] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-108f1f68-bfca-4fe1-a025-444f580cfc25 req-6046e9b9-a308-4d45-b2f0-c0073607e585 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] No waiting events found dispatching network-vif-plugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:41 user nova-compute[73469]: WARNING nova.compute.manager [req-108f1f68-bfca-4fe1-a025-444f580cfc25 req-6046e9b9-a308-4d45-b2f0-c0073607e585 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received unexpected event network-vif-plugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 for instance with vm_state active and task_state rebuilding.
Aug 22 02:55:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-108f1f68-bfca-4fe1-a025-444f580cfc25 req-6046e9b9-a308-4d45-b2f0-c0073607e585 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-6af318a1-2ecf-4320-933c-4836f592367a {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-108f1f68-bfca-4fe1-a025-444f580cfc25 req-6046e9b9-a308-4d45-b2f0-c0073607e585 service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-108f1f68-bfca-4fe1-a025-444f580cfc25 req-6046e9b9-a308-4d45-b2f0-c0073607e585 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-108f1f68-bfca-4fe1-a025-444f580cfc25 req-6046e9b9-a308-4d45-b2f0-c0073607e585 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-108f1f68-bfca-4fe1-a025-444f580cfc25 req-6046e9b9-a308-4d45-b2f0-c0073607e585 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-6af318a1-2ecf-4320-933c-4836f592367a {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:41 user nova-compute[73469]: WARNING nova.compute.manager [req-108f1f68-bfca-4fe1-a025-444f580cfc25 req-6046e9b9-a308-4d45-b2f0-c0073607e585 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-6af318a1-2ecf-4320-933c-4836f592367a for instance with vm_state building and task_state spawning.
Aug 22 02:55:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-108f1f68-bfca-4fe1-a025-444f580cfc25 req-6046e9b9-a308-4d45-b2f0-c0073607e585 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-6af318a1-2ecf-4320-933c-4836f592367a {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-108f1f68-bfca-4fe1-a025-444f580cfc25 req-6046e9b9-a308-4d45-b2f0-c0073607e585 service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-108f1f68-bfca-4fe1-a025-444f580cfc25 req-6046e9b9-a308-4d45-b2f0-c0073607e585 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-108f1f68-bfca-4fe1-a025-444f580cfc25 req-6046e9b9-a308-4d45-b2f0-c0073607e585 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-108f1f68-bfca-4fe1-a025-444f580cfc25 req-6046e9b9-a308-4d45-b2f0-c0073607e585 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-6af318a1-2ecf-4320-933c-4836f592367a {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:41 user nova-compute[73469]: WARNING nova.compute.manager [req-108f1f68-bfca-4fe1-a025-444f580cfc25 req-6046e9b9-a308-4d45-b2f0-c0073607e585 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-6af318a1-2ecf-4320-933c-4836f592367a for instance with vm_state building and task_state spawning.
Aug 22 02:55:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] [instance: f478387d-e004-4314-961d-abf4a910e970] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aiSKRpOD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f478387d-e004-4314-961d-abf4a910e970', 'attached_at': '', 'detached_at': '', 'volume_id': '27390dcd-4591-49a9-96ef-7f40e3b19735', 'serial': '27390dcd-4591-49a9-96ef-7f40e3b19735'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFIKOAiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f478387d-e004-4314-961d-abf4a910e970', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7d8979b-2a2d-463f-aef3-fdbf638abe91', 'serial'} {{(pid=73469) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG nova.network.neutron [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Successfully created port: ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] [instance: f478387d-e004-4314-961d-abf4a910e970] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aiSKRpOD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:42 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:42 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:42 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fe0794-e04d-4e20-82fe-f7d2e8f0c9e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 02:55:42 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fc5caa-6b72-4033-91cd-cb936c2080b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735] added
Aug 22 02:55:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[96835956-b011-4354-a35f-697acbb6e191]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[062022c2-1392-48a5-a07e-916f69948ff4]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aiSKRpOD {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aiSKRpOD" returned: 0 in 0.028s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9151cd93-a582-43e4-b41f-898310c6cba2]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aiSKRpOD'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafac011-8b83-4875-b883-c32d34827d9b]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8035b4e-5847-4325-80dc-6c42f1dab3e3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:55:42 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:42 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:42 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:55:42 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:42 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:42 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[915e35e4-c5eb-444b-9faf-21049e0c99f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735, portal: 172.16.0.220,3260]
Aug 22 02:55:42 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735, portal: 172.16.0.220,3260] successful.
Aug 22 02:55:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[252e7065-095f-4b56-9915-06a1c7243b3d]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[34aa57b3-8418-40c6-8bbd-07fd1f2d6130]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:55:42 user nova-compute[73469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)
Aug 22 02:55:42 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:42 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:42 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:55:42 user nova-compute[73469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)
Aug 22 02:55:42 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:42 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:42 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d11590-5041-40ee-86f9-49ad8399fa1f]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aiSKRpOD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.compute.manager [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-0f58efb2-2fd2-42d0-a2db-f7b821677d19 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.compute.manager [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-0f58efb2-2fd2-42d0-a2db-f7b821677d19 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:43 user nova-compute[73469]: WARNING nova.compute.manager [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-0f58efb2-2fd2-42d0-a2db-f7b821677d19 for instance with vm_state building and task_state spawning.
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.compute.manager [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-4f06a837-3e8c-4362-814a-3b9cd8085a05 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.compute.manager [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-4f06a837-3e8c-4362-814a-3b9cd8085a05 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:43 user nova-compute[73469]: WARNING nova.compute.manager [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-4f06a837-3e8c-4362-814a-3b9cd8085a05 for instance with vm_state building and task_state spawning.
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.compute.manager [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-4f06a837-3e8c-4362-814a-3b9cd8085a05 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.compute.manager [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-4f06a837-3e8c-4362-814a-3b9cd8085a05 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:43 user nova-compute[73469]: WARNING nova.compute.manager [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-4f06a837-3e8c-4362-814a-3b9cd8085a05 for instance with vm_state building and task_state spawning.
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.compute.manager [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-45e4812b-ca27-47b3-b289-63089cb11e00 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.compute.manager [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-45e4812b-ca27-47b3-b289-63089cb11e00 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:43 user nova-compute[73469]: WARNING nova.compute.manager [req-bf13b2aa-1f43-4062-8004-0907872fadb3 req-39773210-d682-488a-be22-77910b87f997 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-45e4812b-ca27-47b3-b289-63089cb11e00 for instance with vm_state building and task_state spawning.
Aug 22 02:55:43 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '26562393634383138', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] [instance: f478387d-e004-4314-961d-abf4a910e970] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562393634383138', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Lazy-loading 'flavor' on Instance uuid f478387d-e004-4314-961d-abf4a910e970 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672943.8946176, 28e78814-0990-49e4-a6e7-e209276d2e46 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:55:43 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] VM Resumed (Lifecycle Event)
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.network.neutron [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Successfully updated port: ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:55:43 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Instance spawned successfully.
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "refresh_cache-8242cec1-3b35-4d14-9e0b-db8a7e75697d" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquired lock "refresh_cache-8242cec1-3b35-4d14-9e0b-db8a7e75697d" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.network.neutron [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:55:43 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672943.8986564, 28e78814-0990-49e4-a6e7-e209276d2e46 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:55:43 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] VM Started (Lifecycle Event)
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:55:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:55:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:55:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:55:44 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:55:44 user nova-compute[73469]: DEBUG nova.network.neutron [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:55:44 user nova-compute[73469]: INFO nova.compute.manager [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Took 13.33 seconds to spawn the instance on the hypervisor.
Aug 22 02:55:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:55:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:55:44 user nova-compute[73469]: INFO nova.compute.manager [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Took 75.33 seconds to build instance.
Aug 22 02:55:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ee986b9-7f00-45a5-836d-b335af8f6570 tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "28e78814-0990-49e4-a6e7-e209276d2e46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 75.436s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:44 user nova-compute[73469]: DEBUG nova.network.neutron [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Updating instance_info_cache with network_info: [{"id": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "address": "fa:16:3e:4f:6e:44", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec640a77-a1", "ovs_interfaceid": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:55:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Releasing lock "refresh_cache-8242cec1-3b35-4d14-9e0b-db8a7e75697d" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:55:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Instance network_info: |[{"id": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "address": "fa:16:3e:4f:6e:44", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec640a77-a1", "ovs_interfaceid": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:55:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] COPY block job progress, current cursor: 139460608 final cursor: 1073741824 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] COPY block job progress, current cursor: 257949696 final cursor: 1073741824 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-45e4812b-ca27-47b3-b289-63089cb11e00 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-45e4812b-ca27-47b3-b289-63089cb11e00 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:45 user nova-compute[73469]: WARNING nova.compute.manager [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-45e4812b-ca27-47b3-b289-63089cb11e00 for instance with vm_state active and task_state None.
Aug 22 02:55:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-cbc301cc-bb85-4871-b3bf-d4dfc54c99ba {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-cbc301cc-bb85-4871-b3bf-d4dfc54c99ba {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:45 user nova-compute[73469]: WARNING nova.compute.manager [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-cbc301cc-bb85-4871-b3bf-d4dfc54c99ba for instance with vm_state active and task_state None.
Aug 22 02:55:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received event network-changed-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Refreshing instance network info cache due to event network-changed-ec640a77-a18c-41a2-aa5e-3eadf60f5e34. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] Acquiring lock "refresh_cache-8242cec1-3b35-4d14-9e0b-db8a7e75697d" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] Acquired lock "refresh_cache-8242cec1-3b35-4d14-9e0b-db8a7e75697d" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG nova.network.neutron [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Refreshing network info cache for port ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] COPY block job progress, current cursor: 433061888 final cursor: 1073741824 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG nova.network.neutron [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Updated VIF entry in instance network info cache for port ec640a77-a18c-41a2-aa5e-3eadf60f5e34. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG nova.network.neutron [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Updating instance_info_cache with network_info: [{"id": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "address": "fa:16:3e:4f:6e:44", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec640a77-a1", "ovs_interfaceid": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG os_brick.utils [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] Releasing lock "refresh_cache-8242cec1-3b35-4d14-9e0b-db8a7e75697d" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-cbc301cc-bb85-4871-b3bf-d4dfc54c99ba {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-cbc301cc-bb85-4871-b3bf-d4dfc54c99ba {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:45 user nova-compute[73469]: WARNING nova.compute.manager [req-f53d2934-764e-47f8-9ccb-bfc833096ffa req-9b665c5d-5c97-42fb-8cec-faf5495034cc service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-cbc301cc-bb85-4871-b3bf-d4dfc54c99ba for instance with vm_state active and task_state None.
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[81394ed5-a549-4636-baf5-bfdac8d2c5a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d646f654-cdbf-4e6d-9f68-690748ecf360]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6951bcc-3aaa-4e27-bc9c-a441904f518f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f55c5d-e6df-4ce1-8a12-8c78741abb9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:55:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 02:55:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:55:46 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 02:55:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6a5fbd-a894-42c1-bbbf-89a8b02111c1]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 02:55:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 02:55:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 02:55:46 user nova-compute[73469]: DEBUG os_brick.utils [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:46 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Updating existing volume attachment record: 6dd5e17c-9da2-4b74-95df-533931b546e0 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 02:55:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] COPY block job progress, current cursor: 589299712 final cursor: 1073741824 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:55:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] COPY block job progress, current cursor: 732954624 final cursor: 1073741824 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:55:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] COPY block job progress, current cursor: 896532480 final cursor: 1073741824 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:55:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] COPY block job progress, current cursor: 1056964608 final cursor: 1073741824 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] [instance: f478387d-e004-4314-961d-abf4a910e970] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFIKOAiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:48 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dfe5f0-86b6-41d2-8893-85934a4b50a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3300036f-25d5-47cd-a06f-1e55d99bfdb5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:55:48 user nova-compute[73469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)
Aug 22 02:55:48 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:48 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:48 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:48 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:55:48 user nova-compute[73469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)
Aug 22 02:55:48 user nova-compute[73469]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:55:48 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:48 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:48 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a413c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91'): ({'sdc'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Removing single pathed devices sdc {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4889aaa2-3a31-4f85-becd-15d3ee2d1574]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[956cc586-762c-4c29-8a5e-0cdb4bddeb3d]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Flushing IO for device /dev/sdc {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[299b55e9-5bd1-4da5-9a2d-6470d4e118a2]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4327e1d-aaa3-435b-ab34-2eed5587af35]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[820361c2-b67b-4b45-a321-94a2250019ee]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG nova.compute.manager [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Preparing to wait for external event volume-reimaged-6d2463b5-2a45-4447-b1d6-2753a728a0b4 {{(pid=73469) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Acquiring lock "71874297-5bc8-4816-b99e-58661ec38500-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dc3118-996f-4551-ae22-d6bbd543a44d]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91, portal: 172.16.0.220,3260]
Aug 22 02:55:48 user nova-compute[73469]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91, portal: 172.16.0.220,3260] successful.
Aug 22 02:55:48 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dff097-d5b3-4f13-8c05-a00aa807c295]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] <== disconnect_volume: return (347ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] [instance: f478387d-e004-4314-961d-abf4a910e970] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aiSKRpOD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f478387d-e004-4314-961d-abf4a910e970', 'attached_at': '', 'detached_at': '', 'volume_id': '27390dcd-4591-49a9-96ef-7f40e3b19735', 'serial'} {{(pid=73469) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 22 02:55:48 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] [instance: f478387d-e004-4314-961d-abf4a910e970] swap_volume: removing Cinder connection for volume c7d8979b-2a2d-463f-aef3-fdbf638abe91 {{(pid=73469) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 22 02:55:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] [instance: f478387d-e004-4314-961d-abf4a910e970] swap_volume: Updating volume c7d8979b-2a2d-463f-aef3-fdbf638abe91 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "aiSKRpOD", "auth_password": "qn4EPNRxl0k6M7", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "27390dcd-4591-49a9-96ef-7f40e3b19735"}, "status": "reserved", "instance": "f478387d-e004-4314-961d-abf4a910e970", "attached_at": "", "detached_at": "", "volume_id": "27390dcd-4591-49a9-96ef-7f40e3b19735", "serial": "27390dcd-4591-49a9-96ef-7f40e3b19735"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '27390dcd-4591-49a9-96ef-7f40e3b19735', 'no_device': None, 'attachment_id': '21fbb75c-846c-44c5-985a-7a3214593440'} {{(pid=73469) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 22 02:55:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ce0ebbcc-eacb-4f14-a953-41b6c00b8929 tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Lock "f478387d-e004-4314-961d-abf4a910e970" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 21.418s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquiring lock "82db3ec6-ab80-406e-84b2-2714a01a94dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "82db3ec6-ab80-406e-84b2-2714a01a94dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquiring lock "82db3ec6-ab80-406e-84b2-2714a01a94dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "82db3ec6-ab80-406e-84b2-2714a01a94dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "82db3ec6-ab80-406e-84b2-2714a01a94dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:50 user nova-compute[73469]: INFO nova.compute.manager [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Terminating instance
Aug 22 02:55:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Acquiring lock "f478387d-e004-4314-961d-abf4a910e970" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Lock "f478387d-e004-4314-961d-abf4a910e970" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG os_brick.utils [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31c27da-f75d-404c-a8ca-0a0414254979]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG nova.compute.manager [req-bd717c15-ca85-4d47-8aad-34ecdde35611 req-49569ba3-bc72-4c65-8909-c5be8d9a30a7 service nova] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Received event network-vif-unplugged-43ab40fd-017d-404c-9456-06880b203b05 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bd717c15-ca85-4d47-8aad-34ecdde35611 req-49569ba3-bc72-4c65-8909-c5be8d9a30a7 service nova] Acquiring lock "82db3ec6-ab80-406e-84b2-2714a01a94dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bd717c15-ca85-4d47-8aad-34ecdde35611 req-49569ba3-bc72-4c65-8909-c5be8d9a30a7 service nova] Lock "82db3ec6-ab80-406e-84b2-2714a01a94dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bd717c15-ca85-4d47-8aad-34ecdde35611 req-49569ba3-bc72-4c65-8909-c5be8d9a30a7 service nova] Lock "82db3ec6-ab80-406e-84b2-2714a01a94dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG nova.compute.manager [req-bd717c15-ca85-4d47-8aad-34ecdde35611 req-49569ba3-bc72-4c65-8909-c5be8d9a30a7 service nova] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] No waiting events found dispatching network-vif-unplugged-43ab40fd-017d-404c-9456-06880b203b05 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG nova.compute.manager [req-bd717c15-ca85-4d47-8aad-34ecdde35611 req-49569ba3-bc72-4c65-8909-c5be8d9a30a7 service nova] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Received event network-vif-unplugged-43ab40fd-017d-404c-9456-06880b203b05 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ab01a7-a679-4464-b5f8-d7a25b7d66f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dce3da9-44c5-4117-a6fc-9c45ca617e84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[22053a56-5c03-4908-bf59-f4d3e311cd0c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:55:51 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a855af21-e7c2-4ab1-9f52-028f1b00f1d0]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG os_brick.utils [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:55:51 user nova-compute[73469]: INFO nova.compute.manager [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] [instance: f478387d-e004-4314-961d-abf4a910e970] Swapping volume 27390dcd-4591-49a9-96ef-7f40e3b19735 for c7d8979b-2a2d-463f-aef3-fdbf638abe91
Aug 22 02:55:51 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Instance destroyed successfully.
Aug 22 02:55:51 user nova-compute[73469]: DEBUG nova.objects.instance [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lazy-loading 'resources' on Instance uuid 82db3ec6-ab80-406e-84b2-2714a01a94dc {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-368665247',display_name='tempest-VolumesActionsTest-instance-368665247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-368665247',id=10,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:54:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fd1fcacf5614d0782d38743f0f336e0',ramdisk_id='',reservation_id='r-pccb681l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1793267254',owner_user_name='tempest-VolumesActionsTest-1793267254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:54:07Z,user_data=None,user_id='7747694d4132438b9d794cb59907a328',uuid=82db3ec6-ab80-406e-84b2-2714a01a94dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43ab40fd-017d-404c-9456-06880b203b05", "address": "fa:16:3e:c5:48:09", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ab40fd-01", "ovs_interfaceid": "43ab40fd-017d-404c-9456-06880b203b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Converting VIF {"id": "43ab40fd-017d-404c-9456-06880b203b05", "address": "fa:16:3e:c5:48:09", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ab40fd-01", "ovs_interfaceid": "43ab40fd-017d-404c-9456-06880b203b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:48:09,bridge_name='br-int',has_traffic_filtering=True,id=43ab40fd-017d-404c-9456-06880b203b05,network=Network(843ceaba-5a3c-4324-bb33-81a695f19d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ab40fd-01') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG os_vif [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:48:09,bridge_name='br-int',has_traffic_filtering=True,id=43ab40fd-017d-404c-9456-06880b203b05,network=Network(843ceaba-5a3c-4324-bb33-81a695f19d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ab40fd-01') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43ab40fd-01, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:51 user nova-compute[73469]: INFO os_vif [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:48:09,bridge_name='br-int',has_traffic_filtering=True,id=43ab40fd-017d-404c-9456-06880b203b05,network=Network(843ceaba-5a3c-4324-bb33-81a695f19d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ab40fd-01')
Aug 22 02:55:51 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Deleting instance files /opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc_del
Aug 22 02:55:51 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Deletion of /opt/stack/data/nova/instances/82db3ec6-ab80-406e-84b2-2714a01a94dc_del complete
Aug 22 02:55:51 user nova-compute[73469]: INFO nova.compute.manager [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 22 02:55:51 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 02:55:51 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 02:55:52 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692672937.291192, f988e66c-6bd1-49bb-ac43-140008f7c995 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:55:52 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] VM Stopped (Lifecycle Event)
Aug 22 02:55:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:52 user nova-compute[73469]: DEBUG nova.compute.manager [None req-543ef492-8af3-42dd-b51a-b0752ff09b6b None None] [instance: f988e66c-6bd1-49bb-ac43-140008f7c995] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:55:52 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:55:52 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Took 0.49 seconds to deallocate network for instance.
Aug 22 02:55:52 user nova-compute[73469]: DEBUG nova.compute.manager [req-a7fb797d-ce6c-40c9-ae6f-a8f58a5e18ac req-8e626794-c8aa-4027-9c10-25be936e64e0 service nova] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Received event network-vif-deleted-43ab40fd-017d-404c-9456-06880b203b05 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:52 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:55:52 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:55:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:52 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Deleted allocations for instance 82db3ec6-ab80-406e-84b2-2714a01a94dc
Aug 22 02:55:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2a030180-cf08-4d1b-8cd5-e6e3226b40eb tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "82db3ec6-ab80-406e-84b2-2714a01a94dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.996s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:53 user nova-compute[73469]: DEBUG nova.compute.manager [req-c6b44f0e-afbc-46b9-98ff-825ebede512a req-1605c74b-33b8-4771-ad62-88dd395ed829 service nova] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Received event network-vif-plugged-43ab40fd-017d-404c-9456-06880b203b05 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:55:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c6b44f0e-afbc-46b9-98ff-825ebede512a req-1605c74b-33b8-4771-ad62-88dd395ed829 service nova] Acquiring lock "82db3ec6-ab80-406e-84b2-2714a01a94dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c6b44f0e-afbc-46b9-98ff-825ebede512a req-1605c74b-33b8-4771-ad62-88dd395ed829 service nova] Lock "82db3ec6-ab80-406e-84b2-2714a01a94dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c6b44f0e-afbc-46b9-98ff-825ebede512a req-1605c74b-33b8-4771-ad62-88dd395ed829 service nova] Lock "82db3ec6-ab80-406e-84b2-2714a01a94dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:53 user nova-compute[73469]: DEBUG nova.compute.manager [req-c6b44f0e-afbc-46b9-98ff-825ebede512a req-1605c74b-33b8-4771-ad62-88dd395ed829 service nova] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] No waiting events found dispatching network-vif-plugged-43ab40fd-017d-404c-9456-06880b203b05 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:55:53 user nova-compute[73469]: WARNING nova.compute.manager [req-c6b44f0e-afbc-46b9-98ff-825ebede512a req-1605c74b-33b8-4771-ad62-88dd395ed829 service nova] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Received unexpected event network-vif-plugged-43ab40fd-017d-404c-9456-06880b203b05 for instance with vm_state deleted and task_state None.
Aug 22 02:55:55 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692672940.1973715, 71874297-5bc8-4816-b99e-58661ec38500 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:55:55 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 71874297-5bc8-4816-b99e-58661ec38500] VM Stopped (Lifecycle Event)
Aug 22 02:55:55 user nova-compute[73469]: DEBUG nova.compute.manager [None req-d34e0004-7963-4a4b-aacf-a88d26b38316 None None] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:55:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.compute.manager [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:55:59 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Creating image(s)
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Did not create local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Ensure instance console log exists: /opt/stack/data/nova/instances/8242cec1-3b35-4d14-9e0b-db8a7e75697d/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Start _get_guest_xml network_info=[{"id": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "address": "fa:16:3e:4f:6e:44", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec640a77-a1", "ovs_interfaceid": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '6dd5e17c-9da2-4b74-95df-533931b546e0', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLtMIbzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8242cec1-3b35-4d14-9e0b-db8a7e75697d', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb3d151e-571e-44c9-b33f-3d8b146c0461', 'serial': 'fb3d151e-571e-44c9-b33f-3d8b146c0461'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:55:59 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:55:59 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLtMIbzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:55:59 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:59 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:55:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:55:59 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[084e4825-7a59-40a3-85d4-caf9dd2baeb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 02:55:59 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[908634e8-b330-41c9-b5d3-1e8ab9fb73d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461] added
Aug 22 02:55:59 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.085s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87e9628-3f94-4461-a582-a26e7e916fd5]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[435c6d99-51fc-40f3-a14c-0a32211146b1]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZLtMIbzR {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZLtMIbzR" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f002d534-2fbe-48d6-b3ee-9bd29e0d3924]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZLtMIbzR'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[76aa6dfa-d6bc-46fc-8ebc-ea0bae5c4fd4]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[59945c59-4560-422a-9538-e89820f40f75]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:55:59 user nova-compute[73469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)
Aug 22 02:55:59 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:59 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:59 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:55:59 user nova-compute[73469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)
Aug 22 02:55:59 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:55:59 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:55:59 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2525c183-1dee-4154-8780-951decd25801]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461, portal: 172.16.0.220,3260]
Aug 22 02:55:59 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461, portal: 172.16.0.220,3260] successful.
Aug 22 02:55:59 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7971ea21-1002-43dd-ac64-d5e080fe5309]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:55:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa3bacd-c7dd-478b-8bc4-cfcc6cd8d84f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:56:00 user nova-compute[73469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)
Aug 22 02:56:00 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:56:00 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:56:00 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:56:00 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:56:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:56:00 user nova-compute[73469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)
Aug 22 02:56:00 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:56:00 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:56:00 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:56:00 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:56:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:56:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 02:56:00 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 02:56:00 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 02:56:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6c8838-687d-4a39-8778-e3a8922cd22e]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:00 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:56:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLtMIbzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '26436386563333632', 'path': '/dev/sdc'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436386563333632', 'path': '/dev/sdc'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:55:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1769101267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1769101267',id=13,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9131cb883044191931dc31e51e94766',ramdisk_id='',reservation_id='r-d7zk2v2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568629509',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:55:40Z,user_data=None,user_id='a7b228f99c9e4d058e128a5a99636b7b',uuid=8242cec1-3b35-4d14-9e0b-db8a7e75697d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "address": "fa:16:3e:4f:6e:44", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec640a77-a1", "ovs_interfaceid": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converting VIF {"id": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "address": "fa:16:3e:4f:6e:44", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec640a77-a1", "ovs_interfaceid": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=ec640a77-a18c-41a2-aa5e-3eadf60f5e34,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec640a77-a1') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG nova.objects.instance [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'pci_devices' on Instance uuid 8242cec1-3b35-4d14-9e0b-db8a7e75697d {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:56:01 user nova-compute[73469]:   <uuid>8242cec1-3b35-4d14-9e0b-db8a7e75697d</uuid>
Aug 22 02:56:01 user nova-compute[73469]:   <name>instance-0000000d</name>
Aug 22 02:56:01 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:56:01 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:56:01 user nova-compute[73469]:   <metadata>
Aug 22 02:56:01 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:56:01 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:56:01 user nova-compute[73469]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1769101267</nova:name>
Aug 22 02:56:01 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:55:59</nova:creationTime>
Aug 22 02:56:01 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:56:01 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:56:01 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:56:01 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:56:01 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:56:01 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:56:01 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:56:01 user nova-compute[73469]:       <nova:owner>
Aug 22 02:56:01 user nova-compute[73469]:         <nova:user uuid="a7b228f99c9e4d058e128a5a99636b7b">tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member</nova:user>
Aug 22 02:56:01 user nova-compute[73469]:         <nova:project uuid="c9131cb883044191931dc31e51e94766">tempest-ServerBootFromVolumeStableRescueTest-568629509</nova:project>
Aug 22 02:56:01 user nova-compute[73469]:       </nova:owner>
Aug 22 02:56:01 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:56:01 user nova-compute[73469]:       <nova:ports>
Aug 22 02:56:01 user nova-compute[73469]:         <nova:port uuid="ec640a77-a18c-41a2-aa5e-3eadf60f5e34">
Aug 22 02:56:01 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 22 02:56:01 user nova-compute[73469]:         </nova:port>
Aug 22 02:56:01 user nova-compute[73469]:       </nova:ports>
Aug 22 02:56:01 user nova-compute[73469]:     </nova:instance>
Aug 22 02:56:01 user nova-compute[73469]:   </metadata>
Aug 22 02:56:01 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:56:01 user nova-compute[73469]:     <system>
Aug 22 02:56:01 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:56:01 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:56:01 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:56:01 user nova-compute[73469]:       <entry name="serial">8242cec1-3b35-4d14-9e0b-db8a7e75697d</entry>
Aug 22 02:56:01 user nova-compute[73469]:       <entry name="uuid">8242cec1-3b35-4d14-9e0b-db8a7e75697d</entry>
Aug 22 02:56:01 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:56:01 user nova-compute[73469]:     </system>
Aug 22 02:56:01 user nova-compute[73469]:   </sysinfo>
Aug 22 02:56:01 user nova-compute[73469]:   <os>
Aug 22 02:56:01 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:56:01 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:56:01 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:56:01 user nova-compute[73469]:   </os>
Aug 22 02:56:01 user nova-compute[73469]:   <features>
Aug 22 02:56:01 user nova-compute[73469]:     <acpi/>
Aug 22 02:56:01 user nova-compute[73469]:     <apic/>
Aug 22 02:56:01 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:56:01 user nova-compute[73469]:   </features>
Aug 22 02:56:01 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:56:01 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:56:01 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:56:01 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:56:01 user nova-compute[73469]:   </clock>
Aug 22 02:56:01 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:56:01 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:56:01 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:56:01 user nova-compute[73469]:   </cpu>
Aug 22 02:56:01 user nova-compute[73469]:   <devices>
Aug 22 02:56:01 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 02:56:01 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:56:01 user nova-compute[73469]:       <source dev="/dev/sdc"/>
Aug 22 02:56:01 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:56:01 user nova-compute[73469]:       <serial>fb3d151e-571e-44c9-b33f-3d8b146c0461</serial>
Aug 22 02:56:01 user nova-compute[73469]:     </disk>
Aug 22 02:56:01 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:56:01 user nova-compute[73469]:       <mac address="fa:16:3e:4f:6e:44"/>
Aug 22 02:56:01 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:56:01 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:56:01 user nova-compute[73469]:       <target dev="tapec640a77-a1"/>
Aug 22 02:56:01 user nova-compute[73469]:     </interface>
Aug 22 02:56:01 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:56:01 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/8242cec1-3b35-4d14-9e0b-db8a7e75697d/console.log" append="off"/>
Aug 22 02:56:01 user nova-compute[73469]:     </serial>
Aug 22 02:56:01 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:56:01 user nova-compute[73469]:     <video>
Aug 22 02:56:01 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:56:01 user nova-compute[73469]:     </video>
Aug 22 02:56:01 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:56:01 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:56:01 user nova-compute[73469]:     </rng>
Aug 22 02:56:01 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:56:01 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:56:01 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:56:01 user nova-compute[73469]:     </memballoon>
Aug 22 02:56:01 user nova-compute[73469]:   </devices>
Aug 22 02:56:01 user nova-compute[73469]: </domain>
Aug 22 02:56:01 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:55:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1769101267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1769101267',id=13,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9131cb883044191931dc31e51e94766',ramdisk_id='',reservation_id='r-d7zk2v2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568629509',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:55:40Z,user_data=None,user_id='a7b228f99c9e4d058e128a5a99636b7b',uuid=8242cec1-3b35-4d14-9e0b-db8a7e75697d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "address": "fa:16:3e:4f:6e:44", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec640a77-a1", "ovs_interfaceid": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converting VIF {"id": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "address": "fa:16:3e:4f:6e:44", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec640a77-a1", "ovs_interfaceid": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=ec640a77-a18c-41a2-aa5e-3eadf60f5e34,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec640a77-a1') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG os_vif [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=ec640a77-a18c-41a2-aa5e-3eadf60f5e34,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec640a77-a1') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec640a77-a1, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec640a77-a1, col_values=(('external_ids', {'iface-id': 'ec640a77-a18c-41a2-aa5e-3eadf60f5e34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:6e:44', 'vm-uuid': '8242cec1-3b35-4d14-9e0b-db8a7e75697d'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:01 user nova-compute[73469]: INFO os_vif [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=ec640a77-a18c-41a2-aa5e-3eadf60f5e34,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec640a77-a1')
Aug 22 02:56:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:56:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] No VIF found with MAC fa:16:3e:4f:6e:44, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:56:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:03 user nova-compute[73469]: DEBUG nova.compute.manager [req-1b6bed23-8d89-4cee-a572-7d788e387798 req-80fc4a28-98de-4fd1-b604-770b61c6ea2e service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received event network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:56:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1b6bed23-8d89-4cee-a572-7d788e387798 req-80fc4a28-98de-4fd1-b604-770b61c6ea2e service nova] Acquiring lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1b6bed23-8d89-4cee-a572-7d788e387798 req-80fc4a28-98de-4fd1-b604-770b61c6ea2e service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1b6bed23-8d89-4cee-a572-7d788e387798 req-80fc4a28-98de-4fd1-b604-770b61c6ea2e service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:03 user nova-compute[73469]: DEBUG nova.compute.manager [req-1b6bed23-8d89-4cee-a572-7d788e387798 req-80fc4a28-98de-4fd1-b604-770b61c6ea2e service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] No waiting events found dispatching network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:56:03 user nova-compute[73469]: WARNING nova.compute.manager [req-1b6bed23-8d89-4cee-a572-7d788e387798 req-80fc4a28-98de-4fd1-b604-770b61c6ea2e service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received unexpected event network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 for instance with vm_state building and task_state spawning.
Aug 22 02:56:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] [instance: f478387d-e004-4314-961d-abf4a910e970] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFIKOAiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f478387d-e004-4314-961d-abf4a910e970', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7d8979b-2a2d-463f-aef3-fdbf638abe91', 'serial': 'c7d8979b-2a2d-463f-aef3-fdbf638abe91'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aiSKRpOD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '27390dcd-4591-49a9-96ef-7f40e3b19735'}, 'status': 'reserved', 'instance': 'f478387d-e004-4314-961d-abf4a910e970', 'attached_at': '', 'detached_at': '', 'volume_id': '27390dcd-4591-49a9-96ef-7f40e3b19735', 'serial'} {{(pid=73469) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] [instance: f478387d-e004-4314-961d-abf4a910e970] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFIKOAiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:56:04 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:56:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:56:04 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:56:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:56:04 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 02:56:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9b4ec4-3d1e-4de1-b317-fa431a6efb59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 02:56:04 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eeb29f-ad28-49bd-aff2-9ab7f8cfc45b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91] added
Aug 22 02:56:04 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71dd9c2-3619-46a5-bdcd-8eb9f001698d]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a977740-b518-403f-89b7-08202b80eaef]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VFIKOAiN {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VFIKOAiN" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d0c267-73b8-4099-b77e-c84685ff0b4a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VFIKOAiN'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd31421b-2e58-4106-8aef-e0588c5a41e5]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f102a82-4414-4474-9a3b-6e8c22ad1c2e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb1660d-6bea-4a46-bc89-81e85da05a4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91, portal: 172.16.0.220,3260]
Aug 22 02:56:05 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91, portal: 172.16.0.220,3260] successful.
Aug 22 02:56:05 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eca721d-8e40-4bc9-be31-99941bda688e]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.compute.manager [req-a430845d-bf73-4103-bf2c-9b9badd036d2 req-85abdb9c-285f-4a67-821c-e1f236ea60fb service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received event network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a430845d-bf73-4103-bf2c-9b9badd036d2 req-85abdb9c-285f-4a67-821c-e1f236ea60fb service nova] Acquiring lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a430845d-bf73-4103-bf2c-9b9badd036d2 req-85abdb9c-285f-4a67-821c-e1f236ea60fb service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a430845d-bf73-4103-bf2c-9b9badd036d2 req-85abdb9c-285f-4a67-821c-e1f236ea60fb service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.compute.manager [req-a430845d-bf73-4103-bf2c-9b9badd036d2 req-85abdb9c-285f-4a67-821c-e1f236ea60fb service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] No waiting events found dispatching network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:56:05 user nova-compute[73469]: WARNING nova.compute.manager [req-a430845d-bf73-4103-bf2c-9b9badd036d2 req-85abdb9c-285f-4a67-821c-e1f236ea60fb service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received unexpected event network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 for instance with vm_state building and task_state spawning.
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.compute.manager [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[013f6534-c5d5-48d9-8a74-dc45b03f994d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:56:05 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] HCTL ('38', '-', '-', 0) found on session 13 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ec8c1c-9d08-4b0e-b23a-b0d36b8d6efe]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Searching for a device in session 13 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFIKOAiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672965.2682412, 8242cec1-3b35-4d14-9e0b-db8a7e75697d => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:56:05 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] VM Resumed (Lifecycle Event)
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.compute.manager [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:56:05 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Instance spawned successfully.
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:05 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672965.2724018, 8242cec1-3b35-4d14-9e0b-db8a7e75697d => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:56:05 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] VM Started (Lifecycle Event)
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:56:05 user nova-compute[73469]: INFO nova.compute.claims [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Claim successful on node user
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:56:05 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:56:05 user nova-compute[73469]: INFO nova.compute.manager [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Took 5.90 seconds to spawn the instance on the hypervisor.
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.compute.manager [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:56:05 user nova-compute[73469]: INFO nova.compute.manager [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Took 26.75 seconds to build instance.
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-319c8cea-b0f8-4399-8b70-acf145be2360 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.077s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:05 user nova-compute[73469]: DEBUG nova.compute.manager [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG nova.network.neutron [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:56:06 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 02:56:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG nova.policy [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd0825598415407d98df7353ed5f08c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39885655a2984da4b2ec082427384bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:56:06 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Creating image(s)
Aug 22 02:56:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "/opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "/opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23439343036653663', 'path': '/dev/sdg'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] [instance: f478387d-e004-4314-961d-abf4a910e970] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439343036653663', 'path': '/dev/sdg'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG nova.objects.instance [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Lazy-loading 'flavor' on Instance uuid f478387d-e004-4314-961d-abf4a910e970 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.192s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.196s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/disk 1073741824" returned: 0 in 0.113s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692672951.7294874, 82db3ec6-ab80-406e-84b2-2714a01a94dc => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:56:06 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] VM Stopped (Lifecycle Event)
Aug 22 02:56:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] COPY block job progress, current cursor: 16777216 final cursor: 1073741824 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:56:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c3f0c05e-2fea-4426-ba2d-e1aa5ebb4b53 None None] [instance: 82db3ec6-ab80-406e-84b2-2714a01a94dc] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:56:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.332s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:07 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 02:56:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:07 user nova-compute[73469]: DEBUG nova.network.neutron [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Successfully created port: 3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:56:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] COPY block job progress, current cursor: 173015040 final cursor: 1073741824 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:56:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:07 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Cannot resize image /opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 02:56:07 user nova-compute[73469]: DEBUG nova.objects.instance [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lazy-loading 'migration_context' on Instance uuid c1671fd3-e0a4-4a9c-9e38-7a595a405377 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:56:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:56:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Ensure instance console log exists: /opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:56:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] COPY block job progress, current cursor: 270532608 final cursor: 1073741824 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:56:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] COPY block job progress, current cursor: 445644800 final cursor: 1073741824 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:56:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:08 user nova-compute[73469]: DEBUG nova.network.neutron [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Successfully updated port: 3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:56:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "refresh_cache-c1671fd3-e0a4-4a9c-9e38-7a595a405377" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:56:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquired lock "refresh_cache-c1671fd3-e0a4-4a9c-9e38-7a595a405377" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:56:08 user nova-compute[73469]: DEBUG nova.network.neutron [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:56:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-82bef48a-5ad6-433e-9e29-ed343210a9ea req-87935d51-d968-4808-b40f-7953a325b9c4 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Received event network-changed-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:56:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-82bef48a-5ad6-433e-9e29-ed343210a9ea req-87935d51-d968-4808-b40f-7953a325b9c4 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Refreshing instance network info cache due to event network-changed-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:56:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-82bef48a-5ad6-433e-9e29-ed343210a9ea req-87935d51-d968-4808-b40f-7953a325b9c4 service nova] Acquiring lock "refresh_cache-c1671fd3-e0a4-4a9c-9e38-7a595a405377" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:56:08 user nova-compute[73469]: DEBUG nova.network.neutron [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:56:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] COPY block job progress, current cursor: 602931200 final cursor: 1073741824 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] COPY block job progress, current cursor: 778043392 final cursor: 1073741824 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.network.neutron [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Updating instance_info_cache with network_info: [{"id": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "address": "fa:16:3e:0e:ce:50", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc3c052-24", "ovs_interfaceid": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Releasing lock "refresh_cache-c1671fd3-e0a4-4a9c-9e38-7a595a405377" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.compute.manager [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Instance network_info: |[{"id": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "address": "fa:16:3e:0e:ce:50", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc3c052-24", "ovs_interfaceid": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-82bef48a-5ad6-433e-9e29-ed343210a9ea req-87935d51-d968-4808-b40f-7953a325b9c4 service nova] Acquired lock "refresh_cache-c1671fd3-e0a4-4a9c-9e38-7a595a405377" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.network.neutron [req-82bef48a-5ad6-433e-9e29-ed343210a9ea req-87935d51-d968-4808-b40f-7953a325b9c4 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Refreshing network info cache for port 3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Start _get_guest_xml network_info=[{"id": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "address": "fa:16:3e:0e:ce:50", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc3c052-24", "ovs_interfaceid": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:56:09 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:56:09 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-922527222',display_name='tempest-VolumesAdminNegativeTest-server-922527222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-922527222',id=14,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39885655a2984da4b2ec082427384bea',ramdisk_id='',reservation_id='r-i01fqrx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1884652392',owner_user_name='tempest-VolumesAdminNegativeTest-1884652392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:56:06Z,user_data=None,user_id='bd0825598415407d98df7353ed5f08c8',uuid=c1671fd3-e0a4-4a9c-9e38-7a595a405377,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "address": "fa:16:3e:0e:ce:50", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc3c052-24", "ovs_interfaceid": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Converting VIF {"id": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "address": "fa:16:3e:0e:ce:50", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc3c052-24", "ovs_interfaceid": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ce:50,bridge_name='br-int',has_traffic_filtering=True,id=3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9,network=Network(b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc3c052-24') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.objects.instance [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lazy-loading 'pci_devices' on Instance uuid c1671fd3-e0a4-4a9c-9e38-7a595a405377 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:56:09 user nova-compute[73469]:   <uuid>c1671fd3-e0a4-4a9c-9e38-7a595a405377</uuid>
Aug 22 02:56:09 user nova-compute[73469]:   <name>instance-0000000e</name>
Aug 22 02:56:09 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:56:09 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:56:09 user nova-compute[73469]:   <metadata>
Aug 22 02:56:09 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:56:09 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:56:09 user nova-compute[73469]:       <nova:name>tempest-VolumesAdminNegativeTest-server-922527222</nova:name>
Aug 22 02:56:09 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:56:09</nova:creationTime>
Aug 22 02:56:09 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:56:09 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:56:09 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:56:09 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:56:09 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:56:09 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:56:09 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:56:09 user nova-compute[73469]:       <nova:owner>
Aug 22 02:56:09 user nova-compute[73469]:         <nova:user uuid="bd0825598415407d98df7353ed5f08c8">tempest-VolumesAdminNegativeTest-1884652392-project-member</nova:user>
Aug 22 02:56:09 user nova-compute[73469]:         <nova:project uuid="39885655a2984da4b2ec082427384bea">tempest-VolumesAdminNegativeTest-1884652392</nova:project>
Aug 22 02:56:09 user nova-compute[73469]:       </nova:owner>
Aug 22 02:56:09 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:56:09 user nova-compute[73469]:       <nova:ports>
Aug 22 02:56:09 user nova-compute[73469]:         <nova:port uuid="3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9">
Aug 22 02:56:09 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 22 02:56:09 user nova-compute[73469]:         </nova:port>
Aug 22 02:56:09 user nova-compute[73469]:       </nova:ports>
Aug 22 02:56:09 user nova-compute[73469]:     </nova:instance>
Aug 22 02:56:09 user nova-compute[73469]:   </metadata>
Aug 22 02:56:09 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:56:09 user nova-compute[73469]:     <system>
Aug 22 02:56:09 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:56:09 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:56:09 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:56:09 user nova-compute[73469]:       <entry name="serial">c1671fd3-e0a4-4a9c-9e38-7a595a405377</entry>
Aug 22 02:56:09 user nova-compute[73469]:       <entry name="uuid">c1671fd3-e0a4-4a9c-9e38-7a595a405377</entry>
Aug 22 02:56:09 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:56:09 user nova-compute[73469]:     </system>
Aug 22 02:56:09 user nova-compute[73469]:   </sysinfo>
Aug 22 02:56:09 user nova-compute[73469]:   <os>
Aug 22 02:56:09 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:56:09 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:56:09 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:56:09 user nova-compute[73469]:   </os>
Aug 22 02:56:09 user nova-compute[73469]:   <features>
Aug 22 02:56:09 user nova-compute[73469]:     <acpi/>
Aug 22 02:56:09 user nova-compute[73469]:     <apic/>
Aug 22 02:56:09 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:56:09 user nova-compute[73469]:   </features>
Aug 22 02:56:09 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:56:09 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:56:09 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:56:09 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:56:09 user nova-compute[73469]:   </clock>
Aug 22 02:56:09 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:56:09 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:56:09 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:56:09 user nova-compute[73469]:   </cpu>
Aug 22 02:56:09 user nova-compute[73469]:   <devices>
Aug 22 02:56:09 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:56:09 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:56:09 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/disk"/>
Aug 22 02:56:09 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:56:09 user nova-compute[73469]:     </disk>
Aug 22 02:56:09 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:56:09 user nova-compute[73469]:       <mac address="fa:16:3e:0e:ce:50"/>
Aug 22 02:56:09 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:56:09 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:56:09 user nova-compute[73469]:       <target dev="tap3cc3c052-24"/>
Aug 22 02:56:09 user nova-compute[73469]:     </interface>
Aug 22 02:56:09 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:56:09 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/console.log" append="off"/>
Aug 22 02:56:09 user nova-compute[73469]:     </serial>
Aug 22 02:56:09 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:56:09 user nova-compute[73469]:     <video>
Aug 22 02:56:09 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:56:09 user nova-compute[73469]:     </video>
Aug 22 02:56:09 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:56:09 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:56:09 user nova-compute[73469]:     </rng>
Aug 22 02:56:09 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:56:09 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:56:09 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:56:09 user nova-compute[73469]:     </memballoon>
Aug 22 02:56:09 user nova-compute[73469]:   </devices>
Aug 22 02:56:09 user nova-compute[73469]: </domain>
Aug 22 02:56:09 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-922527222',display_name='tempest-VolumesAdminNegativeTest-server-922527222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-922527222',id=14,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39885655a2984da4b2ec082427384bea',ramdisk_id='',reservation_id='r-i01fqrx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1884652392',owner_user_name='tempest-VolumesAdminNegativeTest-1884652392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:56:06Z,user_data=None,user_id='bd0825598415407d98df7353ed5f08c8',uuid=c1671fd3-e0a4-4a9c-9e38-7a595a405377,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "address": "fa:16:3e:0e:ce:50", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc3c052-24", "ovs_interfaceid": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Converting VIF {"id": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "address": "fa:16:3e:0e:ce:50", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc3c052-24", "ovs_interfaceid": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ce:50,bridge_name='br-int',has_traffic_filtering=True,id=3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9,network=Network(b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc3c052-24') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG os_vif [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ce:50,bridge_name='br-int',has_traffic_filtering=True,id=3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9,network=Network(b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc3c052-24') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3cc3c052-24, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3cc3c052-24, col_values=(('external_ids', {'iface-id': '3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:ce:50', 'vm-uuid': 'c1671fd3-e0a4-4a9c-9e38-7a595a405377'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:09 user nova-compute[73469]: INFO os_vif [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ce:50,bridge_name='br-int',has_traffic_filtering=True,id=3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9,network=Network(b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc3c052-24')
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] No VIF found with MAC fa:16:3e:0e:ce:50, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:56:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] COPY block job progress, current cursor: 884998144 final cursor: 1073741824 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:56:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] COPY block job progress, current cursor: 1056964608 final cursor: 1073741824 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:56:10 user nova-compute[73469]: DEBUG nova.network.neutron [req-82bef48a-5ad6-433e-9e29-ed343210a9ea req-87935d51-d968-4808-b40f-7953a325b9c4 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Updated VIF entry in instance network info cache for port 3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:56:10 user nova-compute[73469]: DEBUG nova.network.neutron [req-82bef48a-5ad6-433e-9e29-ed343210a9ea req-87935d51-d968-4808-b40f-7953a325b9c4 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Updating instance_info_cache with network_info: [{"id": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "address": "fa:16:3e:0e:ce:50", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc3c052-24", "ovs_interfaceid": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:56:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-82bef48a-5ad6-433e-9e29-ed343210a9ea req-87935d51-d968-4808-b40f-7953a325b9c4 service nova] Releasing lock "refresh_cache-c1671fd3-e0a4-4a9c-9e38-7a595a405377" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:56:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 02:56:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:11 user nova-compute[73469]: DEBUG nova.compute.manager [req-f6541828-9824-4e72-9c63-ce63303e7c0e req-92714459-1a98-48d1-81c9-8e5b9489442d service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Received event network-vif-plugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:56:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f6541828-9824-4e72-9c63-ce63303e7c0e req-92714459-1a98-48d1-81c9-8e5b9489442d service nova] Acquiring lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f6541828-9824-4e72-9c63-ce63303e7c0e req-92714459-1a98-48d1-81c9-8e5b9489442d service nova] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f6541828-9824-4e72-9c63-ce63303e7c0e req-92714459-1a98-48d1-81c9-8e5b9489442d service nova] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:11 user nova-compute[73469]: DEBUG nova.compute.manager [req-f6541828-9824-4e72-9c63-ce63303e7c0e req-92714459-1a98-48d1-81c9-8e5b9489442d service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] No waiting events found dispatching network-vif-plugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:56:11 user nova-compute[73469]: WARNING nova.compute.manager [req-f6541828-9824-4e72-9c63-ce63303e7c0e req-92714459-1a98-48d1-81c9-8e5b9489442d service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Received unexpected event network-vif-plugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 for instance with vm_state building and task_state spawning.
Aug 22 02:56:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672973.4722655, c1671fd3-e0a4-4a9c-9e38-7a595a405377 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:56:13 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] VM Resumed (Lifecycle Event)
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:56:13 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Instance spawned successfully.
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] [instance: f478387d-e004-4314-961d-abf4a910e970] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aiSKRpOD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '27390dcd-4591-49a9-96ef-7f40e3b19735'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:56:13 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:56:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0bb0c4-d31d-4ca2-a1db-43629c3824ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:13 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672973.4736118, c1671fd3-e0a4-4a9c-9e38-7a595a405377 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:56:13 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] VM Started (Lifecycle Event)
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[09927d70-e304-4dc2-b756-966907ba7c22]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:56:13 user nova-compute[73469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)
Aug 22 02:56:13 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:56:13 user nova-compute[73469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:56:13 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:56:13 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:56:13 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:56:13 user nova-compute[73469]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 (non-flash)
Aug 22 02:56:13 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:56:13 user nova-compute[73469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:56:13 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:56:13 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:56:13 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a415cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-67989ef7-71dd-4608-b865-06b79d01be74 req-40c77ad7-29a3-4d80-aa1f-1eb3fc59fc64 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Received event network-vif-plugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-67989ef7-71dd-4608-b865-06b79d01be74 req-40c77ad7-29a3-4d80-aa1f-1eb3fc59fc64 service nova] Acquiring lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-67989ef7-71dd-4608-b865-06b79d01be74 req-40c77ad7-29a3-4d80-aa1f-1eb3fc59fc64 service nova] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-67989ef7-71dd-4608-b865-06b79d01be74 req-40c77ad7-29a3-4d80-aa1f-1eb3fc59fc64 service nova] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-67989ef7-71dd-4608-b865-06b79d01be74 req-40c77ad7-29a3-4d80-aa1f-1eb3fc59fc64 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] No waiting events found dispatching network-vif-plugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:56:13 user nova-compute[73469]: WARNING nova.compute.manager [req-67989ef7-71dd-4608-b865-06b79d01be74 req-40c77ad7-29a3-4d80-aa1f-1eb3fc59fc64 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Received unexpected event network-vif-plugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 for instance with vm_state building and task_state spawning.
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec57e0fc-5bad-4092-91a4-090e8a4b7559]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:13 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:56:13 user nova-compute[73469]: INFO nova.compute.manager [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Took 7.46 seconds to spawn the instance on the hypervisor.
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c6d5d2-009a-4cd0-84c2-ceb7fec8627e]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b416fb1-753f-4584-9472-ff28597cccb5]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e7c12e-0a23-4b99-bf1a-41ae46f59c5d]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c46b338-35c1-413b-92f4-03a16a5fc357]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:13 user nova-compute[73469]: INFO nova.compute.manager [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Took 8.47 seconds to build instance.
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79a01925-3dd1-4a6e-87c4-521f3cd83e1f tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.613s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[622bf96c-7e36-4ce0-921c-31a1a97641a8]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735, portal: 172.16.0.220,3260]
Aug 22 02:56:13 user nova-compute[73469]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735, portal: 172.16.0.220,3260] successful.
Aug 22 02:56:13 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27390dcd-4591-49a9-96ef-7f40e3b19735 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc24e76d-5baf-486a-8315-0a68ba6458bf]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] <== disconnect_volume: return (344ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] [instance: f478387d-e004-4314-961d-abf4a910e970] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFIKOAiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'f478387d-e004-4314-961d-abf4a910e970', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7d8979b-2a2d-463f-aef3-fdbf638abe91', 'serial'} {{(pid=73469) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 22 02:56:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] [instance: f478387d-e004-4314-961d-abf4a910e970] swap_volume: removing Cinder connection for volume 27390dcd-4591-49a9-96ef-7f40e3b19735 {{(pid=73469) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 22 02:56:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Acquiring lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Acquiring lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:14 user nova-compute[73469]: INFO nova.compute.manager [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Terminating instance
Aug 22 02:56:14 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 02:56:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:14 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] [instance: f478387d-e004-4314-961d-abf4a910e970] swap_volume: Updating volume 27390dcd-4591-49a9-96ef-7f40e3b19735 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "VFIKOAiN", "auth_password": "ftHqhMzbkjAWVx", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "c7d8979b-2a2d-463f-aef3-fdbf638abe91"}, "status": "reserved", "instance": "f478387d-e004-4314-961d-abf4a910e970", "attached_at": "", "detached_at": "", "volume_id": "c7d8979b-2a2d-463f-aef3-fdbf638abe91", "serial": "c7d8979b-2a2d-463f-aef3-fdbf638abe91"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c7d8979b-2a2d-463f-aef3-fdbf638abe91', 'no_device': None, 'attachment_id': 'b86cf62c-7be7-4065-81c8-c994df60a89d'} {{(pid=73469) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 22 02:56:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c40290f9-ef1a-491f-b38c-c07fb29d9d5f tempest-TestVolumeSwap-1529470701 tempest-TestVolumeSwap-1529470701-project-admin] Lock "f478387d-e004-4314-961d-abf4a910e970" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 23.704s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Acquiring lock "f478387d-e004-4314-961d-abf4a910e970" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "f478387d-e004-4314-961d-abf4a910e970" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:15 user nova-compute[73469]: INFO nova.compute.manager [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Detaching volume c7d8979b-2a2d-463f-aef3-fdbf638abe91
Aug 22 02:56:15 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Instance destroyed successfully.
Aug 22 02:56:15 user nova-compute[73469]: DEBUG nova.objects.instance [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Lazy-loading 'resources' on Instance uuid e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:56:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1113267848',display_name='tempest-VolumesAssistedSnapshotsTest-server-1113267848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1113267848',id=6,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeH8OxpCrZPtj9pmWfiAyyFneiooHemk/mkvV95vmZjpi+LV5UoZQkmEw+QdaifEhFgT+viLuguggIAnpvaVN01Se10f3LR1T5BwDUrPj24WboY55mMq8pjpUExHE8BsA==',key_name='tempest-keypair-419590459',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:53:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2998d1c629d446cfbf70d34b254ad473',ramdisk_id='',reservation_id='r-l59rr859',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-838523114',owner_user_name='tempest-VolumesAssistedSnapshotsTest-838523114-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:53:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74d31e86d8734f4dab684a5b41c109c3',uuid=e8cc9ae7-e8ec-4407-8f02-4e895ae682b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52040c67-b1ad-4eea-86b2-43143b75acb5", "address": "fa:16:3e:2b:aa:81", "network": {"id": "2731bb0f-0af6-4f92-ad67-294ad45891b7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1587989028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2998d1c629d446cfbf70d34b254ad473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52040c67-b1", "ovs_interfaceid": "52040c67-b1ad-4eea-86b2-43143b75acb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:56:15 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Converting VIF {"id": "52040c67-b1ad-4eea-86b2-43143b75acb5", "address": "fa:16:3e:2b:aa:81", "network": {"id": "2731bb0f-0af6-4f92-ad67-294ad45891b7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1587989028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2998d1c629d446cfbf70d34b254ad473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52040c67-b1", "ovs_interfaceid": "52040c67-b1ad-4eea-86b2-43143b75acb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:56:15 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:aa:81,bridge_name='br-int',has_traffic_filtering=True,id=52040c67-b1ad-4eea-86b2-43143b75acb5,network=Network(2731bb0f-0af6-4f92-ad67-294ad45891b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52040c67-b1') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:56:15 user nova-compute[73469]: DEBUG os_vif [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:aa:81,bridge_name='br-int',has_traffic_filtering=True,id=52040c67-b1ad-4eea-86b2-43143b75acb5,network=Network(2731bb0f-0af6-4f92-ad67-294ad45891b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52040c67-b1') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:56:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52040c67-b1, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:56:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:56:15 user nova-compute[73469]: INFO os_vif [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:aa:81,bridge_name='br-int',has_traffic_filtering=True,id=52040c67-b1ad-4eea-86b2-43143b75acb5,network=Network(2731bb0f-0af6-4f92-ad67-294ad45891b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52040c67-b1')
Aug 22 02:56:15 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Deleting instance files /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4_del
Aug 22 02:56:15 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Deletion of /opt/stack/data/nova/instances/e8cc9ae7-e8ec-4407-8f02-4e895ae682b4_del complete
Aug 22 02:56:15 user nova-compute[73469]: INFO nova.virt.block_device [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Attempting to driver detach volume c7d8979b-2a2d-463f-aef3-fdbf638abe91 from mountpoint /dev/vdb
Aug 22 02:56:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Attempting to detach device vdb from instance f478387d-e004-4314-961d-abf4a910e970 from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 02:56:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 02:56:15 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:56:15 user nova-compute[73469]:   <source dev="/dev/sdg"/>
Aug 22 02:56:15 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 02:56:15 user nova-compute[73469]:   <serial>c7d8979b-2a2d-463f-aef3-fdbf638abe91</serial>
Aug 22 02:56:15 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 02:56:15 user nova-compute[73469]: </disk>
Aug 22 02:56:15 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 02:56:15 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Successfully detached device vdb from instance f478387d-e004-4314-961d-abf4a910e970 from the persistent domain config.
Aug 22 02:56:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f478387d-e004-4314-961d-abf4a910e970 from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 02:56:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 02:56:15 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:56:15 user nova-compute[73469]:   <source dev="/dev/sdg"/>
Aug 22 02:56:15 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 02:56:15 user nova-compute[73469]:   <serial>c7d8979b-2a2d-463f-aef3-fdbf638abe91</serial>
Aug 22 02:56:15 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 02:56:15 user nova-compute[73469]: </disk>
Aug 22 02:56:15 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 02:56:15 user nova-compute[73469]: INFO nova.compute.manager [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 22 02:56:15 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 02:56:15 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 02:56:15 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692672976.037963, f478387d-e004-4314-961d-abf4a910e970 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f478387d-e004-4314-961d-abf4a910e970 {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 02:56:16 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Successfully detached device vdb from instance f478387d-e004-4314-961d-abf4a910e970 from the live domain config.
Aug 22 02:56:16 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFIKOAiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'c7d8979b-2a2d-463f-aef3-fdbf638abe91'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:56:16 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:56:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecf8e32-1c13-46d6-9f3d-89efe69d78b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf89813-fff0-406d-a65d-06ed34591af9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:56:16 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:56:16 user nova-compute[73469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:56:16 user nova-compute[73469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:56:16 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:56:16 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:56:16 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:56:16 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:56:16 user nova-compute[73469]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 (non-flash)
Aug 22 02:56:16 user nova-compute[73469]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:56:16 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:56:16 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:56:16 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a413bd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91'): ({'sdg'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Removing single pathed devices sdg {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[302aea99-4475-45ca-8b83-9aae1d5cbdf4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e389f7-f4dc-47c1-998d-3c192ba12d0c]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Flushing IO for device /dev/sdg {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[989f1229-1950-462a-93cc-fe29755033e4]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ac8957-5c8b-4ebb-91c3-9de335a68980]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] SCSI volumes sdg have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6027a2-e119-4e1b-b7dc-c7d3ce145205]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.186s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3531f8-8c30-4a8b-ac12-e8980b20ea30]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91, portal: 172.16.0.220,3260]
Aug 22 02:56:16 user nova-compute[73469]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91, portal: 172.16.0.220,3260] successful.
Aug 22 02:56:16 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8979b-2a2d-463f-aef3-fdbf638abe91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.486s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d705de-dd48-4f26-abfe-eef8b72184d7]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.907s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] <== disconnect_volume: return (908ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:56:16 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 02:56:17 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:56:17 user nova-compute[73469]: DEBUG nova.compute.manager [req-a98bcc69-c0da-4899-bc24-3bdedaed4caf req-fdce0697-b1f4-4b27-9985-ab0f069498ae service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Received event network-vif-deleted-52040c67-b1ad-4eea-86b2-43143b75acb5 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:56:17 user nova-compute[73469]: INFO nova.compute.manager [req-a98bcc69-c0da-4899-bc24-3bdedaed4caf req-fdce0697-b1f4-4b27-9985-ab0f069498ae service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Neutron deleted interface 52040c67-b1ad-4eea-86b2-43143b75acb5; detaching it from the instance and deleting it from the info cache
Aug 22 02:56:17 user nova-compute[73469]: DEBUG nova.network.neutron [req-a98bcc69-c0da-4899-bc24-3bdedaed4caf req-fdce0697-b1f4-4b27-9985-ab0f069498ae service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:56:17 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Took 1.54 seconds to deallocate network for instance.
Aug 22 02:56:17 user nova-compute[73469]: DEBUG nova.compute.manager [req-a98bcc69-c0da-4899-bc24-3bdedaed4caf req-fdce0697-b1f4-4b27-9985-ab0f069498ae service nova] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Detach interface failed, port_id=52040c67-b1ad-4eea-86b2-43143b75acb5, reason: Instance e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 02:56:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:17 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:56:17 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:56:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:17 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Deleted allocations for instance e8cc9ae7-e8ec-4407-8f02-4e895ae682b4
Aug 22 02:56:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4aef8270-8f6e-4991-93f9-0a2411c8d036 tempest-VolumesAssistedSnapshotsTest-838523114 tempest-VolumesAssistedSnapshotsTest-838523114-project-member] Lock "e8cc9ae7-e8ec-4407-8f02-4e895ae682b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.139s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:18 user nova-compute[73469]: DEBUG nova.objects.instance [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lazy-loading 'flavor' on Instance uuid f478387d-e004-4314-961d-abf4a910e970 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:56:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-08b69a04-b4ea-4725-9ece-2166b5ea3315 tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "f478387d-e004-4314-961d-abf4a910e970" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.778s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 req-7505bb86-c5f8-4b89-aadc-c8f2e056b589 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received event volume-reimaged-6d2463b5-2a45-4447-b1d6-2753a728a0b4 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 req-7505bb86-c5f8-4b89-aadc-c8f2e056b589 service nova] Acquiring lock "71874297-5bc8-4816-b99e-58661ec38500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 req-7505bb86-c5f8-4b89-aadc-c8f2e056b589 service nova] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 req-7505bb86-c5f8-4b89-aadc-c8f2e056b589 service nova] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 req-7505bb86-c5f8-4b89-aadc-c8f2e056b589 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Processing event volume-reimaged-6d2463b5-2a45-4447-b1d6-2753a728a0b4 {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Instance event wait completed in 38 seconds for volume-reimaged {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:56:27 user nova-compute[73469]: INFO nova.virt.block_device [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Booting with volume 6d2463b5-2a45-4447-b1d6-2753a728a0b4 at /dev/vda
Aug 22 02:56:27 user nova-compute[73469]: DEBUG os_brick.utils [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d708ff4-397a-4fb5-adf4-8922ae7b7698]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[707311cd-e9fe-4f4f-8271-9371033992d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bb7ffb-7e7e-480b-a857-b856ee23bc3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b059d68c-75bf-4e23-9b4b-06ee09ae79f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:56:27 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 02:56:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fb2832-cb05-4d74-ba0c-863126f8da68]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG os_brick.utils [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:56:27 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Updating existing volume attachment record: d344b7d4-c0f8-408a-8d3f-1e4f345851d8 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 02:56:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquiring lock "ddef86ef-9510-4010-b34b-68ac6d95652b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:56:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:29 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:56:29 user nova-compute[73469]: INFO nova.compute.claims [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Claim successful on node user
Aug 22 02:56:29 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:56:29 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:56:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:56:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:56:29 user nova-compute[73469]: DEBUG nova.network.neutron [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:56:29 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 02:56:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:56:29 user nova-compute[73469]: DEBUG nova.policy [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '95599bfe510e4edb80093a2a4365503e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4179baa30282429b8bfff7beafb95390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:56:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:56:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:56:29 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Creating image(s)
Aug 22 02:56:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.192s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.208s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk 1073741824" returned: 0 in 0.057s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG nova.network.neutron [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Successfully created port: 0427a59c-aa48-4b73-9579-e91d5e1830b0 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692672975.5019271, e8cc9ae7-e8ec-4407-8f02-4e895ae682b4 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:56:30 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] VM Stopped (Lifecycle Event)
Aug 22 02:56:30 user nova-compute[73469]: DEBUG nova.compute.manager [None req-2093ad9c-81ca-44d2-b447-3c1f501ef9f5 None None] [instance: e8cc9ae7-e8ec-4407-8f02-4e895ae682b4] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.175s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Cannot resize image /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG nova.objects.instance [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lazy-loading 'migration_context' on Instance uuid ddef86ef-9510-4010-b34b-68ac6d95652b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Ensure instance console log exists: /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.network.neutron [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Successfully updated port: 0427a59c-aa48-4b73-9579-e91d5e1830b0 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquiring lock "refresh_cache-ddef86ef-9510-4010-b34b-68ac6d95652b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquired lock "refresh_cache-ddef86ef-9510-4010-b34b-68ac6d95652b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.network.neutron [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.compute.manager [req-b07e192c-b8e6-431a-b66c-6aced48dce8f req-0fc31176-1551-4e3e-8676-a5215ba79379 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received event network-changed-0427a59c-aa48-4b73-9579-e91d5e1830b0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.compute.manager [req-b07e192c-b8e6-431a-b66c-6aced48dce8f req-0fc31176-1551-4e3e-8676-a5215ba79379 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Refreshing instance network info cache due to event network-changed-0427a59c-aa48-4b73-9579-e91d5e1830b0. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b07e192c-b8e6-431a-b66c-6aced48dce8f req-0fc31176-1551-4e3e-8676-a5215ba79379 service nova] Acquiring lock "refresh_cache-ddef86ef-9510-4010-b34b-68ac6d95652b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.network.neutron [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.network.neutron [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Updating instance_info_cache with network_info: [{"id": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "address": "fa:16:3e:7a:e5:d0", "network": {"id": "f787ebbc-4ddc-4671-8a1a-e15d3da6d019", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-677642733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0427a59c-aa", "ovs_interfaceid": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Releasing lock "refresh_cache-ddef86ef-9510-4010-b34b-68ac6d95652b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Instance network_info: |[{"id": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "address": "fa:16:3e:7a:e5:d0", "network": {"id": "f787ebbc-4ddc-4671-8a1a-e15d3da6d019", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-677642733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0427a59c-aa", "ovs_interfaceid": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b07e192c-b8e6-431a-b66c-6aced48dce8f req-0fc31176-1551-4e3e-8676-a5215ba79379 service nova] Acquired lock "refresh_cache-ddef86ef-9510-4010-b34b-68ac6d95652b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.network.neutron [req-b07e192c-b8e6-431a-b66c-6aced48dce8f req-0fc31176-1551-4e3e-8676-a5215ba79379 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Refreshing network info cache for port 0427a59c-aa48-4b73-9579-e91d5e1830b0 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Start _get_guest_xml network_info=[{"id": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "address": "fa:16:3e:7a:e5:d0", "network": {"id": "f787ebbc-4ddc-4671-8a1a-e15d3da6d019", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-677642733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0427a59c-aa", "ovs_interfaceid": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:56:31 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:56:31 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258093798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1258093798',id=15,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQKuMRYunlJu8NopZqi0nqkba6dIOrT/1x7SWN1QBY4cmXStVS07i0EQBQsjpw0PFF97qA9J41BXlNPdvO8dtd6gzmgVzrLwxcMsATaGBS/meCQ+o0tinvjbTrFfRBF+A==',key_name='tempest-keypair-187903951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4179baa30282429b8bfff7beafb95390',ramdisk_id='',reservation_id='r-jfk6r0p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-909833900',owner_user_name='tempest-TaggedAttachmentsTest-909833900-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:56:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95599bfe510e4edb80093a2a4365503e',uuid=ddef86ef-9510-4010-b34b-68ac6d95652b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "address": "fa:16:3e:7a:e5:d0", "network": {"id": "f787ebbc-4ddc-4671-8a1a-e15d3da6d019", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-677642733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0427a59c-aa", "ovs_interfaceid": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Converting VIF {"id": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "address": "fa:16:3e:7a:e5:d0", "network": {"id": "f787ebbc-4ddc-4671-8a1a-e15d3da6d019", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-677642733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0427a59c-aa", "ovs_interfaceid": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e5:d0,bridge_name='br-int',has_traffic_filtering=True,id=0427a59c-aa48-4b73-9579-e91d5e1830b0,network=Network(f787ebbc-4ddc-4671-8a1a-e15d3da6d019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0427a59c-aa') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.objects.instance [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lazy-loading 'pci_devices' on Instance uuid ddef86ef-9510-4010-b34b-68ac6d95652b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:56:31 user nova-compute[73469]:   <uuid>ddef86ef-9510-4010-b34b-68ac6d95652b</uuid>
Aug 22 02:56:31 user nova-compute[73469]:   <name>instance-0000000f</name>
Aug 22 02:56:31 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:56:31 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:56:31 user nova-compute[73469]:   <metadata>
Aug 22 02:56:31 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:56:31 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:56:31 user nova-compute[73469]:       <nova:name>tempest-device-tagging-server-1258093798</nova:name>
Aug 22 02:56:31 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:56:31</nova:creationTime>
Aug 22 02:56:31 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:56:31 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:56:31 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:56:31 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:56:31 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:56:31 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:56:31 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:56:31 user nova-compute[73469]:       <nova:owner>
Aug 22 02:56:31 user nova-compute[73469]:         <nova:user uuid="95599bfe510e4edb80093a2a4365503e">tempest-TaggedAttachmentsTest-909833900-project-member</nova:user>
Aug 22 02:56:31 user nova-compute[73469]:         <nova:project uuid="4179baa30282429b8bfff7beafb95390">tempest-TaggedAttachmentsTest-909833900</nova:project>
Aug 22 02:56:31 user nova-compute[73469]:       </nova:owner>
Aug 22 02:56:31 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:56:31 user nova-compute[73469]:       <nova:ports>
Aug 22 02:56:31 user nova-compute[73469]:         <nova:port uuid="0427a59c-aa48-4b73-9579-e91d5e1830b0">
Aug 22 02:56:31 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 22 02:56:31 user nova-compute[73469]:         </nova:port>
Aug 22 02:56:31 user nova-compute[73469]:       </nova:ports>
Aug 22 02:56:31 user nova-compute[73469]:     </nova:instance>
Aug 22 02:56:31 user nova-compute[73469]:   </metadata>
Aug 22 02:56:31 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:56:31 user nova-compute[73469]:     <system>
Aug 22 02:56:31 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:56:31 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:56:31 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:56:31 user nova-compute[73469]:       <entry name="serial">ddef86ef-9510-4010-b34b-68ac6d95652b</entry>
Aug 22 02:56:31 user nova-compute[73469]:       <entry name="uuid">ddef86ef-9510-4010-b34b-68ac6d95652b</entry>
Aug 22 02:56:31 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:56:31 user nova-compute[73469]:     </system>
Aug 22 02:56:31 user nova-compute[73469]:   </sysinfo>
Aug 22 02:56:31 user nova-compute[73469]:   <os>
Aug 22 02:56:31 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:56:31 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:56:31 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:56:31 user nova-compute[73469]:   </os>
Aug 22 02:56:31 user nova-compute[73469]:   <features>
Aug 22 02:56:31 user nova-compute[73469]:     <acpi/>
Aug 22 02:56:31 user nova-compute[73469]:     <apic/>
Aug 22 02:56:31 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:56:31 user nova-compute[73469]:   </features>
Aug 22 02:56:31 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:56:31 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:56:31 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:56:31 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:56:31 user nova-compute[73469]:   </clock>
Aug 22 02:56:31 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:56:31 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:56:31 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:56:31 user nova-compute[73469]:   </cpu>
Aug 22 02:56:31 user nova-compute[73469]:   <devices>
Aug 22 02:56:31 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:56:31 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:56:31 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk"/>
Aug 22 02:56:31 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:56:31 user nova-compute[73469]:     </disk>
Aug 22 02:56:31 user nova-compute[73469]:     <disk type="file" device="cdrom">
Aug 22 02:56:31 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none"/>
Aug 22 02:56:31 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk.config"/>
Aug 22 02:56:31 user nova-compute[73469]:       <target dev="hda" bus="ide"/>
Aug 22 02:56:31 user nova-compute[73469]:     </disk>
Aug 22 02:56:31 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:56:31 user nova-compute[73469]:       <mac address="fa:16:3e:7a:e5:d0"/>
Aug 22 02:56:31 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:56:31 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:56:31 user nova-compute[73469]:       <target dev="tap0427a59c-aa"/>
Aug 22 02:56:31 user nova-compute[73469]:     </interface>
Aug 22 02:56:31 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:56:31 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/console.log" append="off"/>
Aug 22 02:56:31 user nova-compute[73469]:     </serial>
Aug 22 02:56:31 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:56:31 user nova-compute[73469]:     <video>
Aug 22 02:56:31 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:56:31 user nova-compute[73469]:     </video>
Aug 22 02:56:31 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:56:31 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:56:31 user nova-compute[73469]:     </rng>
Aug 22 02:56:31 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:56:31 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:56:31 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:56:31 user nova-compute[73469]:     </memballoon>
Aug 22 02:56:31 user nova-compute[73469]:   </devices>
Aug 22 02:56:31 user nova-compute[73469]: </domain>
Aug 22 02:56:31 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258093798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1258093798',id=15,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQKuMRYunlJu8NopZqi0nqkba6dIOrT/1x7SWN1QBY4cmXStVS07i0EQBQsjpw0PFF97qA9J41BXlNPdvO8dtd6gzmgVzrLwxcMsATaGBS/meCQ+o0tinvjbTrFfRBF+A==',key_name='tempest-keypair-187903951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4179baa30282429b8bfff7beafb95390',ramdisk_id='',reservation_id='r-jfk6r0p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-909833900',owner_user_name='tempest-TaggedAttachmentsTest-909833900-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:56:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95599bfe510e4edb80093a2a4365503e',uuid=ddef86ef-9510-4010-b34b-68ac6d95652b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "address": "fa:16:3e:7a:e5:d0", "network": {"id": "f787ebbc-4ddc-4671-8a1a-e15d3da6d019", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-677642733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0427a59c-aa", "ovs_interfaceid": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Converting VIF {"id": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "address": "fa:16:3e:7a:e5:d0", "network": {"id": "f787ebbc-4ddc-4671-8a1a-e15d3da6d019", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-677642733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0427a59c-aa", "ovs_interfaceid": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e5:d0,bridge_name='br-int',has_traffic_filtering=True,id=0427a59c-aa48-4b73-9579-e91d5e1830b0,network=Network(f787ebbc-4ddc-4671-8a1a-e15d3da6d019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0427a59c-aa') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG os_vif [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e5:d0,bridge_name='br-int',has_traffic_filtering=True,id=0427a59c-aa48-4b73-9579-e91d5e1830b0,network=Network(f787ebbc-4ddc-4671-8a1a-e15d3da6d019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0427a59c-aa') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0427a59c-aa, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0427a59c-aa, col_values=(('external_ids', {'iface-id': '0427a59c-aa48-4b73-9579-e91d5e1830b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:e5:d0', 'vm-uuid': 'ddef86ef-9510-4010-b34b-68ac6d95652b'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:31 user nova-compute[73469]: INFO os_vif [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e5:d0,bridge_name='br-int',has_traffic_filtering=True,id=0427a59c-aa48-4b73-9579-e91d5e1830b0,network=Network(f787ebbc-4ddc-4671-8a1a-e15d3da6d019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0427a59c-aa')
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] No BDM found with device name hda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] No VIF found with MAC fa:16:3e:7a:e5:d0, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:56:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Using config drive
Aug 22 02:56:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Creating config drive at /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk.config
Aug 22 02:56:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2poq1gwh {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2poq1gwh" returned: 0 in 0.054s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:32 user nova-compute[73469]: DEBUG nova.network.neutron [req-b07e192c-b8e6-431a-b66c-6aced48dce8f req-0fc31176-1551-4e3e-8676-a5215ba79379 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Updated VIF entry in instance network info cache for port 0427a59c-aa48-4b73-9579-e91d5e1830b0. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:56:32 user nova-compute[73469]: DEBUG nova.network.neutron [req-b07e192c-b8e6-431a-b66c-6aced48dce8f req-0fc31176-1551-4e3e-8676-a5215ba79379 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Updating instance_info_cache with network_info: [{"id": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "address": "fa:16:3e:7a:e5:d0", "network": {"id": "f787ebbc-4ddc-4671-8a1a-e15d3da6d019", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-677642733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0427a59c-aa", "ovs_interfaceid": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:56:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b07e192c-b8e6-431a-b66c-6aced48dce8f req-0fc31176-1551-4e3e-8676-a5215ba79379 service nova] Releasing lock "refresh_cache-ddef86ef-9510-4010-b34b-68ac6d95652b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:56:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:32 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:56:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:33 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:56:33 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:56:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:33 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 02:56:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-304ba2c6-918d-4a32-8ab2-a6e101b49566 req-986d7ff6-b578-40cc-afe4-bcbb391ea931 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received event network-vif-plugged-0427a59c-aa48-4b73-9579-e91d5e1830b0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:56:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-304ba2c6-918d-4a32-8ab2-a6e101b49566 req-986d7ff6-b578-40cc-afe4-bcbb391ea931 service nova] Acquiring lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-304ba2c6-918d-4a32-8ab2-a6e101b49566 req-986d7ff6-b578-40cc-afe4-bcbb391ea931 service nova] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-304ba2c6-918d-4a32-8ab2-a6e101b49566 req-986d7ff6-b578-40cc-afe4-bcbb391ea931 service nova] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-304ba2c6-918d-4a32-8ab2-a6e101b49566 req-986d7ff6-b578-40cc-afe4-bcbb391ea931 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] No waiting events found dispatching network-vif-plugged-0427a59c-aa48-4b73-9579-e91d5e1830b0 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:56:33 user nova-compute[73469]: WARNING nova.compute.manager [req-304ba2c6-918d-4a32-8ab2-a6e101b49566 req-986d7ff6-b578-40cc-afe4-bcbb391ea931 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received unexpected event network-vif-plugged-0427a59c-aa48-4b73-9579-e91d5e1830b0 for instance with vm_state building and task_state spawning.
Aug 22 02:56:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672995.7954059, ddef86ef-9510-4010-b34b-68ac6d95652b => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:56:35 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] VM Resumed (Lifecycle Event)
Aug 22 02:56:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-0305afe6-edc5-4801-b6e6-f8cf12ebf3ba req-55f57a54-0173-4cff-9a5d-4aba355c8c9c service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received event network-vif-plugged-0427a59c-aa48-4b73-9579-e91d5e1830b0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0305afe6-edc5-4801-b6e6-f8cf12ebf3ba req-55f57a54-0173-4cff-9a5d-4aba355c8c9c service nova] Acquiring lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0305afe6-edc5-4801-b6e6-f8cf12ebf3ba req-55f57a54-0173-4cff-9a5d-4aba355c8c9c service nova] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0305afe6-edc5-4801-b6e6-f8cf12ebf3ba req-55f57a54-0173-4cff-9a5d-4aba355c8c9c service nova] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-0305afe6-edc5-4801-b6e6-f8cf12ebf3ba req-55f57a54-0173-4cff-9a5d-4aba355c8c9c service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] No waiting events found dispatching network-vif-plugged-0427a59c-aa48-4b73-9579-e91d5e1830b0 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:56:35 user nova-compute[73469]: WARNING nova.compute.manager [req-0305afe6-edc5-4801-b6e6-f8cf12ebf3ba req-55f57a54-0173-4cff-9a5d-4aba355c8c9c service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received unexpected event network-vif-plugged-0427a59c-aa48-4b73-9579-e91d5e1830b0 for instance with vm_state building and task_state spawning.
Aug 22 02:56:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:56:35 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Instance spawned successfully.
Aug 22 02:56:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:56:35 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:56:35 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692672995.813376, ddef86ef-9510-4010-b34b-68ac6d95652b => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:56:35 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] VM Started (Lifecycle Event)
Aug 22 02:56:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:56:35 user nova-compute[73469]: INFO nova.compute.manager [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Took 6.10 seconds to spawn the instance on the hypervisor.
Aug 22 02:56:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:56:35 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:56:36 user nova-compute[73469]: INFO nova.compute.manager [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Took 6.95 seconds to build instance.
Aug 22 02:56:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d6a0b757-950b-4818-ae0b-66a68a0d06ed tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.089s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 02:56:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 02:56:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 02:56:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 02:56:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:38 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:56:38 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:56:38 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=7415MB free_disk=25.52240753173828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 02:56:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:38 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:56:38 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d0668c0-7a49-4857-9b69-541021f18ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:56:38 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance dc3f5545-8ebb-4947-97d0-98a91f67e421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:56:38 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f5fdf305-bf02-4b53-bb0d-83e939ae1acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:56:38 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f478387d-e004-4314-961d-abf4a910e970 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:56:38 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 71874297-5bc8-4816-b99e-58661ec38500 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:56:38 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 28e78814-0990-49e4-a6e7-e209276d2e46 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:56:38 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 3ade8cba-6c34-4457-9ad3-484a604dbdb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:56:38 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8242cec1-3b35-4d14-9e0b-db8a7e75697d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:56:38 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance c1671fd3-e0a4-4a9c-9e38-7a595a405377 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:56:38 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance ddef86ef-9510-4010-b34b-68ac6d95652b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:56:38 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 02:56:38 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.827s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:56:39 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Creating image(s)
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Did not create local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Ensure instance console log exists: /opt/stack/data/nova/instances/71874297-5bc8-4816-b99e-58661ec38500/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Start _get_guest_xml network_info=[{"id": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "address": "fa:16:3e:b0:64:29", "network": {"id": "c0ca9d32-e425-4576-8e7a-007b037ac6e2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-953287001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5e945a8b0f0492c9099049690ada404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa442f21d-ed", "ovs_interfaceid": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'd344b7d4-c0f8-408a-8d3f-1e4f345851d8', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSLPutZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71874297-5bc8-4816-b99e-58661ec38500', 'attached_at': '', 'detached_at': '', 'volume_id': '6d2463b5-2a45-4447-b1d6-2753a728a0b4', 'serial': '6d2463b5-2a45-4447-b1d6-2753a728a0b4'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:56:39 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 22 02:56:39 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.objects.instance [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lazy-loading 'vcpu_model' on Instance uuid 71874297-5bc8-4816-b99e-58661ec38500 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSLPutZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:56:39 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 22 02:56:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:56:39 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 22 02:56:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:56:39 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1f7828-e67b-46f5-8dfc-a203502bc73d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 02:56:39 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e279fb0-37b3-457c-87ee-452005df20aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4] added
Aug 22 02:56:39 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23486f2-b842-496a-ba7b-038736f8c7a3]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb218fc-6445-4281-88a2-28773b5e74f0]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bSLPutZz {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bSLPutZz" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9e7882-0ceb-4e6d-91df-c48b6101d675]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bSLPutZz'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b86537-5535-4de7-9f77-278f6cc74869]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ca4b43-7589-425b-ba0d-29e0c69c73ae]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:56:40 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:56:40 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:56:40 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:56:40 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:56:40 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:56:40 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:56:40 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:56:40 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c8fadd-6daa-4f19-9387-5c91c1cbcabc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4, portal: 172.16.0.220,3260]
Aug 22 02:56:40 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4, portal: 172.16.0.220,3260] successful.
Aug 22 02:56:40 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12429f1-627b-4d3c-9c18-df2f40b60471]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ceded41-4cb1-4480-9562-5de5e11d4aa6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:56:40 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:56:40 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:56:40 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:56:40 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:56:40 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:56:40 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:56:40 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:56:40 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:56:40 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:56:40 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda70a2c-9553-406e-b3ac-a1bdb24e22d0]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSLPutZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-f5fdf305-bf02-4b53-bb0d-83e939ae1acb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-f5fdf305-bf02-4b53-bb0d-83e939ae1acb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:56:40 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23237363730383232', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237363730383232', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-22T02:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1381787490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-377659152',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKdydlpBpfM8iUKDYqmt+T3Vb9ogb25mCf0t5qBVWqYu7okcZIbqswy9cY7EzBR1ehqgAhMx+2jQu1gM1ufIoHEPIBlAoobLh2iMYLXMFczVAufMp/nR4kSWj02M0KlhA==',key_name='tempest-keypair-904786919',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:54:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f5e945a8b0f0492c9099049690ada404',ramdisk_id='',reservation_id='r-k6v908aw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-436752772',owner_user_name='tempest-ServerActionsV293TestJSON-436752772-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:56:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5ba5f1c3b147388c043d08d17103c1',uuid=71874297-5bc8-4816-b99e-58661ec38500,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "address": "fa:16:3e:b0:64:29", "network": {"id": "c0ca9d32-e425-4576-8e7a-007b037ac6e2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-953287001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5e945a8b0f0492c9099049690ada404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa442f21d-ed", "ovs_interfaceid": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Converting VIF {"id": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "address": "fa:16:3e:b0:64:29", "network": {"id": "c0ca9d32-e425-4576-8e7a-007b037ac6e2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-953287001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5e945a8b0f0492c9099049690ada404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa442f21d-ed", "ovs_interfaceid": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:64:29,bridge_name='br-int',has_traffic_filtering=True,id=a442f21d-ed03-4b3f-89d7-c5b24175d1f9,network=Network(c0ca9d32-e425-4576-8e7a-007b037ac6e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa442f21d-ed') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:56:41 user nova-compute[73469]:   <uuid>71874297-5bc8-4816-b99e-58661ec38500</uuid>
Aug 22 02:56:41 user nova-compute[73469]:   <name>instance-00000009</name>
Aug 22 02:56:41 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:56:41 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:56:41 user nova-compute[73469]:   <metadata>
Aug 22 02:56:41 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:56:41 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:56:41 user nova-compute[73469]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1381787490</nova:name>
Aug 22 02:56:41 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:56:39</nova:creationTime>
Aug 22 02:56:41 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:56:41 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:56:41 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:56:41 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:56:41 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:56:41 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:56:41 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:56:41 user nova-compute[73469]:       <nova:owner>
Aug 22 02:56:41 user nova-compute[73469]:         <nova:user uuid="cf5ba5f1c3b147388c043d08d17103c1">tempest-ServerActionsV293TestJSON-436752772-project-member</nova:user>
Aug 22 02:56:41 user nova-compute[73469]:         <nova:project uuid="f5e945a8b0f0492c9099049690ada404">tempest-ServerActionsV293TestJSON-436752772</nova:project>
Aug 22 02:56:41 user nova-compute[73469]:       </nova:owner>
Aug 22 02:56:41 user nova-compute[73469]:       <nova:ports>
Aug 22 02:56:41 user nova-compute[73469]:         <nova:port uuid="a442f21d-ed03-4b3f-89d7-c5b24175d1f9">
Aug 22 02:56:41 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 22 02:56:41 user nova-compute[73469]:         </nova:port>
Aug 22 02:56:41 user nova-compute[73469]:       </nova:ports>
Aug 22 02:56:41 user nova-compute[73469]:     </nova:instance>
Aug 22 02:56:41 user nova-compute[73469]:   </metadata>
Aug 22 02:56:41 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:56:41 user nova-compute[73469]:     <system>
Aug 22 02:56:41 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:56:41 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:56:41 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:56:41 user nova-compute[73469]:       <entry name="serial">71874297-5bc8-4816-b99e-58661ec38500</entry>
Aug 22 02:56:41 user nova-compute[73469]:       <entry name="uuid">71874297-5bc8-4816-b99e-58661ec38500</entry>
Aug 22 02:56:41 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:56:41 user nova-compute[73469]:     </system>
Aug 22 02:56:41 user nova-compute[73469]:   </sysinfo>
Aug 22 02:56:41 user nova-compute[73469]:   <os>
Aug 22 02:56:41 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:56:41 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:56:41 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:56:41 user nova-compute[73469]:   </os>
Aug 22 02:56:41 user nova-compute[73469]:   <features>
Aug 22 02:56:41 user nova-compute[73469]:     <acpi/>
Aug 22 02:56:41 user nova-compute[73469]:     <apic/>
Aug 22 02:56:41 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:56:41 user nova-compute[73469]:   </features>
Aug 22 02:56:41 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:56:41 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:56:41 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:56:41 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:56:41 user nova-compute[73469]:   </clock>
Aug 22 02:56:41 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:56:41 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:56:41 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:56:41 user nova-compute[73469]:   </cpu>
Aug 22 02:56:41 user nova-compute[73469]:   <devices>
Aug 22 02:56:41 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 02:56:41 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:56:41 user nova-compute[73469]:       <source dev="/dev/sdb"/>
Aug 22 02:56:41 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:56:41 user nova-compute[73469]:       <serial>6d2463b5-2a45-4447-b1d6-2753a728a0b4</serial>
Aug 22 02:56:41 user nova-compute[73469]:     </disk>
Aug 22 02:56:41 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:56:41 user nova-compute[73469]:       <mac address="fa:16:3e:b0:64:29"/>
Aug 22 02:56:41 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:56:41 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:56:41 user nova-compute[73469]:       <target dev="tapa442f21d-ed"/>
Aug 22 02:56:41 user nova-compute[73469]:     </interface>
Aug 22 02:56:41 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:56:41 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/71874297-5bc8-4816-b99e-58661ec38500/console.log" append="off"/>
Aug 22 02:56:41 user nova-compute[73469]:     </serial>
Aug 22 02:56:41 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:56:41 user nova-compute[73469]:     <video>
Aug 22 02:56:41 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:56:41 user nova-compute[73469]:     </video>
Aug 22 02:56:41 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:56:41 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:56:41 user nova-compute[73469]:     </rng>
Aug 22 02:56:41 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:56:41 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:56:41 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:56:41 user nova-compute[73469]:     </memballoon>
Aug 22 02:56:41 user nova-compute[73469]:   </devices>
Aug 22 02:56:41 user nova-compute[73469]: </domain>
Aug 22 02:56:41 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-22T02:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1381787490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-377659152',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKdydlpBpfM8iUKDYqmt+T3Vb9ogb25mCf0t5qBVWqYu7okcZIbqswy9cY7EzBR1ehqgAhMx+2jQu1gM1ufIoHEPIBlAoobLh2iMYLXMFczVAufMp/nR4kSWj02M0KlhA==',key_name='tempest-keypair-904786919',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:54:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f5e945a8b0f0492c9099049690ada404',ramdisk_id='',reservation_id='r-k6v908aw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-436752772',owner_user_name='tempest-ServerActionsV293TestJSON-436752772-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:56:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5ba5f1c3b147388c043d08d17103c1',uuid=71874297-5bc8-4816-b99e-58661ec38500,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "address": "fa:16:3e:b0:64:29", "network": {"id": "c0ca9d32-e425-4576-8e7a-007b037ac6e2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-953287001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5e945a8b0f0492c9099049690ada404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa442f21d-ed", "ovs_interfaceid": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Converting VIF {"id": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "address": "fa:16:3e:b0:64:29", "network": {"id": "c0ca9d32-e425-4576-8e7a-007b037ac6e2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-953287001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5e945a8b0f0492c9099049690ada404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa442f21d-ed", "ovs_interfaceid": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:64:29,bridge_name='br-int',has_traffic_filtering=True,id=a442f21d-ed03-4b3f-89d7-c5b24175d1f9,network=Network(c0ca9d32-e425-4576-8e7a-007b037ac6e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa442f21d-ed') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG os_vif [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:64:29,bridge_name='br-int',has_traffic_filtering=True,id=a442f21d-ed03-4b3f-89d7-c5b24175d1f9,network=Network(c0ca9d32-e425-4576-8e7a-007b037ac6e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa442f21d-ed') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa442f21d-ed, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa442f21d-ed, col_values=(('external_ids', {'iface-id': 'a442f21d-ed03-4b3f-89d7-c5b24175d1f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:64:29', 'vm-uuid': '71874297-5bc8-4816-b99e-58661ec38500'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:41 user nova-compute[73469]: INFO os_vif [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:64:29,bridge_name='br-int',has_traffic_filtering=True,id=a442f21d-ed03-4b3f-89d7-c5b24175d1f9,network=Network(c0ca9d32-e425-4576-8e7a-007b037ac6e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa442f21d-ed')
Aug 22 02:56:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] No VIF found with MAC fa:16:3e:b0:64:29, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Updating instance_info_cache with network_info: [{"id": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "address": "fa:16:3e:70:a3:62", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dffa70d-3c", "ovs_interfaceid": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-f5fdf305-bf02-4b53-bb0d-83e939ae1acb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:56:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 02:56:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:43 user nova-compute[73469]: DEBUG nova.compute.manager [req-6676fa05-de18-47d0-bba1-077cc8fd0452 req-30a2410a-fc12-4d66-9e32-dbad933c7395 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received event network-vif-plugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:56:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6676fa05-de18-47d0-bba1-077cc8fd0452 req-30a2410a-fc12-4d66-9e32-dbad933c7395 service nova] Acquiring lock "71874297-5bc8-4816-b99e-58661ec38500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6676fa05-de18-47d0-bba1-077cc8fd0452 req-30a2410a-fc12-4d66-9e32-dbad933c7395 service nova] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6676fa05-de18-47d0-bba1-077cc8fd0452 req-30a2410a-fc12-4d66-9e32-dbad933c7395 service nova] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:43 user nova-compute[73469]: DEBUG nova.compute.manager [req-6676fa05-de18-47d0-bba1-077cc8fd0452 req-30a2410a-fc12-4d66-9e32-dbad933c7395 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] No waiting events found dispatching network-vif-plugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:56:43 user nova-compute[73469]: WARNING nova.compute.manager [req-6676fa05-de18-47d0-bba1-077cc8fd0452 req-30a2410a-fc12-4d66-9e32-dbad933c7395 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received unexpected event network-vif-plugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 for instance with vm_state active and task_state rebuild_spawning.
Aug 22 02:56:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquiring lock "56f5786e-f554-479f-93a7-0d4834ce9fce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "56f5786e-f554-479f-93a7-0d4834ce9fce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:43 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:56:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:43 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:56:43 user nova-compute[73469]: INFO nova.compute.claims [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Claim successful on node user
Aug 22 02:56:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:44 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:56:44 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:56:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:56:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:56:44 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:56:44 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 02:56:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:56:44 user nova-compute[73469]: DEBUG nova.policy [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7747694d4132438b9d794cb59907a328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd1fcacf5614d0782d38743f0f336e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:56:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:56:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:56:44 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Creating image(s)
Aug 22 02:56:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquiring lock "/opt/stack/data/nova/instances/56f5786e-f554-479f-93a7-0d4834ce9fce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "/opt/stack/data/nova/instances/56f5786e-f554-479f-93a7-0d4834ce9fce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "/opt/stack/data/nova/instances/56f5786e-f554-479f-93a7-0d4834ce9fce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.209s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.219s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/56f5786e-f554-479f-93a7-0d4834ce9fce/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/56f5786e-f554-479f-93a7-0d4834ce9fce/disk 1073741824" returned: 0 in 0.057s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-bb46706d-8154-49ce-8b70-7cad894c4593 req-a98db4ac-4abb-4d97-a864-551a57a5e2bf service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received event network-vif-plugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bb46706d-8154-49ce-8b70-7cad894c4593 req-a98db4ac-4abb-4d97-a864-551a57a5e2bf service nova] Acquiring lock "71874297-5bc8-4816-b99e-58661ec38500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bb46706d-8154-49ce-8b70-7cad894c4593 req-a98db4ac-4abb-4d97-a864-551a57a5e2bf service nova] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bb46706d-8154-49ce-8b70-7cad894c4593 req-a98db4ac-4abb-4d97-a864-551a57a5e2bf service nova] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-bb46706d-8154-49ce-8b70-7cad894c4593 req-a98db4ac-4abb-4d97-a864-551a57a5e2bf service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] No waiting events found dispatching network-vif-plugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:56:45 user nova-compute[73469]: WARNING nova.compute.manager [req-bb46706d-8154-49ce-8b70-7cad894c4593 req-a98db4ac-4abb-4d97-a864-551a57a5e2bf service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received unexpected event network-vif-plugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 for instance with vm_state active and task_state rebuild_spawning.
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673005.1681626, 71874297-5bc8-4816-b99e-58661ec38500 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:56:45 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 71874297-5bc8-4816-b99e-58661ec38500] VM Resumed (Lifecycle Event)
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.compute.manager [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:56:45 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Instance spawned successfully.
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:45 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 71874297-5bc8-4816-b99e-58661ec38500] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673005.170975, 71874297-5bc8-4816-b99e-58661ec38500 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:56:45 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 71874297-5bc8-4816-b99e-58661ec38500] VM Started (Lifecycle Event)
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Successfully created port: 79905cbd-3475-4c02-aba3-aa94a56a2823 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.207s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56f5786e-f554-479f-93a7-0d4834ce9fce/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f5786e-f554-479f-93a7-0d4834ce9fce/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:45 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 71874297-5bc8-4816-b99e-58661ec38500] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.compute.manager [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.objects.instance [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73469) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f5786e-f554-479f-93a7-0d4834ce9fce/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Cannot resize image /opt/stack/data/nova/instances/56f5786e-f554-479f-93a7-0d4834ce9fce/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.objects.instance [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lazy-loading 'migration_context' on Instance uuid 56f5786e-f554-479f-93a7-0d4834ce9fce {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Ensure instance console log exists: /opt/stack/data/nova/instances/56f5786e-f554-479f-93a7-0d4834ce9fce/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a8c626c3-9bb8-42c3-95f5-dcbd45863530 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.101s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Successfully updated port: 79905cbd-3475-4c02-aba3-aa94a56a2823 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquiring lock "refresh_cache-56f5786e-f554-479f-93a7-0d4834ce9fce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquired lock "refresh_cache-56f5786e-f554-479f-93a7-0d4834ce9fce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.compute.manager [req-ea44c0cd-5256-4675-a5f0-0f8b76d598fa req-fc638b18-8763-4e97-802f-0470741764cc service nova] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Received event network-changed-79905cbd-3475-4c02-aba3-aa94a56a2823 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.compute.manager [req-ea44c0cd-5256-4675-a5f0-0f8b76d598fa req-fc638b18-8763-4e97-802f-0470741764cc service nova] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Refreshing instance network info cache due to event network-changed-79905cbd-3475-4c02-aba3-aa94a56a2823. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ea44c0cd-5256-4675-a5f0-0f8b76d598fa req-fc638b18-8763-4e97-802f-0470741764cc service nova] Acquiring lock "refresh_cache-56f5786e-f554-479f-93a7-0d4834ce9fce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Updating instance_info_cache with network_info: [{"id": "79905cbd-3475-4c02-aba3-aa94a56a2823", "address": "fa:16:3e:83:ff:04", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79905cbd-34", "ovs_interfaceid": "79905cbd-3475-4c02-aba3-aa94a56a2823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Releasing lock "refresh_cache-56f5786e-f554-479f-93a7-0d4834ce9fce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Instance network_info: |[{"id": "79905cbd-3475-4c02-aba3-aa94a56a2823", "address": "fa:16:3e:83:ff:04", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79905cbd-34", "ovs_interfaceid": "79905cbd-3475-4c02-aba3-aa94a56a2823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ea44c0cd-5256-4675-a5f0-0f8b76d598fa req-fc638b18-8763-4e97-802f-0470741764cc service nova] Acquired lock "refresh_cache-56f5786e-f554-479f-93a7-0d4834ce9fce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.network.neutron [req-ea44c0cd-5256-4675-a5f0-0f8b76d598fa req-fc638b18-8763-4e97-802f-0470741764cc service nova] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Refreshing network info cache for port 79905cbd-3475-4c02-aba3-aa94a56a2823 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Start _get_guest_xml network_info=[{"id": "79905cbd-3475-4c02-aba3-aa94a56a2823", "address": "fa:16:3e:83:ff:04", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79905cbd-34", "ovs_interfaceid": "79905cbd-3475-4c02-aba3-aa94a56a2823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:56:46 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:56:46 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:56:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2100391501',display_name='tempest-VolumesActionsTest-instance-2100391501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2100391501',id=16,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fd1fcacf5614d0782d38743f0f336e0',ramdisk_id='',reservation_id='r-bfxfs8yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1793267254',owner_user_name='tempest-VolumesActionsTest-1793267254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:56:45Z,user_data=None,user_id='7747694d4132438b9d794cb59907a328',uuid=56f5786e-f554-479f-93a7-0d4834ce9fce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79905cbd-3475-4c02-aba3-aa94a56a2823", "address": "fa:16:3e:83:ff:04", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79905cbd-34", "ovs_interfaceid": "79905cbd-3475-4c02-aba3-aa94a56a2823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Converting VIF {"id": "79905cbd-3475-4c02-aba3-aa94a56a2823", "address": "fa:16:3e:83:ff:04", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79905cbd-34", "ovs_interfaceid": "79905cbd-3475-4c02-aba3-aa94a56a2823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ff:04,bridge_name='br-int',has_traffic_filtering=True,id=79905cbd-3475-4c02-aba3-aa94a56a2823,network=Network(843ceaba-5a3c-4324-bb33-81a695f19d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79905cbd-34') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.objects.instance [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lazy-loading 'pci_devices' on Instance uuid 56f5786e-f554-479f-93a7-0d4834ce9fce {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:56:46 user nova-compute[73469]:   <uuid>56f5786e-f554-479f-93a7-0d4834ce9fce</uuid>
Aug 22 02:56:46 user nova-compute[73469]:   <name>instance-00000010</name>
Aug 22 02:56:46 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:56:46 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:56:46 user nova-compute[73469]:   <metadata>
Aug 22 02:56:46 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:56:46 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:56:46 user nova-compute[73469]:       <nova:name>tempest-VolumesActionsTest-instance-2100391501</nova:name>
Aug 22 02:56:46 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:56:46</nova:creationTime>
Aug 22 02:56:46 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:56:46 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:56:46 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:56:46 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:56:46 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:56:46 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:56:46 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:56:46 user nova-compute[73469]:       <nova:owner>
Aug 22 02:56:46 user nova-compute[73469]:         <nova:user uuid="7747694d4132438b9d794cb59907a328">tempest-VolumesActionsTest-1793267254-project-member</nova:user>
Aug 22 02:56:46 user nova-compute[73469]:         <nova:project uuid="9fd1fcacf5614d0782d38743f0f336e0">tempest-VolumesActionsTest-1793267254</nova:project>
Aug 22 02:56:46 user nova-compute[73469]:       </nova:owner>
Aug 22 02:56:46 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:56:46 user nova-compute[73469]:       <nova:ports>
Aug 22 02:56:46 user nova-compute[73469]:         <nova:port uuid="79905cbd-3475-4c02-aba3-aa94a56a2823">
Aug 22 02:56:46 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 22 02:56:46 user nova-compute[73469]:         </nova:port>
Aug 22 02:56:46 user nova-compute[73469]:       </nova:ports>
Aug 22 02:56:46 user nova-compute[73469]:     </nova:instance>
Aug 22 02:56:46 user nova-compute[73469]:   </metadata>
Aug 22 02:56:46 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:56:46 user nova-compute[73469]:     <system>
Aug 22 02:56:46 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:56:46 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:56:46 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:56:46 user nova-compute[73469]:       <entry name="serial">56f5786e-f554-479f-93a7-0d4834ce9fce</entry>
Aug 22 02:56:46 user nova-compute[73469]:       <entry name="uuid">56f5786e-f554-479f-93a7-0d4834ce9fce</entry>
Aug 22 02:56:46 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:56:46 user nova-compute[73469]:     </system>
Aug 22 02:56:46 user nova-compute[73469]:   </sysinfo>
Aug 22 02:56:46 user nova-compute[73469]:   <os>
Aug 22 02:56:46 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:56:46 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:56:46 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:56:46 user nova-compute[73469]:   </os>
Aug 22 02:56:46 user nova-compute[73469]:   <features>
Aug 22 02:56:46 user nova-compute[73469]:     <acpi/>
Aug 22 02:56:46 user nova-compute[73469]:     <apic/>
Aug 22 02:56:46 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:56:46 user nova-compute[73469]:   </features>
Aug 22 02:56:46 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:56:46 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:56:46 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:56:46 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:56:46 user nova-compute[73469]:   </clock>
Aug 22 02:56:46 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:56:46 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:56:46 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:56:46 user nova-compute[73469]:   </cpu>
Aug 22 02:56:46 user nova-compute[73469]:   <devices>
Aug 22 02:56:46 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:56:46 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:56:46 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/56f5786e-f554-479f-93a7-0d4834ce9fce/disk"/>
Aug 22 02:56:46 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:56:46 user nova-compute[73469]:     </disk>
Aug 22 02:56:46 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:56:46 user nova-compute[73469]:       <mac address="fa:16:3e:83:ff:04"/>
Aug 22 02:56:46 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:56:46 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:56:46 user nova-compute[73469]:       <target dev="tap79905cbd-34"/>
Aug 22 02:56:46 user nova-compute[73469]:     </interface>
Aug 22 02:56:46 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:56:46 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/56f5786e-f554-479f-93a7-0d4834ce9fce/console.log" append="off"/>
Aug 22 02:56:46 user nova-compute[73469]:     </serial>
Aug 22 02:56:46 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:56:46 user nova-compute[73469]:     <video>
Aug 22 02:56:46 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:56:46 user nova-compute[73469]:     </video>
Aug 22 02:56:46 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:56:46 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:56:46 user nova-compute[73469]:     </rng>
Aug 22 02:56:46 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:56:46 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:56:46 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:56:46 user nova-compute[73469]:     </memballoon>
Aug 22 02:56:46 user nova-compute[73469]:   </devices>
Aug 22 02:56:46 user nova-compute[73469]: </domain>
Aug 22 02:56:46 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:56:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2100391501',display_name='tempest-VolumesActionsTest-instance-2100391501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2100391501',id=16,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fd1fcacf5614d0782d38743f0f336e0',ramdisk_id='',reservation_id='r-bfxfs8yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1793267254',owner_user_name='tempest-VolumesActionsTest-1793267254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:56:45Z,user_data=None,user_id='7747694d4132438b9d794cb59907a328',uuid=56f5786e-f554-479f-93a7-0d4834ce9fce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79905cbd-3475-4c02-aba3-aa94a56a2823", "address": "fa:16:3e:83:ff:04", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79905cbd-34", "ovs_interfaceid": "79905cbd-3475-4c02-aba3-aa94a56a2823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Converting VIF {"id": "79905cbd-3475-4c02-aba3-aa94a56a2823", "address": "fa:16:3e:83:ff:04", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79905cbd-34", "ovs_interfaceid": "79905cbd-3475-4c02-aba3-aa94a56a2823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ff:04,bridge_name='br-int',has_traffic_filtering=True,id=79905cbd-3475-4c02-aba3-aa94a56a2823,network=Network(843ceaba-5a3c-4324-bb33-81a695f19d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79905cbd-34') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG os_vif [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ff:04,bridge_name='br-int',has_traffic_filtering=True,id=79905cbd-3475-4c02-aba3-aa94a56a2823,network=Network(843ceaba-5a3c-4324-bb33-81a695f19d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79905cbd-34') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79905cbd-34, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap79905cbd-34, col_values=(('external_ids', {'iface-id': '79905cbd-3475-4c02-aba3-aa94a56a2823', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:ff:04', 'vm-uuid': '56f5786e-f554-479f-93a7-0d4834ce9fce'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:56:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:46 user nova-compute[73469]: INFO os_vif [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ff:04,bridge_name='br-int',has_traffic_filtering=True,id=79905cbd-3475-4c02-aba3-aa94a56a2823,network=Network(843ceaba-5a3c-4324-bb33-81a695f19d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79905cbd-34')
Aug 22 02:56:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:56:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] No VIF found with MAC fa:16:3e:83:ff:04, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:56:47 user nova-compute[73469]: DEBUG nova.network.neutron [req-ea44c0cd-5256-4675-a5f0-0f8b76d598fa req-fc638b18-8763-4e97-802f-0470741764cc service nova] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Updated VIF entry in instance network info cache for port 79905cbd-3475-4c02-aba3-aa94a56a2823. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:56:47 user nova-compute[73469]: DEBUG nova.network.neutron [req-ea44c0cd-5256-4675-a5f0-0f8b76d598fa req-fc638b18-8763-4e97-802f-0470741764cc service nova] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Updating instance_info_cache with network_info: [{"id": "79905cbd-3475-4c02-aba3-aa94a56a2823", "address": "fa:16:3e:83:ff:04", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79905cbd-34", "ovs_interfaceid": "79905cbd-3475-4c02-aba3-aa94a56a2823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:56:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ea44c0cd-5256-4675-a5f0-0f8b76d598fa req-fc638b18-8763-4e97-802f-0470741764cc service nova] Releasing lock "refresh_cache-56f5786e-f554-479f-93a7-0d4834ce9fce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:56:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:48 user nova-compute[73469]: DEBUG nova.compute.manager [req-9bd5d3f3-ea71-491b-8457-f83fea341af4 req-4e7870d2-9801-4aa7-8279-14c740ff45b7 service nova] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Received event network-vif-plugged-79905cbd-3475-4c02-aba3-aa94a56a2823 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:56:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9bd5d3f3-ea71-491b-8457-f83fea341af4 req-4e7870d2-9801-4aa7-8279-14c740ff45b7 service nova] Acquiring lock "56f5786e-f554-479f-93a7-0d4834ce9fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9bd5d3f3-ea71-491b-8457-f83fea341af4 req-4e7870d2-9801-4aa7-8279-14c740ff45b7 service nova] Lock "56f5786e-f554-479f-93a7-0d4834ce9fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9bd5d3f3-ea71-491b-8457-f83fea341af4 req-4e7870d2-9801-4aa7-8279-14c740ff45b7 service nova] Lock "56f5786e-f554-479f-93a7-0d4834ce9fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:48 user nova-compute[73469]: DEBUG nova.compute.manager [req-9bd5d3f3-ea71-491b-8457-f83fea341af4 req-4e7870d2-9801-4aa7-8279-14c740ff45b7 service nova] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] No waiting events found dispatching network-vif-plugged-79905cbd-3475-4c02-aba3-aa94a56a2823 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:56:48 user nova-compute[73469]: WARNING nova.compute.manager [req-9bd5d3f3-ea71-491b-8457-f83fea341af4 req-4e7870d2-9801-4aa7-8279-14c740ff45b7 service nova] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Received unexpected event network-vif-plugged-79905cbd-3475-4c02-aba3-aa94a56a2823 for instance with vm_state building and task_state spawning.
Aug 22 02:56:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:50 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673010.9200218, 56f5786e-f554-479f-93a7-0d4834ce9fce => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:56:50 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] VM Resumed (Lifecycle Event)
Aug 22 02:56:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:56:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:56:50 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Instance spawned successfully.
Aug 22 02:56:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:56:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:56:50 user nova-compute[73469]: DEBUG nova.compute.manager [req-cd36a924-dde0-4671-9c0c-583ec30465d7 req-cc610494-d182-4324-af81-8ff2b6dc67f2 service nova] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Received event network-vif-plugged-79905cbd-3475-4c02-aba3-aa94a56a2823 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:56:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cd36a924-dde0-4671-9c0c-583ec30465d7 req-cc610494-d182-4324-af81-8ff2b6dc67f2 service nova] Acquiring lock "56f5786e-f554-479f-93a7-0d4834ce9fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cd36a924-dde0-4671-9c0c-583ec30465d7 req-cc610494-d182-4324-af81-8ff2b6dc67f2 service nova] Lock "56f5786e-f554-479f-93a7-0d4834ce9fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cd36a924-dde0-4671-9c0c-583ec30465d7 req-cc610494-d182-4324-af81-8ff2b6dc67f2 service nova] Lock "56f5786e-f554-479f-93a7-0d4834ce9fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:50 user nova-compute[73469]: DEBUG nova.compute.manager [req-cd36a924-dde0-4671-9c0c-583ec30465d7 req-cc610494-d182-4324-af81-8ff2b6dc67f2 service nova] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] No waiting events found dispatching network-vif-plugged-79905cbd-3475-4c02-aba3-aa94a56a2823 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:56:50 user nova-compute[73469]: WARNING nova.compute.manager [req-cd36a924-dde0-4671-9c0c-583ec30465d7 req-cc610494-d182-4324-af81-8ff2b6dc67f2 service nova] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Received unexpected event network-vif-plugged-79905cbd-3475-4c02-aba3-aa94a56a2823 for instance with vm_state building and task_state spawning.
Aug 22 02:56:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:56:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:56:50 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:56:50 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673010.9289799, 56f5786e-f554-479f-93a7-0d4834ce9fce => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:56:50 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] VM Started (Lifecycle Event)
Aug 22 02:56:51 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:56:51 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:56:51 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:56:51 user nova-compute[73469]: INFO nova.compute.manager [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Took 6.48 seconds to spawn the instance on the hypervisor.
Aug 22 02:56:51 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:56:51 user nova-compute[73469]: INFO nova.compute.manager [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Took 7.27 seconds to build instance.
Aug 22 02:56:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc08ce54-cb4b-482f-aed3-51da3b02726c tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "56f5786e-f554-479f-93a7-0d4834ce9fce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.377s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:52 user nova-compute[73469]: DEBUG nova.objects.instance [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lazy-loading 'flavor' on Instance uuid 3ade8cba-6c34-4457-9ad3-484a604dbdb6 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:56:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:52 user nova-compute[73469]: INFO nova.compute.manager [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Attaching volume 09354d33-ec90-4ebe-81cf-9fed080243bc to /dev/vdb
Aug 22 02:56:52 user nova-compute[73469]: DEBUG os_brick.utils [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:56:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:52 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[142d760a-0e61-4fa1-a0ee-a9714dbbda51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:52 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ab12ee-bdfb-473c-b2c4-da4b542d8bbf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c37f22b-7c04-4d6f-9ebd-4c7afcedebe4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d62bd3-2a98-4883-bffb-48b3d8eef8af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:56:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 02:56:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:56:53 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 02:56:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f6eb73-e96d-47f1-972b-8886561262f5]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:56:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 02:56:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 02:56:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 02:56:53 user nova-compute[73469]: DEBUG os_brick.utils [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:56:53 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Updating existing volume attachment record: d396717a-c312-41c8-8584-e6c3d629d310 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 02:56:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:56:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:56:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:57 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:56:57 user nova-compute[73469]: INFO nova.compute.claims [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Claim successful on node user
Aug 22 02:56:58 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:56:58 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:56:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:56:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:56:58 user nova-compute[73469]: DEBUG nova.network.neutron [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:56:58 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 02:56:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:56:58 user nova-compute[73469]: DEBUG nova.policy [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e62d25dff554a629a7e0af1406d97a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49e405f5aca432097b7ba854fd3055b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:56:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:56:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:56:58 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Creating image(s)
Aug 22 02:56:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "/opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "/opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.226s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.179s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk 1073741824" returned: 0 in 0.053s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:56:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:59 user nova-compute[73469]: DEBUG nova.network.neutron [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Successfully created port: 1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:56:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.216s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:59 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 02:56:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:56:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:56:59 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Cannot resize image /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 02:56:59 user nova-compute[73469]: DEBUG nova.objects.instance [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'migration_context' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:56:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:56:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Ensure instance console log exists: /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:56:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:56:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:56:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.network.neutron [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Successfully updated port: 1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "refresh_cache-2e621408-a0af-460b-80a2-3446b5f1aadb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquired lock "refresh_cache-2e621408-a0af-460b-80a2-3446b5f1aadb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.network.neutron [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.compute.manager [req-8027a510-af83-42cb-8309-25a0ab517b63 req-f97a2c72-c3ab-40ff-81e1-f6bc10816150 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received event network-changed-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.compute.manager [req-8027a510-af83-42cb-8309-25a0ab517b63 req-f97a2c72-c3ab-40ff-81e1-f6bc10816150 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Refreshing instance network info cache due to event network-changed-1b3de561-7dd1-4d48-8932-05c4e4770538. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8027a510-af83-42cb-8309-25a0ab517b63 req-f97a2c72-c3ab-40ff-81e1-f6bc10816150 service nova] Acquiring lock "refresh_cache-2e621408-a0af-460b-80a2-3446b5f1aadb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.network.neutron [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.network.neutron [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Updating instance_info_cache with network_info: [{"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Releasing lock "refresh_cache-2e621408-a0af-460b-80a2-3446b5f1aadb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Instance network_info: |[{"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8027a510-af83-42cb-8309-25a0ab517b63 req-f97a2c72-c3ab-40ff-81e1-f6bc10816150 service nova] Acquired lock "refresh_cache-2e621408-a0af-460b-80a2-3446b5f1aadb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.network.neutron [req-8027a510-af83-42cb-8309-25a0ab517b63 req-f97a2c72-c3ab-40ff-81e1-f6bc10816150 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Refreshing network info cache for port 1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Start _get_guest_xml network_info=[{"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:57:00 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:57:00 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1789351683',display_name='tempest-AttachVolumeTestJSON-server-1789351683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1789351683',id=17,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg3FO8Q1Fyh7Eb17I96O7txjPwDiFqMIfNq8/4/TcYPo08QnJwR73w8ZzPDWLE/eydf8rsuj4/QsACeGK9yAdP5tx7NSUxI3GV9dfyUcRbWNJiAjAgSe8h9Vrksa3qrNg==',key_name='tempest-keypair-647650365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e49e405f5aca432097b7ba854fd3055b',ramdisk_id='',reservation_id='r-xv1z21bt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-356928747',owner_user_name='tempest-AttachVolumeTestJSON-356928747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:56:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e62d25dff554a629a7e0af1406d97a9',uuid=2e621408-a0af-460b-80a2-3446b5f1aadb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converting VIF {"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.objects.instance [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:57:00 user nova-compute[73469]:   <uuid>2e621408-a0af-460b-80a2-3446b5f1aadb</uuid>
Aug 22 02:57:00 user nova-compute[73469]:   <name>instance-00000011</name>
Aug 22 02:57:00 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:57:00 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:57:00 user nova-compute[73469]:   <metadata>
Aug 22 02:57:00 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:57:00 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:57:00 user nova-compute[73469]:       <nova:name>tempest-AttachVolumeTestJSON-server-1789351683</nova:name>
Aug 22 02:57:00 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:57:00</nova:creationTime>
Aug 22 02:57:00 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:57:00 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:57:00 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:57:00 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:57:00 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:57:00 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:57:00 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:57:00 user nova-compute[73469]:       <nova:owner>
Aug 22 02:57:00 user nova-compute[73469]:         <nova:user uuid="0e62d25dff554a629a7e0af1406d97a9">tempest-AttachVolumeTestJSON-356928747-project-member</nova:user>
Aug 22 02:57:00 user nova-compute[73469]:         <nova:project uuid="e49e405f5aca432097b7ba854fd3055b">tempest-AttachVolumeTestJSON-356928747</nova:project>
Aug 22 02:57:00 user nova-compute[73469]:       </nova:owner>
Aug 22 02:57:00 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:57:00 user nova-compute[73469]:       <nova:ports>
Aug 22 02:57:00 user nova-compute[73469]:         <nova:port uuid="1b3de561-7dd1-4d48-8932-05c4e4770538">
Aug 22 02:57:00 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 22 02:57:00 user nova-compute[73469]:         </nova:port>
Aug 22 02:57:00 user nova-compute[73469]:       </nova:ports>
Aug 22 02:57:00 user nova-compute[73469]:     </nova:instance>
Aug 22 02:57:00 user nova-compute[73469]:   </metadata>
Aug 22 02:57:00 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:57:00 user nova-compute[73469]:     <system>
Aug 22 02:57:00 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:57:00 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:57:00 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:57:00 user nova-compute[73469]:       <entry name="serial">2e621408-a0af-460b-80a2-3446b5f1aadb</entry>
Aug 22 02:57:00 user nova-compute[73469]:       <entry name="uuid">2e621408-a0af-460b-80a2-3446b5f1aadb</entry>
Aug 22 02:57:00 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:57:00 user nova-compute[73469]:     </system>
Aug 22 02:57:00 user nova-compute[73469]:   </sysinfo>
Aug 22 02:57:00 user nova-compute[73469]:   <os>
Aug 22 02:57:00 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:57:00 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:57:00 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:57:00 user nova-compute[73469]:   </os>
Aug 22 02:57:00 user nova-compute[73469]:   <features>
Aug 22 02:57:00 user nova-compute[73469]:     <acpi/>
Aug 22 02:57:00 user nova-compute[73469]:     <apic/>
Aug 22 02:57:00 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:57:00 user nova-compute[73469]:   </features>
Aug 22 02:57:00 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:57:00 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:57:00 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:57:00 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:57:00 user nova-compute[73469]:   </clock>
Aug 22 02:57:00 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:57:00 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:57:00 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:57:00 user nova-compute[73469]:   </cpu>
Aug 22 02:57:00 user nova-compute[73469]:   <devices>
Aug 22 02:57:00 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:57:00 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:57:00 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk"/>
Aug 22 02:57:00 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:57:00 user nova-compute[73469]:     </disk>
Aug 22 02:57:00 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:57:00 user nova-compute[73469]:       <mac address="fa:16:3e:d7:a2:07"/>
Aug 22 02:57:00 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:57:00 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:57:00 user nova-compute[73469]:       <target dev="tap1b3de561-7d"/>
Aug 22 02:57:00 user nova-compute[73469]:     </interface>
Aug 22 02:57:00 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:57:00 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/console.log" append="off"/>
Aug 22 02:57:00 user nova-compute[73469]:     </serial>
Aug 22 02:57:00 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:57:00 user nova-compute[73469]:     <video>
Aug 22 02:57:00 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:57:00 user nova-compute[73469]:     </video>
Aug 22 02:57:00 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:57:00 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:57:00 user nova-compute[73469]:     </rng>
Aug 22 02:57:00 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:57:00 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:57:00 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:57:00 user nova-compute[73469]:     </memballoon>
Aug 22 02:57:00 user nova-compute[73469]:   </devices>
Aug 22 02:57:00 user nova-compute[73469]: </domain>
Aug 22 02:57:00 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1789351683',display_name='tempest-AttachVolumeTestJSON-server-1789351683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1789351683',id=17,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg3FO8Q1Fyh7Eb17I96O7txjPwDiFqMIfNq8/4/TcYPo08QnJwR73w8ZzPDWLE/eydf8rsuj4/QsACeGK9yAdP5tx7NSUxI3GV9dfyUcRbWNJiAjAgSe8h9Vrksa3qrNg==',key_name='tempest-keypair-647650365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e49e405f5aca432097b7ba854fd3055b',ramdisk_id='',reservation_id='r-xv1z21bt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-356928747',owner_user_name='tempest-AttachVolumeTestJSON-356928747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:56:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e62d25dff554a629a7e0af1406d97a9',uuid=2e621408-a0af-460b-80a2-3446b5f1aadb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converting VIF {"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG os_vif [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b3de561-7d, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1b3de561-7d, col_values=(('external_ids', {'iface-id': '1b3de561-7dd1-4d48-8932-05c4e4770538', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:a2:07', 'vm-uuid': '2e621408-a0af-460b-80a2-3446b5f1aadb'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:00 user nova-compute[73469]: INFO os_vif [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d')
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] No VIF found with MAC fa:16:3e:d7:a2:07, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.network.neutron [req-8027a510-af83-42cb-8309-25a0ab517b63 req-f97a2c72-c3ab-40ff-81e1-f6bc10816150 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Updated VIF entry in instance network info cache for port 1b3de561-7dd1-4d48-8932-05c4e4770538. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG nova.network.neutron [req-8027a510-af83-42cb-8309-25a0ab517b63 req-f97a2c72-c3ab-40ff-81e1-f6bc10816150 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Updating instance_info_cache with network_info: [{"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:57:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8027a510-af83-42cb-8309-25a0ab517b63 req-f97a2c72-c3ab-40ff-81e1-f6bc10816150 service nova] Releasing lock "refresh_cache-2e621408-a0af-460b-80a2-3446b5f1aadb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:57:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:02 user nova-compute[73469]: DEBUG nova.compute.manager [req-9ed1a93d-eaa7-4700-9499-6f9a5437667b req-4b3b40b0-7f90-45c1-89bf-5d3fe586c987 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received event network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9ed1a93d-eaa7-4700-9499-6f9a5437667b req-4b3b40b0-7f90-45c1-89bf-5d3fe586c987 service nova] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9ed1a93d-eaa7-4700-9499-6f9a5437667b req-4b3b40b0-7f90-45c1-89bf-5d3fe586c987 service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9ed1a93d-eaa7-4700-9499-6f9a5437667b req-4b3b40b0-7f90-45c1-89bf-5d3fe586c987 service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:02 user nova-compute[73469]: DEBUG nova.compute.manager [req-9ed1a93d-eaa7-4700-9499-6f9a5437667b req-4b3b40b0-7f90-45c1-89bf-5d3fe586c987 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] No waiting events found dispatching network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:02 user nova-compute[73469]: WARNING nova.compute.manager [req-9ed1a93d-eaa7-4700-9499-6f9a5437667b req-4b3b40b0-7f90-45c1-89bf-5d3fe586c987 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received unexpected event network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 for instance with vm_state building and task_state spawning.
Aug 22 02:57:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:04 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673024.4775772, 2e621408-a0af-460b-80a2-3446b5f1aadb => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:57:04 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] VM Resumed (Lifecycle Event)
Aug 22 02:57:04 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:57:04 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:57:04 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Instance spawned successfully.
Aug 22 02:57:04 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:57:04 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:57:04 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:57:04 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:57:04 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:57:04 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:57:04 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:57:04 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:57:04 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:57:04 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:57:04 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673024.4841056, 2e621408-a0af-460b-80a2-3446b5f1aadb => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:57:04 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] VM Started (Lifecycle Event)
Aug 22 02:57:04 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:57:04 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:57:04 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:57:04 user nova-compute[73469]: INFO nova.compute.manager [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Took 5.93 seconds to spawn the instance on the hypervisor.
Aug 22 02:57:04 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:57:04 user nova-compute[73469]: INFO nova.compute.manager [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Took 6.78 seconds to build instance.
Aug 22 02:57:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e00690a9-ab0d-4cb3-84e2-12a9c52912f3 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.883s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:04 user nova-compute[73469]: DEBUG nova.compute.manager [req-b1f255b3-7198-4b42-889a-b22130657e3e req-8c05b43d-6b70-4d59-ac23-c13d3185703f service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received event network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b1f255b3-7198-4b42-889a-b22130657e3e req-8c05b43d-6b70-4d59-ac23-c13d3185703f service nova] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b1f255b3-7198-4b42-889a-b22130657e3e req-8c05b43d-6b70-4d59-ac23-c13d3185703f service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b1f255b3-7198-4b42-889a-b22130657e3e req-8c05b43d-6b70-4d59-ac23-c13d3185703f service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:04 user nova-compute[73469]: DEBUG nova.compute.manager [req-b1f255b3-7198-4b42-889a-b22130657e3e req-8c05b43d-6b70-4d59-ac23-c13d3185703f service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] No waiting events found dispatching network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:04 user nova-compute[73469]: WARNING nova.compute.manager [req-b1f255b3-7198-4b42-889a-b22130657e3e req-8c05b43d-6b70-4d59-ac23-c13d3185703f service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received unexpected event network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 for instance with vm_state active and task_state None.
Aug 22 02:57:05 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CPFMtrvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:57:05 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:57:05 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:57:05 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[292cc6f5-079c-4db5-b47c-aa2abd324d93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 02:57:05 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5827c745-0f00-43e9-a515-6865407be27b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc] added
Aug 22 02:57:05 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa19e500-1b91-44d4-bb59-ea7856f1a868]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab99bac-c99b-4696-914b-72c064c85268]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CPFMtrvb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CPFMtrvb" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[98faa919-ec9d-4624-a594-02d5880a71ec]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CPFMtrvb'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[878bc5fa-e154-4cbd-96d3-4dfc0fcc49a7]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06eab42-3786-4d60-98d2-ab0652c21215]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3db7898-112f-4b4d-8f1e-038a3846d260]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc, portal: 172.16.0.220,3260]
Aug 22 02:57:05 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc, portal: 172.16.0.220,3260] successful.
Aug 22 02:57:05 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.059s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c054dc1-cc6e-46eb-aa97-8e6cd5c87b6d]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1165f82c-61c2-4c6d-820e-d5cd4a931ea9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:57:05 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:57:05 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:57:05 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] HCTL ('38', '-', '-', 0) found on session 16 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f29265b-b1d9-4d75-829e-c3492632cc8c]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Searching for a device in session 16 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CPFMtrvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Acquiring lock "f478387d-e004-4314-961d-abf4a910e970" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "f478387d-e004-4314-961d-abf4a910e970" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Acquiring lock "f478387d-e004-4314-961d-abf4a910e970-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "f478387d-e004-4314-961d-abf4a910e970-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "f478387d-e004-4314-961d-abf4a910e970-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:05 user nova-compute[73469]: INFO nova.compute.manager [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Terminating instance
Aug 22 02:57:05 user nova-compute[73469]: DEBUG nova.compute.manager [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:06 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: f478387d-e004-4314-961d-abf4a910e970] Instance destroyed successfully.
Aug 22 02:57:06 user nova-compute[73469]: DEBUG nova.objects.instance [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lazy-loading 'resources' on Instance uuid f478387d-e004-4314-961d-abf4a910e970 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2072789517',display_name='tempest-TestVolumeSwap-server-2072789517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2072789517',id=8,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNkHzhaIKZAAMJju6nMvsYsNMkUHkELvuE21pKgUC0dqShiMeHcF48QrQyu+m0sBQZSc2Mm8RwyW5CwMiT1Ik7ll82rf28/HcHgucqaMHaUWjdIqwobXPJG4U51Zu6WYA==',key_name='tempest-keypair-1765973754',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:53:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4af59db42fc849efa62fe05f0225084c',ramdisk_id='',reservation_id='r-w9t6bpam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-784062355',owner_user_name='tempest-TestVolumeSwap-784062355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:53:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94d6857e94724880877a28c02ad6eaaa',uuid=f478387d-e004-4314-961d-abf4a910e970,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "address": "fa:16:3e:40:4d:fa", "network": {"id": "10332235-8c40-4287-965d-a31a57873020", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075046749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af59db42fc849efa62fe05f0225084c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a77e8c-e1", "ovs_interfaceid": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Converting VIF {"id": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "address": "fa:16:3e:40:4d:fa", "network": {"id": "10332235-8c40-4287-965d-a31a57873020", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075046749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af59db42fc849efa62fe05f0225084c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a77e8c-e1", "ovs_interfaceid": "f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:4d:fa,bridge_name='br-int',has_traffic_filtering=True,id=f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e,network=Network(10332235-8c40-4287-965d-a31a57873020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3a77e8c-e1') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG os_vif [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:4d:fa,bridge_name='br-int',has_traffic_filtering=True,id=f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e,network=Network(10332235-8c40-4287-965d-a31a57873020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3a77e8c-e1') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3a77e8c-e1, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:57:06 user nova-compute[73469]: INFO os_vif [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:4d:fa,bridge_name='br-int',has_traffic_filtering=True,id=f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e,network=Network(10332235-8c40-4287-965d-a31a57873020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3a77e8c-e1')
Aug 22 02:57:06 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Deleting instance files /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970_del
Aug 22 02:57:06 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Deletion of /opt/stack/data/nova/instances/f478387d-e004-4314-961d-abf4a910e970_del complete
Aug 22 02:57:06 user nova-compute[73469]: INFO nova.compute.manager [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] [instance: f478387d-e004-4314-961d-abf4a910e970] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 22 02:57:06 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: f478387d-e004-4314-961d-abf4a910e970] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: f478387d-e004-4314-961d-abf4a910e970] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '26131646330663762', 'path': '/dev/sdg'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131646330663762', 'path': '/dev/sdg'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG nova.objects.instance [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lazy-loading 'flavor' on Instance uuid 3ade8cba-6c34-4457-9ad3-484a604dbdb6 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 02:57:06 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:57:06 user nova-compute[73469]:   <source dev="/dev/sdg"/>
Aug 22 02:57:06 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 02:57:06 user nova-compute[73469]:   <serial>09354d33-ec90-4ebe-81cf-9fed080243bc</serial>
Aug 22 02:57:06 user nova-compute[73469]: </disk>
Aug 22 02:57:06 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG nova.compute.manager [req-204ca35e-6a9a-46c5-9e38-5325da7afa72 req-4c2b1e3e-dc72-4b8a-a0f0-f0acb397c5fe service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] Received event network-vif-unplugged-f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-204ca35e-6a9a-46c5-9e38-5325da7afa72 req-4c2b1e3e-dc72-4b8a-a0f0-f0acb397c5fe service nova] Acquiring lock "f478387d-e004-4314-961d-abf4a910e970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-204ca35e-6a9a-46c5-9e38-5325da7afa72 req-4c2b1e3e-dc72-4b8a-a0f0-f0acb397c5fe service nova] Lock "f478387d-e004-4314-961d-abf4a910e970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-204ca35e-6a9a-46c5-9e38-5325da7afa72 req-4c2b1e3e-dc72-4b8a-a0f0-f0acb397c5fe service nova] Lock "f478387d-e004-4314-961d-abf4a910e970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG nova.compute.manager [req-204ca35e-6a9a-46c5-9e38-5325da7afa72 req-4c2b1e3e-dc72-4b8a-a0f0-f0acb397c5fe service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] No waiting events found dispatching network-vif-unplugged-f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG nova.compute.manager [req-204ca35e-6a9a-46c5-9e38-5325da7afa72 req-4c2b1e3e-dc72-4b8a-a0f0-f0acb397c5fe service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] Received event network-vif-unplugged-f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG nova.compute.manager [req-204ca35e-6a9a-46c5-9e38-5325da7afa72 req-4c2b1e3e-dc72-4b8a-a0f0-f0acb397c5fe service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] Received event network-vif-plugged-f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-204ca35e-6a9a-46c5-9e38-5325da7afa72 req-4c2b1e3e-dc72-4b8a-a0f0-f0acb397c5fe service nova] Acquiring lock "f478387d-e004-4314-961d-abf4a910e970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-204ca35e-6a9a-46c5-9e38-5325da7afa72 req-4c2b1e3e-dc72-4b8a-a0f0-f0acb397c5fe service nova] Lock "f478387d-e004-4314-961d-abf4a910e970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-204ca35e-6a9a-46c5-9e38-5325da7afa72 req-4c2b1e3e-dc72-4b8a-a0f0-f0acb397c5fe service nova] Lock "f478387d-e004-4314-961d-abf4a910e970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:06 user nova-compute[73469]: DEBUG nova.compute.manager [req-204ca35e-6a9a-46c5-9e38-5325da7afa72 req-4c2b1e3e-dc72-4b8a-a0f0-f0acb397c5fe service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] No waiting events found dispatching network-vif-plugged-f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:06 user nova-compute[73469]: WARNING nova.compute.manager [req-204ca35e-6a9a-46c5-9e38-5325da7afa72 req-4c2b1e3e-dc72-4b8a-a0f0-f0acb397c5fe service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] Received unexpected event network-vif-plugged-f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e for instance with vm_state active and task_state deleting.
Aug 22 02:57:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:57:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:57:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] No VIF found with MAC fa:16:3e:ef:c1:aa, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:57:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4052d032-983b-427b-9bb8-9d5b20f664a0 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.580s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:08 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: f478387d-e004-4314-961d-abf4a910e970] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:57:08 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: f478387d-e004-4314-961d-abf4a910e970] Took 1.90 seconds to deallocate network for instance.
Aug 22 02:57:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-609fc351-0fcd-405d-938f-cd8d73bd401d req-61784224-2f68-4640-b775-bafc00a69fcf service nova] [instance: f478387d-e004-4314-961d-abf4a910e970] Received event network-vif-deleted-f3a77e8c-e17a-4dc6-b032-d5c9deea6f2e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:09 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:57:09 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:57:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:09 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Deleted allocations for instance f478387d-e004-4314-961d-abf4a910e970
Aug 22 02:57:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5d4f9d80-87d7-4562-bacd-b70f2c9ae4da tempest-TestVolumeSwap-784062355 tempest-TestVolumeSwap-784062355-project-member] Lock "f478387d-e004-4314-961d-abf4a910e970" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.476s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:12 user nova-compute[73469]: DEBUG nova.compute.manager [req-71c22067-e0a3-4530-aaeb-682e5718c658 req-8367233e-2594-4c3d-bfc8-90f3a658ec75 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-changed-d4d8e796-6ff5-4094-aab4-3efd059b5645 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:12 user nova-compute[73469]: DEBUG nova.compute.manager [req-71c22067-e0a3-4530-aaeb-682e5718c658 req-8367233e-2594-4c3d-bfc8-90f3a658ec75 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Refreshing instance network info cache due to event network-changed-d4d8e796-6ff5-4094-aab4-3efd059b5645. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:57:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-71c22067-e0a3-4530-aaeb-682e5718c658 req-8367233e-2594-4c3d-bfc8-90f3a658ec75 service nova] Acquiring lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:57:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-71c22067-e0a3-4530-aaeb-682e5718c658 req-8367233e-2594-4c3d-bfc8-90f3a658ec75 service nova] Acquired lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:57:12 user nova-compute[73469]: DEBUG nova.network.neutron [req-71c22067-e0a3-4530-aaeb-682e5718c658 req-8367233e-2594-4c3d-bfc8-90f3a658ec75 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Refreshing network info cache for port d4d8e796-6ff5-4094-aab4-3efd059b5645 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:57:13 user nova-compute[73469]: DEBUG nova.network.neutron [req-71c22067-e0a3-4530-aaeb-682e5718c658 req-8367233e-2594-4c3d-bfc8-90f3a658ec75 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Updated VIF entry in instance network info cache for port d4d8e796-6ff5-4094-aab4-3efd059b5645. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:57:13 user nova-compute[73469]: DEBUG nova.network.neutron [req-71c22067-e0a3-4530-aaeb-682e5718c658 req-8367233e-2594-4c3d-bfc8-90f3a658ec75 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Updating instance_info_cache with network_info: [{"id": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "address": "fa:16:3e:d4:b8:e1", "network": {"id": "f37e6636-5a5f-4465-91c5-6f305460d1d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903703061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d8e796-6f", "ovs_interfaceid": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "address": "fa:16:3e:97:ea:4f", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf962364e-a4", "ovs_interfaceid": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6af318a1-2ecf-4320-933c-4836f592367a", "address": "fa:16:3e:08:32:58", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af318a1-2e", "ovs_interfaceid": "6af318a1-2ecf-4320-933c-4836f592367a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "address": "fa:16:3e:fe:42:04", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f58efb2-2f", "ovs_interfaceid": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "address": "fa:16:3e:fc:e2:5d", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f06a837-3e", "ovs_interfaceid": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45e4812b-ca27-47b3-b289-63089cb11e00", "address": "fa:16:3e:a7:8f:57", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e4812b-ca", "ovs_interfaceid": "45e4812b-ca27-47b3-b289-63089cb11e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "address": "fa:16:3e:d6:db:55", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc301cc-bb", "ovs_interfaceid": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:57:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-71c22067-e0a3-4530-aaeb-682e5718c658 req-8367233e-2594-4c3d-bfc8-90f3a658ec75 service nova] Releasing lock "refresh_cache-28e78814-0990-49e4-a6e7-e209276d2e46" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:57:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "28e78814-0990-49e4-a6e7-e209276d2e46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:15 user nova-compute[73469]: INFO nova.compute.manager [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Terminating instance
Aug 22 02:57:15 user nova-compute[73469]: DEBUG nova.compute.manager [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 02:57:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-07c65ea5-4f1c-4204-937e-bb4263f3c554 req-cafdc0fe-44ff-44aa-b286-9e7121c8df7b service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-unplugged-f962364e-a4e1-4d88-b7b5-5dcc07eb8220 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-07c65ea5-4f1c-4204-937e-bb4263f3c554 req-cafdc0fe-44ff-44aa-b286-9e7121c8df7b service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-07c65ea5-4f1c-4204-937e-bb4263f3c554 req-cafdc0fe-44ff-44aa-b286-9e7121c8df7b service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-07c65ea5-4f1c-4204-937e-bb4263f3c554 req-cafdc0fe-44ff-44aa-b286-9e7121c8df7b service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-07c65ea5-4f1c-4204-937e-bb4263f3c554 req-cafdc0fe-44ff-44aa-b286-9e7121c8df7b service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-unplugged-f962364e-a4e1-4d88-b7b5-5dcc07eb8220 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-07c65ea5-4f1c-4204-937e-bb4263f3c554 req-cafdc0fe-44ff-44aa-b286-9e7121c8df7b service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-unplugged-f962364e-a4e1-4d88-b7b5-5dcc07eb8220 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-dc97528f-4651-4437-aff1-831a99ec217d req-bafc4960-fc79-4eaf-a9bf-e0c040829af5 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-unplugged-6af318a1-2ecf-4320-933c-4836f592367a {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dc97528f-4651-4437-aff1-831a99ec217d req-bafc4960-fc79-4eaf-a9bf-e0c040829af5 service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dc97528f-4651-4437-aff1-831a99ec217d req-bafc4960-fc79-4eaf-a9bf-e0c040829af5 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dc97528f-4651-4437-aff1-831a99ec217d req-bafc4960-fc79-4eaf-a9bf-e0c040829af5 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-dc97528f-4651-4437-aff1-831a99ec217d req-bafc4960-fc79-4eaf-a9bf-e0c040829af5 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-unplugged-6af318a1-2ecf-4320-933c-4836f592367a {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-dc97528f-4651-4437-aff1-831a99ec217d req-bafc4960-fc79-4eaf-a9bf-e0c040829af5 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-unplugged-6af318a1-2ecf-4320-933c-4836f592367a for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-818c472e-f8db-4624-9762-590a40f2c363 req-eef33c60-5687-4526-bc87-309ceeb0b6fc service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-unplugged-d4d8e796-6ff5-4094-aab4-3efd059b5645 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-818c472e-f8db-4624-9762-590a40f2c363 req-eef33c60-5687-4526-bc87-309ceeb0b6fc service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-818c472e-f8db-4624-9762-590a40f2c363 req-eef33c60-5687-4526-bc87-309ceeb0b6fc service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-818c472e-f8db-4624-9762-590a40f2c363 req-eef33c60-5687-4526-bc87-309ceeb0b6fc service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-818c472e-f8db-4624-9762-590a40f2c363 req-eef33c60-5687-4526-bc87-309ceeb0b6fc service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-unplugged-d4d8e796-6ff5-4094-aab4-3efd059b5645 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-818c472e-f8db-4624-9762-590a40f2c363 req-eef33c60-5687-4526-bc87-309ceeb0b6fc service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-unplugged-d4d8e796-6ff5-4094-aab4-3efd059b5645 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:17 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Instance destroyed successfully.
Aug 22 02:57:17 user nova-compute[73469]: DEBUG nova.objects.instance [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lazy-loading 'resources' on Instance uuid 28e78814-0990-49e4-a6e7-e209276d2e46 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:55:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "address": "fa:16:3e:d4:b8:e1", "network": {"id": "f37e6636-5a5f-4465-91c5-6f305460d1d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903703061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d8e796-6f", "ovs_interfaceid": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "address": "fa:16:3e:d4:b8:e1", "network": {"id": "f37e6636-5a5f-4465-91c5-6f305460d1d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903703061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d8e796-6f", "ovs_interfaceid": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:b8:e1,bridge_name='br-int',has_traffic_filtering=True,id=d4d8e796-6ff5-4094-aab4-3efd059b5645,network=Network(f37e6636-5a5f-4465-91c5-6f305460d1d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d8e796-6f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG os_vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:b8:e1,bridge_name='br-int',has_traffic_filtering=True,id=d4d8e796-6ff5-4094-aab4-3efd059b5645,network=Network(f37e6636-5a5f-4465-91c5-6f305460d1d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d8e796-6f') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4d8e796-6f, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:17 user nova-compute[73469]: INFO os_vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:b8:e1,bridge_name='br-int',has_traffic_filtering=True,id=d4d8e796-6ff5-4094-aab4-3efd059b5645,network=Network(f37e6636-5a5f-4465-91c5-6f305460d1d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d8e796-6f')
Aug 22 02:57:17 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:55:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "address": "fa:16:3e:97:ea:4f", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf962364e-a4", "ovs_interfaceid": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "address": "fa:16:3e:97:ea:4f", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf962364e-a4", "ovs_interfaceid": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:ea:4f,bridge_name='br-int',has_traffic_filtering=True,id=f962364e-a4e1-4d88-b7b5-5dcc07eb8220,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf962364e-a4') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG os_vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:ea:4f,bridge_name='br-int',has_traffic_filtering=True,id=f962364e-a4e1-4d88-b7b5-5dcc07eb8220,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf962364e-a4') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf962364e-a4, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:17 user nova-compute[73469]: INFO os_vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:ea:4f,bridge_name='br-int',has_traffic_filtering=True,id=f962364e-a4e1-4d88-b7b5-5dcc07eb8220,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf962364e-a4')
Aug 22 02:57:17 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:55:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6af318a1-2ecf-4320-933c-4836f592367a", "address": "fa:16:3e:08:32:58", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af318a1-2e", "ovs_interfaceid": "6af318a1-2ecf-4320-933c-4836f592367a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "6af318a1-2ecf-4320-933c-4836f592367a", "address": "fa:16:3e:08:32:58", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af318a1-2e", "ovs_interfaceid": "6af318a1-2ecf-4320-933c-4836f592367a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:32:58,bridge_name='br-int',has_traffic_filtering=True,id=6af318a1-2ecf-4320-933c-4836f592367a,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6af318a1-2e') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG os_vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:32:58,bridge_name='br-int',has_traffic_filtering=True,id=6af318a1-2ecf-4320-933c-4836f592367a,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6af318a1-2e') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6af318a1-2e, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:17 user nova-compute[73469]: INFO os_vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:32:58,bridge_name='br-int',has_traffic_filtering=True,id=6af318a1-2ecf-4320-933c-4836f592367a,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6af318a1-2e')
Aug 22 02:57:17 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:55:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "address": "fa:16:3e:fe:42:04", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f58efb2-2f", "ovs_interfaceid": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "address": "fa:16:3e:fe:42:04", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f58efb2-2f", "ovs_interfaceid": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:42:04,bridge_name='br-int',has_traffic_filtering=True,id=0f58efb2-2fd2-42d0-a2db-f7b821677d19,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f58efb2-2f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG os_vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:42:04,bridge_name='br-int',has_traffic_filtering=True,id=0f58efb2-2fd2-42d0-a2db-f7b821677d19,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f58efb2-2f') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f58efb2-2f, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:17 user nova-compute[73469]: INFO os_vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:42:04,bridge_name='br-int',has_traffic_filtering=True,id=0f58efb2-2fd2-42d0-a2db-f7b821677d19,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f58efb2-2f')
Aug 22 02:57:17 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:55:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "address": "fa:16:3e:fc:e2:5d", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f06a837-3e", "ovs_interfaceid": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "address": "fa:16:3e:fc:e2:5d", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f06a837-3e", "ovs_interfaceid": "4f06a837-3e8c-4362-814a-3b9cd8085a05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:e2:5d,bridge_name='br-int',has_traffic_filtering=True,id=4f06a837-3e8c-4362-814a-3b9cd8085a05,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f06a837-3e') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG os_vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:e2:5d,bridge_name='br-int',has_traffic_filtering=True,id=4f06a837-3e8c-4362-814a-3b9cd8085a05,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f06a837-3e') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f06a837-3e, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:17 user nova-compute[73469]: INFO os_vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:e2:5d,bridge_name='br-int',has_traffic_filtering=True,id=4f06a837-3e8c-4362-814a-3b9cd8085a05,network=Network(23c6d28e-7284-4d8b-baec-88b1c1a0be7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f06a837-3e')
Aug 22 02:57:17 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:55:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45e4812b-ca27-47b3-b289-63089cb11e00", "address": "fa:16:3e:a7:8f:57", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e4812b-ca", "ovs_interfaceid": "45e4812b-ca27-47b3-b289-63089cb11e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "45e4812b-ca27-47b3-b289-63089cb11e00", "address": "fa:16:3e:a7:8f:57", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e4812b-ca", "ovs_interfaceid": "45e4812b-ca27-47b3-b289-63089cb11e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:8f:57,bridge_name='br-int',has_traffic_filtering=True,id=45e4812b-ca27-47b3-b289-63089cb11e00,network=Network(eece3552-98b8-41f1-ae19-9575fb5529b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e4812b-ca') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG os_vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:8f:57,bridge_name='br-int',has_traffic_filtering=True,id=45e4812b-ca27-47b3-b289-63089cb11e00,network=Network(eece3552-98b8-41f1-ae19-9575fb5529b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e4812b-ca') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45e4812b-ca, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:57:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:18 user nova-compute[73469]: INFO os_vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:8f:57,bridge_name='br-int',has_traffic_filtering=True,id=45e4812b-ca27-47b3-b289-63089cb11e00,network=Network(eece3552-98b8-41f1-ae19-9575fb5529b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e4812b-ca')
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:54:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352986397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352986397',id=11,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2zvSE5CeojXGQCxQ0gqdfxLf5Slsv5+kvgQOF/j5Q8sUpHa0h79uGqd/+QHLtp7cXc6IoERO3k6in0rhoPrnedxBJcjj96F7V8ankDaoIqBgndc72HoUa103XZMo2A+w==',key_name='tempest-keypair-206815856',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:55:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7630ab68804e4d79b0a136f5c6236ea4',ramdisk_id='',reservation_id='r-kre703jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-98908978',owner_user_name='tempest-TaggedBootDevicesTest-98908978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794fcc9145b94cbb989309e571bb3f1c',uuid=28e78814-0990-49e4-a6e7-e209276d2e46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "address": "fa:16:3e:d6:db:55", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc301cc-bb", "ovs_interfaceid": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converting VIF {"id": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "address": "fa:16:3e:d6:db:55", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc301cc-bb", "ovs_interfaceid": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:db:55,bridge_name='br-int',has_traffic_filtering=True,id=cbc301cc-bb85-4871-b3bf-d4dfc54c99ba,network=Network(eece3552-98b8-41f1-ae19-9575fb5529b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc301cc-bb') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:db:55,bridge_name='br-int',has_traffic_filtering=True,id=cbc301cc-bb85-4871-b3bf-d4dfc54c99ba,network=Network(eece3552-98b8-41f1-ae19-9575fb5529b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc301cc-bb') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbc301cc-bb, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:57:18 user nova-compute[73469]: INFO os_vif [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:db:55,bridge_name='br-int',has_traffic_filtering=True,id=cbc301cc-bb85-4871-b3bf-d4dfc54c99ba,network=Network(eece3552-98b8-41f1-ae19-9575fb5529b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc301cc-bb')
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGqbYmEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:57:18 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5924c3f-1cc7-47ae-90ed-7e7e3b5e5ec9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4ccc64-01d7-4270-ac99-3103eed40131]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4661360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267'): ({'sde'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Removing single pathed devices sde {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[176ff1fa-133e-47f4-870d-f50afd4e659a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[034d799b-6858-45ad-8f76-d6390eea1ab1]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Flushing IO for device /dev/sde {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0779fee-0b7d-464b-9342-fd532699d9b5]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[17454848-78ff-4c74-9eb7-e6c8fa4c9a34]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] SCSI volumes sde have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[394c489e-c864-42f9-bc0f-af19ac5a48eb]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb5e97f-d244-487f-9626-64af4e3236b0]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267, portal: 172.16.0.220,3260]
Aug 22 02:57:18 user nova-compute[73469]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267, portal: 172.16.0.220,3260] successful.
Aug 22 02:57:18 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e35ce7-e3d4-461b-951f-eb26eba9f267 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[27413456-cf8d-4e51-91e3-ead783b2e648]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] <== disconnect_volume: return (325ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgyCUJwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:57:18 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a52859-7fd1-4256-ae7b-bbb0e0cfd210]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0276cfea-2c50-496b-a71a-99732f78efb3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4661360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6'): ({'sdf'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Removing single pathed devices sdf {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6532b990-399d-473e-8529-7d9fd662cbbf]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-8a882e14-40c9-4bee-8921-1528be4847da req-4412fbd5-e776-480b-89d1-ed113d5ad0f1 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-f962364e-a4e1-4d88-b7b5-5dcc07eb8220 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8a882e14-40c9-4bee-8921-1528be4847da req-4412fbd5-e776-480b-89d1-ed113d5ad0f1 service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8a882e14-40c9-4bee-8921-1528be4847da req-4412fbd5-e776-480b-89d1-ed113d5ad0f1 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8a882e14-40c9-4bee-8921-1528be4847da req-4412fbd5-e776-480b-89d1-ed113d5ad0f1 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-8a882e14-40c9-4bee-8921-1528be4847da req-4412fbd5-e776-480b-89d1-ed113d5ad0f1 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-f962364e-a4e1-4d88-b7b5-5dcc07eb8220 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:18 user nova-compute[73469]: WARNING nova.compute.manager [req-8a882e14-40c9-4bee-8921-1528be4847da req-4412fbd5-e776-480b-89d1-ed113d5ad0f1 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-f962364e-a4e1-4d88-b7b5-5dcc07eb8220 for instance with vm_state active and task_state deleting.
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.044s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9570712-e2eb-42bf-aba2-15dcbeba4d83]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Flushing IO for device /dev/sdf {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb599e98-1832-470b-aba8-f60f78ddaf1e]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2c2e8082-1def-4768-b272-9414b4347ebc req-4c8578a5-4d88-445b-9832-bb537150be48 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-6af318a1-2ecf-4320-933c-4836f592367a {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2c2e8082-1def-4768-b272-9414b4347ebc req-4c8578a5-4d88-445b-9832-bb537150be48 service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2c2e8082-1def-4768-b272-9414b4347ebc req-4c8578a5-4d88-445b-9832-bb537150be48 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2c2e8082-1def-4768-b272-9414b4347ebc req-4c8578a5-4d88-445b-9832-bb537150be48 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2c2e8082-1def-4768-b272-9414b4347ebc req-4c8578a5-4d88-445b-9832-bb537150be48 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-6af318a1-2ecf-4320-933c-4836f592367a {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:18 user nova-compute[73469]: WARNING nova.compute.manager [req-2c2e8082-1def-4768-b272-9414b4347ebc req-4c8578a5-4d88-445b-9832-bb537150be48 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-6af318a1-2ecf-4320-933c-4836f592367a for instance with vm_state active and task_state deleting.
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b01565-932a-49e8-bf51-ddbc6b44c16e]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] SCSI volumes sdf have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[be73d1b4-f9ae-4e01-9ac0-2e19d537eba5]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[46907414-c2ec-49b1-84a0-ecb0fb118203]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6, portal: 172.16.0.220,3260]
Aug 22 02:57:18 user nova-compute[73469]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6, portal: 172.16.0.220,3260] successful.
Aug 22 02:57:18 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e845e74-8f7f-47c1-8c6c-421d00a5e5c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[680aa989-3864-419a-9618-bab99d92c4b4]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] <== disconnect_volume: return (367ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dFcLxEvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:57:18 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7cbef9-e9ad-419e-bdf3-3b059f4c5660]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86095ec-28a9-4b9c-b506-0d581716a6a1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:57:18 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:57:18 user nova-compute[73469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:57:18 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a41391b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722'): ({'sdd'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Removing single pathed devices sdd {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b7260b-2348-4606-b1d0-2de4f9ec7168]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-d4d8e796-6ff5-4094-aab4-3efd059b5645 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-d4d8e796-6ff5-4094-aab4-3efd059b5645 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:18 user nova-compute[73469]: WARNING nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-d4d8e796-6ff5-4094-aab4-3efd059b5645 for instance with vm_state active and task_state deleting.
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-unplugged-0f58efb2-2fd2-42d0-a2db-f7b821677d19 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-unplugged-0f58efb2-2fd2-42d0-a2db-f7b821677d19 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-unplugged-0f58efb2-2fd2-42d0-a2db-f7b821677d19 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-0f58efb2-2fd2-42d0-a2db-f7b821677d19 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-0f58efb2-2fd2-42d0-a2db-f7b821677d19 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:18 user nova-compute[73469]: WARNING nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-0f58efb2-2fd2-42d0-a2db-f7b821677d19 for instance with vm_state active and task_state deleting.
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-unplugged-4f06a837-3e8c-4362-814a-3b9cd8085a05 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-unplugged-4f06a837-3e8c-4362-814a-3b9cd8085a05 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-unplugged-4f06a837-3e8c-4362-814a-3b9cd8085a05 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-4f06a837-3e8c-4362-814a-3b9cd8085a05 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-4f06a837-3e8c-4362-814a-3b9cd8085a05 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:18 user nova-compute[73469]: WARNING nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-4f06a837-3e8c-4362-814a-3b9cd8085a05 for instance with vm_state active and task_state deleting.
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-unplugged-45e4812b-ca27-47b3-b289-63089cb11e00 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-unplugged-45e4812b-ca27-47b3-b289-63089cb11e00 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-unplugged-45e4812b-ca27-47b3-b289-63089cb11e00 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-45e4812b-ca27-47b3-b289-63089cb11e00 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-45e4812b-ca27-47b3-b289-63089cb11e00 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:18 user nova-compute[73469]: WARNING nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-45e4812b-ca27-47b3-b289-63089cb11e00 for instance with vm_state active and task_state deleting.
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-unplugged-cbc301cc-bb85-4871-b3bf-d4dfc54c99ba {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-unplugged-cbc301cc-bb85-4871-b3bf-d4dfc54c99ba {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-2b733305-3397-4e55-83f9-56a48335569c req-9d6a8fe5-2db5-4772-993b-5420686b6d0d service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-unplugged-cbc301cc-bb85-4871-b3bf-d4dfc54c99ba for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d92eaa5-e01a-4d80-a868-0580a5595d5c]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Flushing IO for device /dev/sdd {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb1c787-92ea-4c70-bafc-4e77780b2e2f]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.083s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae4ea8a-fdf8-4a95-aeff-c993a7fb88f8]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 02:57:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 02:57:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:19 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec5dcdb-6b58-4434-889a-602afff7a469]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:19 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73f0084-66a6-4c84-83a6-3675a724a487]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722, portal: 172.16.0.220,3260]
Aug 22 02:57:19 user nova-compute[73469]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722, portal: 172.16.0.220,3260] successful.
Aug 22 02:57:19 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ed05cb-3e80-4f16-81a7-5849f3dfe722 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:19 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9189f0b-53eb-4b3b-9bcc-2311cfbca5e3]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:57:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] <== disconnect_volume: return (377ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:57:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 02:57:19 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Deleting instance files /opt/stack/data/nova/instances/28e78814-0990-49e4-a6e7-e209276d2e46_del
Aug 22 02:57:19 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Deletion of /opt/stack/data/nova/instances/28e78814-0990-49e4-a6e7-e209276d2e46_del complete
Aug 22 02:57:19 user nova-compute[73469]: INFO nova.compute.manager [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Took 3.35 seconds to destroy the instance on the hypervisor.
Aug 22 02:57:19 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 02:57:19 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 02:57:19 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 02:57:20 user nova-compute[73469]: DEBUG nova.compute.manager [req-8bb90a60-929a-4a5e-983d-68c64a3ffecc req-d8fa3435-be85-4537-97ed-bf4535ca7736 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-plugged-cbc301cc-bb85-4871-b3bf-d4dfc54c99ba {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8bb90a60-929a-4a5e-983d-68c64a3ffecc req-d8fa3435-be85-4537-97ed-bf4535ca7736 service nova] Acquiring lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8bb90a60-929a-4a5e-983d-68c64a3ffecc req-d8fa3435-be85-4537-97ed-bf4535ca7736 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8bb90a60-929a-4a5e-983d-68c64a3ffecc req-d8fa3435-be85-4537-97ed-bf4535ca7736 service nova] Lock "28e78814-0990-49e4-a6e7-e209276d2e46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:20 user nova-compute[73469]: DEBUG nova.compute.manager [req-8bb90a60-929a-4a5e-983d-68c64a3ffecc req-d8fa3435-be85-4537-97ed-bf4535ca7736 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] No waiting events found dispatching network-vif-plugged-cbc301cc-bb85-4871-b3bf-d4dfc54c99ba {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:20 user nova-compute[73469]: WARNING nova.compute.manager [req-8bb90a60-929a-4a5e-983d-68c64a3ffecc req-d8fa3435-be85-4537-97ed-bf4535ca7736 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received unexpected event network-vif-plugged-cbc301cc-bb85-4871-b3bf-d4dfc54c99ba for instance with vm_state active and task_state deleting.
Aug 22 02:57:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-552cc9d0-f51f-4a73-aa26-4641a614508d req-c269359d-e8dc-4b5f-b65f-f4a509be66de service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received event network-changed-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-552cc9d0-f51f-4a73-aa26-4641a614508d req-c269359d-e8dc-4b5f-b65f-f4a509be66de service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Refreshing instance network info cache due to event network-changed-18fedb7c-3d67-4417-b0a3-d98b54df5150. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:57:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-552cc9d0-f51f-4a73-aa26-4641a614508d req-c269359d-e8dc-4b5f-b65f-f4a509be66de service nova] Acquiring lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:57:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-552cc9d0-f51f-4a73-aa26-4641a614508d req-c269359d-e8dc-4b5f-b65f-f4a509be66de service nova] Acquired lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:57:21 user nova-compute[73469]: DEBUG nova.network.neutron [req-552cc9d0-f51f-4a73-aa26-4641a614508d req-c269359d-e8dc-4b5f-b65f-f4a509be66de service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Refreshing network info cache for port 18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:57:21 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673026.569526, f478387d-e004-4314-961d-abf4a910e970 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:57:21 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: f478387d-e004-4314-961d-abf4a910e970] VM Stopped (Lifecycle Event)
Aug 22 02:57:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-2f5fa62c-0766-4762-b4f6-04b545b982f1 None None] [instance: f478387d-e004-4314-961d-abf4a910e970] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:57:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:22 user nova-compute[73469]: DEBUG nova.network.neutron [req-552cc9d0-f51f-4a73-aa26-4641a614508d req-c269359d-e8dc-4b5f-b65f-f4a509be66de service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Updated VIF entry in instance network info cache for port 18fedb7c-3d67-4417-b0a3-d98b54df5150. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:57:22 user nova-compute[73469]: DEBUG nova.network.neutron [req-552cc9d0-f51f-4a73-aa26-4641a614508d req-c269359d-e8dc-4b5f-b65f-f4a509be66de service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Updating instance_info_cache with network_info: [{"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:57:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-552cc9d0-f51f-4a73-aa26-4641a614508d req-c269359d-e8dc-4b5f-b65f-f4a509be66de service nova] Releasing lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:57:22 user nova-compute[73469]: DEBUG nova.compute.manager [req-a96cdf5c-0799-4b84-94ce-8d58949eeadb req-0b8fe562-48f8-42ca-9351-9c469502f013 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-deleted-4f06a837-3e8c-4362-814a-3b9cd8085a05 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:22 user nova-compute[73469]: INFO nova.compute.manager [req-a96cdf5c-0799-4b84-94ce-8d58949eeadb req-0b8fe562-48f8-42ca-9351-9c469502f013 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Neutron deleted interface 4f06a837-3e8c-4362-814a-3b9cd8085a05; detaching it from the instance and deleting it from the info cache
Aug 22 02:57:22 user nova-compute[73469]: DEBUG nova.network.neutron [req-a96cdf5c-0799-4b84-94ce-8d58949eeadb req-0b8fe562-48f8-42ca-9351-9c469502f013 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Updating instance_info_cache with network_info: [{"id": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "address": "fa:16:3e:d4:b8:e1", "network": {"id": "f37e6636-5a5f-4465-91c5-6f305460d1d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903703061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d8e796-6f", "ovs_interfaceid": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "address": "fa:16:3e:97:ea:4f", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf962364e-a4", "ovs_interfaceid": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6af318a1-2ecf-4320-933c-4836f592367a", "address": "fa:16:3e:08:32:58", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af318a1-2e", "ovs_interfaceid": "6af318a1-2ecf-4320-933c-4836f592367a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "address": "fa:16:3e:fe:42:04", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f58efb2-2f", "ovs_interfaceid": "0f58efb2-2fd2-42d0-a2db-f7b821677d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45e4812b-ca27-47b3-b289-63089cb11e00", "address": "fa:16:3e:a7:8f:57", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e4812b-ca", "ovs_interfaceid": "45e4812b-ca27-47b3-b289-63089cb11e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "address": "fa:16:3e:d6:db:55", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc301cc-bb", "ovs_interfaceid": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:57:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-a96cdf5c-0799-4b84-94ce-8d58949eeadb req-0b8fe562-48f8-42ca-9351-9c469502f013 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Detach interface failed, port_id=4f06a837-3e8c-4362-814a-3b9cd8085a05, reason: Instance 28e78814-0990-49e4-a6e7-e209276d2e46 could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 02:57:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-a96cdf5c-0799-4b84-94ce-8d58949eeadb req-0b8fe562-48f8-42ca-9351-9c469502f013 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-deleted-0f58efb2-2fd2-42d0-a2db-f7b821677d19 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:23 user nova-compute[73469]: INFO nova.compute.manager [req-a96cdf5c-0799-4b84-94ce-8d58949eeadb req-0b8fe562-48f8-42ca-9351-9c469502f013 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Neutron deleted interface 0f58efb2-2fd2-42d0-a2db-f7b821677d19; detaching it from the instance and deleting it from the info cache
Aug 22 02:57:23 user nova-compute[73469]: DEBUG nova.network.neutron [req-a96cdf5c-0799-4b84-94ce-8d58949eeadb req-0b8fe562-48f8-42ca-9351-9c469502f013 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Updating instance_info_cache with network_info: [{"id": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "address": "fa:16:3e:d4:b8:e1", "network": {"id": "f37e6636-5a5f-4465-91c5-6f305460d1d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903703061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d8e796-6f", "ovs_interfaceid": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "address": "fa:16:3e:97:ea:4f", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf962364e-a4", "ovs_interfaceid": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6af318a1-2ecf-4320-933c-4836f592367a", "address": "fa:16:3e:08:32:58", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af318a1-2e", "ovs_interfaceid": "6af318a1-2ecf-4320-933c-4836f592367a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45e4812b-ca27-47b3-b289-63089cb11e00", "address": "fa:16:3e:a7:8f:57", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e4812b-ca", "ovs_interfaceid": "45e4812b-ca27-47b3-b289-63089cb11e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "address": "fa:16:3e:d6:db:55", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc301cc-bb", "ovs_interfaceid": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:57:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-a96cdf5c-0799-4b84-94ce-8d58949eeadb req-0b8fe562-48f8-42ca-9351-9c469502f013 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Detach interface failed, port_id=0f58efb2-2fd2-42d0-a2db-f7b821677d19, reason: Instance 28e78814-0990-49e4-a6e7-e209276d2e46 could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 02:57:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-a96cdf5c-0799-4b84-94ce-8d58949eeadb req-0b8fe562-48f8-42ca-9351-9c469502f013 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-deleted-45e4812b-ca27-47b3-b289-63089cb11e00 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:23 user nova-compute[73469]: INFO nova.compute.manager [req-a96cdf5c-0799-4b84-94ce-8d58949eeadb req-0b8fe562-48f8-42ca-9351-9c469502f013 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Neutron deleted interface 45e4812b-ca27-47b3-b289-63089cb11e00; detaching it from the instance and deleting it from the info cache
Aug 22 02:57:23 user nova-compute[73469]: DEBUG nova.network.neutron [req-a96cdf5c-0799-4b84-94ce-8d58949eeadb req-0b8fe562-48f8-42ca-9351-9c469502f013 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Updating instance_info_cache with network_info: [{"id": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "address": "fa:16:3e:d4:b8:e1", "network": {"id": "f37e6636-5a5f-4465-91c5-6f305460d1d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903703061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d8e796-6f", "ovs_interfaceid": "d4d8e796-6ff5-4094-aab4-3efd059b5645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "address": "fa:16:3e:97:ea:4f", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf962364e-a4", "ovs_interfaceid": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6af318a1-2ecf-4320-933c-4836f592367a", "address": "fa:16:3e:08:32:58", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af318a1-2e", "ovs_interfaceid": "6af318a1-2ecf-4320-933c-4836f592367a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "address": "fa:16:3e:d6:db:55", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc301cc-bb", "ovs_interfaceid": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:57:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-a96cdf5c-0799-4b84-94ce-8d58949eeadb req-0b8fe562-48f8-42ca-9351-9c469502f013 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Detach interface failed, port_id=45e4812b-ca27-47b3-b289-63089cb11e00, reason: Instance 28e78814-0990-49e4-a6e7-e209276d2e46 could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 02:57:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-a96cdf5c-0799-4b84-94ce-8d58949eeadb req-0b8fe562-48f8-42ca-9351-9c469502f013 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-deleted-d4d8e796-6ff5-4094-aab4-3efd059b5645 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:23 user nova-compute[73469]: INFO nova.compute.manager [req-a96cdf5c-0799-4b84-94ce-8d58949eeadb req-0b8fe562-48f8-42ca-9351-9c469502f013 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Neutron deleted interface d4d8e796-6ff5-4094-aab4-3efd059b5645; detaching it from the instance and deleting it from the info cache
Aug 22 02:57:23 user nova-compute[73469]: DEBUG nova.network.neutron [req-a96cdf5c-0799-4b84-94ce-8d58949eeadb req-0b8fe562-48f8-42ca-9351-9c469502f013 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Updating instance_info_cache with network_info: [{"id": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "address": "fa:16:3e:97:ea:4f", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf962364e-a4", "ovs_interfaceid": "f962364e-a4e1-4d88-b7b5-5dcc07eb8220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6af318a1-2ecf-4320-933c-4836f592367a", "address": "fa:16:3e:08:32:58", "network": {"id": "23c6d28e-7284-4d8b-baec-88b1c1a0be7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-602722488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af318a1-2e", "ovs_interfaceid": "6af318a1-2ecf-4320-933c-4836f592367a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "address": "fa:16:3e:d6:db:55", "network": {"id": "eece3552-98b8-41f1-ae19-9575fb5529b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088030563", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7630ab68804e4d79b0a136f5c6236ea4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc301cc-bb", "ovs_interfaceid": "cbc301cc-bb85-4871-b3bf-d4dfc54c99ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:57:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-a96cdf5c-0799-4b84-94ce-8d58949eeadb req-0b8fe562-48f8-42ca-9351-9c469502f013 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Detach interface failed, port_id=d4d8e796-6ff5-4094-aab4-3efd059b5645, reason: Instance 28e78814-0990-49e4-a6e7-e209276d2e46 could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 02:57:23 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:57:23 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Took 4.14 seconds to deallocate network for instance.
Aug 22 02:57:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-2c32860e-8f09-437a-ad37-554c5d4ab39a req-0d6573f2-6413-4a9f-8a83-01068240d5b6 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received event network-changed-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-2c32860e-8f09-437a-ad37-554c5d4ab39a req-0d6573f2-6413-4a9f-8a83-01068240d5b6 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Refreshing instance network info cache due to event network-changed-18fedb7c-3d67-4417-b0a3-d98b54df5150. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:57:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2c32860e-8f09-437a-ad37-554c5d4ab39a req-0d6573f2-6413-4a9f-8a83-01068240d5b6 service nova] Acquiring lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:57:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2c32860e-8f09-437a-ad37-554c5d4ab39a req-0d6573f2-6413-4a9f-8a83-01068240d5b6 service nova] Acquired lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:57:24 user nova-compute[73469]: DEBUG nova.network.neutron [req-2c32860e-8f09-437a-ad37-554c5d4ab39a req-0d6573f2-6413-4a9f-8a83-01068240d5b6 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Refreshing network info cache for port 18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:57:25 user nova-compute[73469]: DEBUG nova.compute.manager [req-c78f426a-e1b7-414f-a83e-0a062210d22b req-1a81fb3d-da5f-417d-a18d-91833a048dd1 service nova] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Received event network-vif-deleted-cbc301cc-bb85-4871-b3bf-d4dfc54c99ba {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:25 user nova-compute[73469]: DEBUG nova.network.neutron [req-2c32860e-8f09-437a-ad37-554c5d4ab39a req-0d6573f2-6413-4a9f-8a83-01068240d5b6 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Updated VIF entry in instance network info cache for port 18fedb7c-3d67-4417-b0a3-d98b54df5150. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:57:25 user nova-compute[73469]: DEBUG nova.network.neutron [req-2c32860e-8f09-437a-ad37-554c5d4ab39a req-0d6573f2-6413-4a9f-8a83-01068240d5b6 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Updating instance_info_cache with network_info: [{"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:57:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2c32860e-8f09-437a-ad37-554c5d4ab39a req-0d6573f2-6413-4a9f-8a83-01068240d5b6 service nova] Releasing lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:57:25 user nova-compute[73469]: INFO nova.compute.manager [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Rescuing
Aug 22 02:57:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:57:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquired lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:57:25 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:57:25 user nova-compute[73469]: INFO nova.compute.manager [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Took 2.55 seconds to detach 3 volumes for instance.
Aug 22 02:57:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:26 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Updating instance_info_cache with network_info: [{"id": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "address": "fa:16:3e:8e:27:47", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6148435c-1c", "ovs_interfaceid": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:57:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Releasing lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:57:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:26 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:57:26 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:57:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:26 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Deleted allocations for instance 28e78814-0990-49e4-a6e7-e209276d2e46
Aug 22 02:57:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-68b60bd8-1c25-4252-9abb-cceac66beb4d tempest-TaggedBootDevicesTest-98908978 tempest-TaggedBootDevicesTest-98908978-project-member] Lock "28e78814-0990-49e4-a6e7-e209276d2e46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.723s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:26 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Instance destroyed successfully.
Aug 22 02:57:26 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Attempting rescue
Aug 22 02:57:26 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73469) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 22 02:57:26 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Instance directory exists: not creating {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 22 02:57:26 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Creating image(s)
Aug 22 02:57:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "/opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "/opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:26 user nova-compute[73469]: DEBUG nova.objects.instance [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9d0668c0-7a49-4857-9b69-541021f18ab2 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.191s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk.rescue {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk.rescue" returned: 0 in 0.055s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.objects.instance [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'migration_context' on Instance uuid 9d0668c0-7a49-4857-9b69-541021f18ab2 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Start _get_guest_xml network_info=[{"id": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "address": "fa:16:3e:8e:27:47", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "vif_mac": "fa:16:3e:8e:27:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6148435c-1c", "ovs_interfaceid": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.objects.instance [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'resources' on Instance uuid 9d0668c0-7a49-4857-9b69-541021f18ab2 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.objects.instance [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'numa_topology' on Instance uuid 9d0668c0-7a49-4857-9b69-541021f18ab2 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-038be7bf-78d7-40d1-886c-ad23d3d53343 req-04b9f8a9-5af6-4fb4-b98d-da9d5fad442a service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received event network-vif-unplugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-038be7bf-78d7-40d1-886c-ad23d3d53343 req-04b9f8a9-5af6-4fb4-b98d-da9d5fad442a service nova] Acquiring lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-038be7bf-78d7-40d1-886c-ad23d3d53343 req-04b9f8a9-5af6-4fb4-b98d-da9d5fad442a service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-038be7bf-78d7-40d1-886c-ad23d3d53343 req-04b9f8a9-5af6-4fb4-b98d-da9d5fad442a service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-038be7bf-78d7-40d1-886c-ad23d3d53343 req-04b9f8a9-5af6-4fb4-b98d-da9d5fad442a service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] No waiting events found dispatching network-vif-unplugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:27 user nova-compute[73469]: WARNING nova.compute.manager [req-038be7bf-78d7-40d1-886c-ad23d3d53343 req-04b9f8a9-5af6-4fb4-b98d-da9d5fad442a service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received unexpected event network-vif-unplugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 for instance with vm_state active and task_state rescuing.
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-038be7bf-78d7-40d1-886c-ad23d3d53343 req-04b9f8a9-5af6-4fb4-b98d-da9d5fad442a service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received event network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-038be7bf-78d7-40d1-886c-ad23d3d53343 req-04b9f8a9-5af6-4fb4-b98d-da9d5fad442a service nova] Acquiring lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-038be7bf-78d7-40d1-886c-ad23d3d53343 req-04b9f8a9-5af6-4fb4-b98d-da9d5fad442a service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-038be7bf-78d7-40d1-886c-ad23d3d53343 req-04b9f8a9-5af6-4fb4-b98d-da9d5fad442a service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-038be7bf-78d7-40d1-886c-ad23d3d53343 req-04b9f8a9-5af6-4fb4-b98d-da9d5fad442a service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] No waiting events found dispatching network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:27 user nova-compute[73469]: WARNING nova.compute.manager [req-038be7bf-78d7-40d1-886c-ad23d3d53343 req-04b9f8a9-5af6-4fb4-b98d-da9d5fad442a service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received unexpected event network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 for instance with vm_state active and task_state rescuing.
Aug 22 02:57:27 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:57:27 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.objects.instance [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9d0668c0-7a49-4857-9b69-541021f18ab2 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1254960621',display_name='tempest-ServerRescueNegativeTestJSON-server-1254960621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1254960621',id=2,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:52:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46cd52eb0f2642bc95dbf216ae280e12',ramdisk_id='',reservation_id='r-ijl84rjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2020570120',owner_user_name='tempest-ServerRescueNegativeTestJSON-2020570120-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:52:58Z,user_data=None,user_id='64b023ffba814ac5b6a3bc4666107767',uuid=9d0668c0-7a49-4857-9b69-541021f18ab2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "address": "fa:16:3e:8e:27:47", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "vif_mac": "fa:16:3e:8e:27:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6148435c-1c", "ovs_interfaceid": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converting VIF {"id": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "address": "fa:16:3e:8e:27:47", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "vif_mac": "fa:16:3e:8e:27:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6148435c-1c", "ovs_interfaceid": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:27:47,bridge_name='br-int',has_traffic_filtering=True,id=6148435c-1cc6-4d56-baa1-4cfb2b3924f6,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6148435c-1c') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.objects.instance [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d0668c0-7a49-4857-9b69-541021f18ab2 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:57:27 user nova-compute[73469]:   <uuid>9d0668c0-7a49-4857-9b69-541021f18ab2</uuid>
Aug 22 02:57:27 user nova-compute[73469]:   <name>instance-00000002</name>
Aug 22 02:57:27 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:57:27 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:57:27 user nova-compute[73469]:   <metadata>
Aug 22 02:57:27 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:57:27 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:57:27 user nova-compute[73469]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1254960621</nova:name>
Aug 22 02:57:27 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:57:27</nova:creationTime>
Aug 22 02:57:27 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:57:27 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:57:27 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:57:27 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:57:27 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:57:27 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:57:27 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:57:27 user nova-compute[73469]:       <nova:owner>
Aug 22 02:57:27 user nova-compute[73469]:         <nova:user uuid="64b023ffba814ac5b6a3bc4666107767">tempest-ServerRescueNegativeTestJSON-2020570120-project-member</nova:user>
Aug 22 02:57:27 user nova-compute[73469]:         <nova:project uuid="46cd52eb0f2642bc95dbf216ae280e12">tempest-ServerRescueNegativeTestJSON-2020570120</nova:project>
Aug 22 02:57:27 user nova-compute[73469]:       </nova:owner>
Aug 22 02:57:27 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:57:27 user nova-compute[73469]:       <nova:ports>
Aug 22 02:57:27 user nova-compute[73469]:         <nova:port uuid="6148435c-1cc6-4d56-baa1-4cfb2b3924f6">
Aug 22 02:57:27 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 22 02:57:27 user nova-compute[73469]:         </nova:port>
Aug 22 02:57:27 user nova-compute[73469]:       </nova:ports>
Aug 22 02:57:27 user nova-compute[73469]:     </nova:instance>
Aug 22 02:57:27 user nova-compute[73469]:   </metadata>
Aug 22 02:57:27 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:57:27 user nova-compute[73469]:     <system>
Aug 22 02:57:27 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:57:27 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:57:27 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:57:27 user nova-compute[73469]:       <entry name="serial">9d0668c0-7a49-4857-9b69-541021f18ab2</entry>
Aug 22 02:57:27 user nova-compute[73469]:       <entry name="uuid">9d0668c0-7a49-4857-9b69-541021f18ab2</entry>
Aug 22 02:57:27 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:57:27 user nova-compute[73469]:     </system>
Aug 22 02:57:27 user nova-compute[73469]:   </sysinfo>
Aug 22 02:57:27 user nova-compute[73469]:   <os>
Aug 22 02:57:27 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:57:27 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:57:27 user nova-compute[73469]:   </os>
Aug 22 02:57:27 user nova-compute[73469]:   <features>
Aug 22 02:57:27 user nova-compute[73469]:     <acpi/>
Aug 22 02:57:27 user nova-compute[73469]:     <apic/>
Aug 22 02:57:27 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:57:27 user nova-compute[73469]:   </features>
Aug 22 02:57:27 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:57:27 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:57:27 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:57:27 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:57:27 user nova-compute[73469]:   </clock>
Aug 22 02:57:27 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:57:27 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:57:27 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:57:27 user nova-compute[73469]:   </cpu>
Aug 22 02:57:27 user nova-compute[73469]:   <devices>
Aug 22 02:57:27 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:57:27 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:57:27 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk.rescue"/>
Aug 22 02:57:27 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:57:27 user nova-compute[73469]:     </disk>
Aug 22 02:57:27 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:57:27 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:57:27 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk"/>
Aug 22 02:57:27 user nova-compute[73469]:       <target dev="vdb" bus="virtio"/>
Aug 22 02:57:27 user nova-compute[73469]:     </disk>
Aug 22 02:57:27 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:57:27 user nova-compute[73469]:       <mac address="fa:16:3e:8e:27:47"/>
Aug 22 02:57:27 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:57:27 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:57:27 user nova-compute[73469]:       <target dev="tap6148435c-1c"/>
Aug 22 02:57:27 user nova-compute[73469]:     </interface>
Aug 22 02:57:27 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:57:27 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/console.log" append="off"/>
Aug 22 02:57:27 user nova-compute[73469]:     </serial>
Aug 22 02:57:27 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:57:27 user nova-compute[73469]:     <video>
Aug 22 02:57:27 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:57:27 user nova-compute[73469]:     </video>
Aug 22 02:57:27 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:57:27 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:57:27 user nova-compute[73469]:     </rng>
Aug 22 02:57:27 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:57:27 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:57:27 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:57:27 user nova-compute[73469]:     </memballoon>
Aug 22 02:57:27 user nova-compute[73469]:   </devices>
Aug 22 02:57:27 user nova-compute[73469]: </domain>
Aug 22 02:57:27 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:57:27 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Instance destroyed successfully.
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] No VIF found with MAC fa:16:3e:8e:27:47, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:57:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:29 user nova-compute[73469]: DEBUG nova.compute.manager [req-a5744d7e-a77c-43d6-bbb4-aed86e92521e req-8e6434bb-4b54-4ed5-beed-ed23a2d52dd9 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received event network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a5744d7e-a77c-43d6-bbb4-aed86e92521e req-8e6434bb-4b54-4ed5-beed-ed23a2d52dd9 service nova] Acquiring lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a5744d7e-a77c-43d6-bbb4-aed86e92521e req-8e6434bb-4b54-4ed5-beed-ed23a2d52dd9 service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a5744d7e-a77c-43d6-bbb4-aed86e92521e req-8e6434bb-4b54-4ed5-beed-ed23a2d52dd9 service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:29 user nova-compute[73469]: DEBUG nova.compute.manager [req-a5744d7e-a77c-43d6-bbb4-aed86e92521e req-8e6434bb-4b54-4ed5-beed-ed23a2d52dd9 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] No waiting events found dispatching network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:29 user nova-compute[73469]: WARNING nova.compute.manager [req-a5744d7e-a77c-43d6-bbb4-aed86e92521e req-8e6434bb-4b54-4ed5-beed-ed23a2d52dd9 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received unexpected event network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 for instance with vm_state active and task_state rescuing.
Aug 22 02:57:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:29 user nova-compute[73469]: INFO nova.compute.manager [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Rescuing
Aug 22 02:57:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "refresh_cache-8242cec1-3b35-4d14-9e0b-db8a7e75697d" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:57:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquired lock "refresh_cache-8242cec1-3b35-4d14-9e0b-db8a7e75697d" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:57:29 user nova-compute[73469]: DEBUG nova.network.neutron [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:57:30 user nova-compute[73469]: DEBUG nova.network.neutron [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Updating instance_info_cache with network_info: [{"id": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "address": "fa:16:3e:4f:6e:44", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec640a77-a1", "ovs_interfaceid": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:57:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Releasing lock "refresh_cache-8242cec1-3b35-4d14-9e0b-db8a7e75697d" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:57:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Instance destroyed successfully.
Aug 22 02:57:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Attempting a stable device rescue
Aug 22 02:57:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73469) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 22 02:57:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Instance directory exists: not creating {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 22 02:57:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Creating image(s)
Aug 22 02:57:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "/opt/stack/data/nova/instances/8242cec1-3b35-4d14-9e0b-db8a7e75697d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "/opt/stack/data/nova/instances/8242cec1-3b35-4d14-9e0b-db8a7e75697d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "/opt/stack/data/nova/instances/8242cec1-3b35-4d14-9e0b-db8a7e75697d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:31 user nova-compute[73469]: DEBUG nova.objects.instance [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8242cec1-3b35-4d14-9e0b-db8a7e75697d {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "69f43ca870176f5696a6ffbd09c7d8bf27c566ad" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "69f43ca870176f5696a6ffbd09c7d8bf27c566ad" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Removed pending event for 9d0668c0-7a49-4857-9b69-541021f18ab2 due to event {{(pid=73469) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 22 02:57:31 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673051.1692216, 9d0668c0-7a49-4857-9b69-541021f18ab2 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:57:31 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] VM Resumed (Lifecycle Event)
Aug 22 02:57:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6e9ad73e-39e4-411a-b6c6-204c3d8202da tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:57:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f43ca870176f5696a6ffbd09c7d8bf27c566ad.part --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-1e2211bd-b06c-49fb-bddc-c8c3af6681f1 req-97c81b17-294e-4846-a62f-6069f015df35 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received event network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1e2211bd-b06c-49fb-bddc-c8c3af6681f1 req-97c81b17-294e-4846-a62f-6069f015df35 service nova] Acquiring lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1e2211bd-b06c-49fb-bddc-c8c3af6681f1 req-97c81b17-294e-4846-a62f-6069f015df35 service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1e2211bd-b06c-49fb-bddc-c8c3af6681f1 req-97c81b17-294e-4846-a62f-6069f015df35 service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-1e2211bd-b06c-49fb-bddc-c8c3af6681f1 req-97c81b17-294e-4846-a62f-6069f015df35 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] No waiting events found dispatching network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:32 user nova-compute[73469]: WARNING nova.compute.manager [req-1e2211bd-b06c-49fb-bddc-c8c3af6681f1 req-97c81b17-294e-4846-a62f-6069f015df35 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received unexpected event network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 for instance with vm_state rescued and task_state None.
Aug 22 02:57:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-1e2211bd-b06c-49fb-bddc-c8c3af6681f1 req-97c81b17-294e-4846-a62f-6069f015df35 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received event network-vif-unplugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1e2211bd-b06c-49fb-bddc-c8c3af6681f1 req-97c81b17-294e-4846-a62f-6069f015df35 service nova] Acquiring lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1e2211bd-b06c-49fb-bddc-c8c3af6681f1 req-97c81b17-294e-4846-a62f-6069f015df35 service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1e2211bd-b06c-49fb-bddc-c8c3af6681f1 req-97c81b17-294e-4846-a62f-6069f015df35 service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-1e2211bd-b06c-49fb-bddc-c8c3af6681f1 req-97c81b17-294e-4846-a62f-6069f015df35 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] No waiting events found dispatching network-vif-unplugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:32 user nova-compute[73469]: WARNING nova.compute.manager [req-1e2211bd-b06c-49fb-bddc-c8c3af6681f1 req-97c81b17-294e-4846-a62f-6069f015df35 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received unexpected event network-vif-unplugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 for instance with vm_state active and task_state rescuing.
Aug 22 02:57:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-1e2211bd-b06c-49fb-bddc-c8c3af6681f1 req-97c81b17-294e-4846-a62f-6069f015df35 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received event network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1e2211bd-b06c-49fb-bddc-c8c3af6681f1 req-97c81b17-294e-4846-a62f-6069f015df35 service nova] Acquiring lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1e2211bd-b06c-49fb-bddc-c8c3af6681f1 req-97c81b17-294e-4846-a62f-6069f015df35 service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1e2211bd-b06c-49fb-bddc-c8c3af6681f1 req-97c81b17-294e-4846-a62f-6069f015df35 service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-1e2211bd-b06c-49fb-bddc-c8c3af6681f1 req-97c81b17-294e-4846-a62f-6069f015df35 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] No waiting events found dispatching network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:32 user nova-compute[73469]: WARNING nova.compute.manager [req-1e2211bd-b06c-49fb-bddc-c8c3af6681f1 req-97c81b17-294e-4846-a62f-6069f015df35 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received unexpected event network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 for instance with vm_state active and task_state rescuing.
Aug 22 02:57:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673051.1735952, 9d0668c0-7a49-4857-9b69-541021f18ab2 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:57:32 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] VM Started (Lifecycle Event)
Aug 22 02:57:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f43ca870176f5696a6ffbd09c7d8bf27c566ad.part --force-share --output=json" returned: 0 in 0.184s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG nova.virt.images [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] 6ee1a307-1886-45e5-9250-f0f795b82615 was qcow2, converting to raw {{(pid=73469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG nova.privsep.utils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/69f43ca870176f5696a6ffbd09c7d8bf27c566ad.part /opt/stack/data/nova/instances/_base/69f43ca870176f5696a6ffbd09c7d8bf27c566ad.converted {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673037.6451936, 28e78814-0990-49e4-a6e7-e209276d2e46 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:57:32 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] VM Stopped (Lifecycle Event)
Aug 22 02:57:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-08a55c1c-1eb2-4f69-8eb8-5e4c77a6a04f None None] [instance: 28e78814-0990-49e4-a6e7-e209276d2e46] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/69f43ca870176f5696a6ffbd09c7d8bf27c566ad.part /opt/stack/data/nova/instances/_base/69f43ca870176f5696a6ffbd09c7d8bf27c566ad.converted" returned: 0 in 0.418s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f43ca870176f5696a6ffbd09c7d8bf27c566ad.converted --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f43ca870176f5696a6ffbd09c7d8bf27c566ad.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "69f43ca870176f5696a6ffbd09c7d8bf27c566ad" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.884s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "69f43ca870176f5696a6ffbd09c7d8bf27c566ad" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "69f43ca870176f5696a6ffbd09c7d8bf27c566ad" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f43ca870176f5696a6ffbd09c7d8bf27c566ad --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f43ca870176f5696a6ffbd09c7d8bf27c566ad --force-share --output=json" returned: 0 in 0.278s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f43ca870176f5696a6ffbd09c7d8bf27c566ad,backing_fmt=raw /opt/stack/data/nova/instances/8242cec1-3b35-4d14-9e0b-db8a7e75697d/disk.rescue {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f43ca870176f5696a6ffbd09c7d8bf27c566ad,backing_fmt=raw /opt/stack/data/nova/instances/8242cec1-3b35-4d14-9e0b-db8a7e75697d/disk.rescue" returned: 0 in 0.066s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "69f43ca870176f5696a6ffbd09c7d8bf27c566ad" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.350s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.objects.instance [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'migration_context' on Instance uuid 8242cec1-3b35-4d14-9e0b-db8a7e75697d {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Start _get_guest_xml network_info=[{"id": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "address": "fa:16:3e:4f:6e:44", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "vif_mac": "fa:16:3e:4f:6e:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec640a77-a1", "ovs_interfaceid": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6ee1a307-1886-45e5-9250-f0f795b82615', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '6dd5e17c-9da2-4b74-95df-533931b546e0', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLtMIbzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '8242cec1-3b35-4d14-9e0b-db8a7e75697d', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb3d151e-571e-44c9-b33f-3d8b146c0461', 'serial': 'fb3d151e-571e-44c9-b33f-3d8b146c0461'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.objects.instance [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'resources' on Instance uuid 8242cec1-3b35-4d14-9e0b-db8a7e75697d {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:33 user nova-compute[73469]: INFO nova.compute.manager [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Rebooting instance
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.objects.instance [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'numa_topology' on Instance uuid 8242cec1-3b35-4d14-9e0b-db8a7e75697d {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.compute.manager [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquired lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:57:33 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:57:33 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.objects.instance [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8242cec1-3b35-4d14-9e0b-db8a7e75697d {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLtMIbzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:57:33 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:57:33 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:57:33 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[651ab816-e97d-4883-b458-5a965f6d73e5]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ZLtMIbzR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 22 02:57:33 user nova-compute[73469]: node.name = iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461
Aug 22 02:57:33 user nova-compute[73469]: node.tpgt = -1
Aug 22 02:57:33 user nova-compute[73469]: node.startup = automatic
Aug 22 02:57:33 user nova-compute[73469]: node.leading_login = No
Aug 22 02:57:33 user nova-compute[73469]: iface.iscsi_ifacename = default
Aug 22 02:57:33 user nova-compute[73469]: iface.net_ifacename = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.ipaddress = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.prefix_len = 0
Aug 22 02:57:33 user nova-compute[73469]: iface.hwaddress = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.transport_name = tcp
Aug 22 02:57:33 user nova-compute[73469]: iface.initiatorname = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.state = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.vlan_id = 0
Aug 22 02:57:33 user nova-compute[73469]: iface.vlan_priority = 0
Aug 22 02:57:33 user nova-compute[73469]: iface.vlan_state = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.iface_num = 0
Aug 22 02:57:33 user nova-compute[73469]: iface.mtu = 0
Aug 22 02:57:33 user nova-compute[73469]: iface.port = 0
Aug 22 02:57:33 user nova-compute[73469]: iface.bootproto = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.subnet_mask = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.gateway = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.dhcp_alt_client_id_state = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.dhcp_alt_client_id = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.dhcp_dns = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.dhcp_learn_iqn = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.dhcp_req_vendor_id_state = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.dhcp_vendor_id_state = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.dhcp_vendor_id = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.dhcp_slp_da = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.fragmentation = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.gratuitous_arp = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.incoming_forwarding = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.tos_state = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.tos = 0
Aug 22 02:57:33 user nova-compute[73469]: iface.ttl = 0
Aug 22 02:57:33 user nova-compute[73469]: iface.delayed_ack = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.tcp_nagle = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.tcp_wsf_state = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.tcp_wsf = 0
Aug 22 02:57:33 user nova-compute[73469]: iface.tcp_timer_scale = 0
Aug 22 02:57:33 user nova-compute[73469]: iface.tcp_timestamp = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.redirect = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.def_task_mgmt_timeout = 0
Aug 22 02:57:33 user nova-compute[73469]: iface.header_digest = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.data_digest = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.immediate_data = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.initial_r2t = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.data_seq_inorder = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.data_pdu_inorder = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.erl = 0
Aug 22 02:57:33 user nova-compute[73469]: iface.max_receive_data_len = 0
Aug 22 02:57:33 user nova-compute[73469]: iface.first_burst_len = 0
Aug 22 02:57:33 user nova-compute[73469]: iface.max_outstanding_r2t = 0
Aug 22 02:57:33 user nova-compute[73469]: iface.max_burst_len = 0
Aug 22 02:57:33 user nova-compute[73469]: iface.chap_auth = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.bidi_chap = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.strict_login_compliance = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.discovery_auth = <empty>
Aug 22 02:57:33 user nova-compute[73469]: iface.discovery_logout = <empty>
Aug 22 02:57:33 user nova-compute[73469]: node.discovery_address = <empty>
Aug 22 02:57:33 user nova-compute[73469]: node.discovery_port = 0
Aug 22 02:57:33 user nova-compute[73469]: node.discovery_type = static
Aug 22 02:57:33 user nova-compute[73469]: node.session.initial_cmdsn = 0
Aug 22 02:57:33 user nova-compute[73469]: node.session.initial_login_retry_max = 8
Aug 22 02:57:33 user nova-compute[73469]: node.session.xmit_thread_priority = -20
Aug 22 02:57:33 user nova-compute[73469]: node.session.cmds_max = 128
Aug 22 02:57:33 user nova-compute[73469]: node.session.queue_depth = 32
Aug 22 02:57:33 user nova-compute[73469]: node.session.nr_sessions = 1
Aug 22 02:57:33 user nova-compute[73469]: node.session.auth.authmethod = CHAP
Aug 22 02:57:33 user nova-compute[73469]: node.session.auth.username = ZLtMIbzR
Aug 22 02:57:33 user nova-compute[73469]: node.session.auth.password = ***
Aug 22 02:57:33 user nova-compute[73469]: node.session.auth.username_in = <empty>
Aug 22 02:57:33 user nova-compute[73469]: node.session.auth.password_in = <empty>
Aug 22 02:57:33 user nova-compute[73469]: node.session.auth.chap_algs = MD5
Aug 22 02:57:33 user nova-compute[73469]: node.session.timeo.replacement_timeout = 120
Aug 22 02:57:33 user nova-compute[73469]: node.session.err_timeo.abort_timeout = 15
Aug 22 02:57:33 user nova-compute[73469]: node.session.err_timeo.lu_reset_timeout = 30
Aug 22 02:57:33 user nova-compute[73469]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 22 02:57:33 user nova-compute[73469]: node.session.err_timeo.host_reset_timeout = 60
Aug 22 02:57:33 user nova-compute[73469]: node.session.iscsi.FastAbort = Yes
Aug 22 02:57:33 user nova-compute[73469]: node.session.iscsi.InitialR2T = No
Aug 22 02:57:33 user nova-compute[73469]: node.session.iscsi.ImmediateData = Yes
Aug 22 02:57:33 user nova-compute[73469]: node.session.iscsi.FirstBurstLength = 262144
Aug 22 02:57:33 user nova-compute[73469]: node.session.iscsi.MaxBurstLength = 16776192
Aug 22 02:57:33 user nova-compute[73469]: node.session.iscsi.DefaultTime2Retain = 0
Aug 22 02:57:33 user nova-compute[73469]: node.session.iscsi.DefaultTime2Wait = 2
Aug 22 02:57:33 user nova-compute[73469]: node.session.iscsi.MaxConnections = 1
Aug 22 02:57:33 user nova-compute[73469]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 22 02:57:33 user nova-compute[73469]: node.session.iscsi.ERL = 0
Aug 22 02:57:33 user nova-compute[73469]: node.session.scan = manual
Aug 22 02:57:33 user nova-compute[73469]: node.session.reopen_max = 0
Aug 22 02:57:33 user nova-compute[73469]: node.conn[0].address = 172.16.0.220
Aug 22 02:57:33 user nova-compute[73469]: node.conn[0].port = 3260
Aug 22 02:57:33 user nova-compute[73469]: node.conn[0].startup = manual
Aug 22 02:57:33 user nova-compute[73469]: node.conn[0].tcp.window_size = 524288
Aug 22 02:57:33 user nova-compute[73469]: node.conn[0].tcp.type_of_service = 0
Aug 22 02:57:33 user nova-compute[73469]: node.conn[0].timeo.logout_timeout = 15
Aug 22 02:57:33 user nova-compute[73469]: node.conn[0].timeo.login_timeout = 15
Aug 22 02:57:33 user nova-compute[73469]: node.conn[0].timeo.auth_timeout = 45
Aug 22 02:57:33 user nova-compute[73469]: node.conn[0].timeo.noop_out_interval = 5
Aug 22 02:57:33 user nova-compute[73469]: node.conn[0].timeo.noop_out_timeout = 5
Aug 22 02:57:33 user nova-compute[73469]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 22 02:57:33 user nova-compute[73469]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 22 02:57:33 user nova-compute[73469]: node.conn[0].iscsi.HeaderDigest = None
Aug 22 02:57:33 user nova-compute[73469]: node.conn[0].iscsi.DataDigest = None
Aug 22 02:57:33 user nova-compute[73469]: node.conn[0].iscsi.IFMarker = No
Aug 22 02:57:33 user nova-compute[73469]: node.conn[0].iscsi.OFMarker = No
Aug 22 02:57:33 user nova-compute[73469]: # END RECORD
Aug 22 02:57:33 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[010ef32c-4692-443c-95af-a43f14102714]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:57:33 user nova-compute[73469]: INFO nova.compute.claims [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Claim successful on node user
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[584598a0-b0de-4e26-a03e-4480aeba7e89]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZLtMIbzR {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZLtMIbzR" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1859c31-119f-409b-90ab-ec5eff39b583]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZLtMIbzR'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f854d42-39a3-46ec-96cf-6129621127c9]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[50aa5338-6ed9-44c0-82ba-5568d1dad737]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:57:33 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:57:33 user nova-compute[73469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:57:33 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:57:33 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:57:33 user nova-compute[73469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:57:33 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.200s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] HCTL ('34', '0', '0', 0) found on session 12 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b1acf9-5d3e-4c84-b3d8-eb6bbde2e1a8]: (4, ('0 0 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Searching for a device in session 12 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLtMIbzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.284s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] <== connect_volume: return (285ms) {'type': 'block', 'scsi_wwn': '26436386563333632', 'path': '/dev/sdc'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436386563333632', 'path': '/dev/sdc'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:55:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1769101267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1769101267',id=13,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:56:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9131cb883044191931dc31e51e94766',ramdisk_id='',reservation_id='r-d7zk2v2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568629509',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:56:05Z,user_data=None,user_id='a7b228f99c9e4d058e128a5a99636b7b',uuid=8242cec1-3b35-4d14-9e0b-db8a7e75697d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "address": "fa:16:3e:4f:6e:44", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "vif_mac": "fa:16:3e:4f:6e:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec640a77-a1", "ovs_interfaceid": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converting VIF {"id": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "address": "fa:16:3e:4f:6e:44", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "vif_mac": "fa:16:3e:4f:6e:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec640a77-a1", "ovs_interfaceid": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=ec640a77-a18c-41a2-aa5e-3eadf60f5e34,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec640a77-a1') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.objects.instance [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'pci_devices' on Instance uuid 8242cec1-3b35-4d14-9e0b-db8a7e75697d {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:57:33 user nova-compute[73469]:   <uuid>8242cec1-3b35-4d14-9e0b-db8a7e75697d</uuid>
Aug 22 02:57:33 user nova-compute[73469]:   <name>instance-0000000d</name>
Aug 22 02:57:33 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:57:33 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:57:33 user nova-compute[73469]:   <metadata>
Aug 22 02:57:33 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:57:33 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:57:33 user nova-compute[73469]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1769101267</nova:name>
Aug 22 02:57:33 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:57:33</nova:creationTime>
Aug 22 02:57:33 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:57:33 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:57:33 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:57:33 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:57:33 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:57:33 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:57:33 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:57:33 user nova-compute[73469]:       <nova:owner>
Aug 22 02:57:33 user nova-compute[73469]:         <nova:user uuid="a7b228f99c9e4d058e128a5a99636b7b">tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member</nova:user>
Aug 22 02:57:33 user nova-compute[73469]:         <nova:project uuid="c9131cb883044191931dc31e51e94766">tempest-ServerBootFromVolumeStableRescueTest-568629509</nova:project>
Aug 22 02:57:33 user nova-compute[73469]:       </nova:owner>
Aug 22 02:57:33 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:57:33 user nova-compute[73469]:       <nova:ports>
Aug 22 02:57:33 user nova-compute[73469]:         <nova:port uuid="ec640a77-a18c-41a2-aa5e-3eadf60f5e34">
Aug 22 02:57:33 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 22 02:57:33 user nova-compute[73469]:         </nova:port>
Aug 22 02:57:33 user nova-compute[73469]:       </nova:ports>
Aug 22 02:57:33 user nova-compute[73469]:     </nova:instance>
Aug 22 02:57:33 user nova-compute[73469]:   </metadata>
Aug 22 02:57:33 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:57:33 user nova-compute[73469]:     <system>
Aug 22 02:57:33 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:57:33 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:57:33 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:57:33 user nova-compute[73469]:       <entry name="serial">8242cec1-3b35-4d14-9e0b-db8a7e75697d</entry>
Aug 22 02:57:33 user nova-compute[73469]:       <entry name="uuid">8242cec1-3b35-4d14-9e0b-db8a7e75697d</entry>
Aug 22 02:57:33 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:57:33 user nova-compute[73469]:     </system>
Aug 22 02:57:33 user nova-compute[73469]:   </sysinfo>
Aug 22 02:57:33 user nova-compute[73469]:   <os>
Aug 22 02:57:33 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:57:33 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:57:33 user nova-compute[73469]:   </os>
Aug 22 02:57:33 user nova-compute[73469]:   <features>
Aug 22 02:57:33 user nova-compute[73469]:     <acpi/>
Aug 22 02:57:33 user nova-compute[73469]:     <apic/>
Aug 22 02:57:33 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:57:33 user nova-compute[73469]:   </features>
Aug 22 02:57:33 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:57:33 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:57:33 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:57:33 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:57:33 user nova-compute[73469]:   </clock>
Aug 22 02:57:33 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:57:33 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:57:33 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:57:33 user nova-compute[73469]:   </cpu>
Aug 22 02:57:33 user nova-compute[73469]:   <devices>
Aug 22 02:57:33 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 02:57:33 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:57:33 user nova-compute[73469]:       <source dev="/dev/sdc"/>
Aug 22 02:57:33 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:57:33 user nova-compute[73469]:       <serial>fb3d151e-571e-44c9-b33f-3d8b146c0461</serial>
Aug 22 02:57:33 user nova-compute[73469]:     </disk>
Aug 22 02:57:33 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:57:33 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:57:33 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/8242cec1-3b35-4d14-9e0b-db8a7e75697d/disk.rescue"/>
Aug 22 02:57:33 user nova-compute[73469]:       <target dev="vdb" bus="virtio"/>
Aug 22 02:57:33 user nova-compute[73469]:       <boot order="1"/>
Aug 22 02:57:33 user nova-compute[73469]:     </disk>
Aug 22 02:57:33 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:57:33 user nova-compute[73469]:       <mac address="fa:16:3e:4f:6e:44"/>
Aug 22 02:57:33 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:57:33 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:57:33 user nova-compute[73469]:       <target dev="tapec640a77-a1"/>
Aug 22 02:57:33 user nova-compute[73469]:     </interface>
Aug 22 02:57:33 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:57:33 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/8242cec1-3b35-4d14-9e0b-db8a7e75697d/console.log" append="off"/>
Aug 22 02:57:33 user nova-compute[73469]:     </serial>
Aug 22 02:57:33 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:57:33 user nova-compute[73469]:     <video>
Aug 22 02:57:33 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:57:33 user nova-compute[73469]:     </video>
Aug 22 02:57:33 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:57:33 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:57:33 user nova-compute[73469]:     </rng>
Aug 22 02:57:33 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:57:33 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:57:33 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:57:33 user nova-compute[73469]:     </memballoon>
Aug 22 02:57:33 user nova-compute[73469]:   </devices>
Aug 22 02:57:33 user nova-compute[73469]: </domain>
Aug 22 02:57:33 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:57:33 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Instance destroyed successfully.
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] No VIF found with MAC fa:16:3e:4f:6e:44, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Updating instance_info_cache with network_info: [{"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Releasing lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f5786e-f554-479f-93a7-0d4834ce9fce/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.724s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG nova.compute.manager [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f5786e-f554-479f-93a7-0d4834ce9fce/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f5786e-f554-479f-93a7-0d4834ce9fce/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG nova.compute.manager [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG nova.network.neutron [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:34 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 02:57:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG nova.compute.manager [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f5786e-f554-479f-93a7-0d4834ce9fce/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG nova.compute.manager [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:57:34 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Creating image(s)
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "/opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "/opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "/opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG nova.policy [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d3f2f35df22412cac98e90f1bb80b08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d41329e1ad49bc94369a54d2798ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-392e102e-33f6-4508-9bb2-f9e324c58ee3 req-e4d12d5e-70a6-4790-8ac5-8fdb2678caf2 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received event network-vif-unplugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-392e102e-33f6-4508-9bb2-f9e324c58ee3 req-e4d12d5e-70a6-4790-8ac5-8fdb2678caf2 service nova] Acquiring lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-392e102e-33f6-4508-9bb2-f9e324c58ee3 req-e4d12d5e-70a6-4790-8ac5-8fdb2678caf2 service nova] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-392e102e-33f6-4508-9bb2-f9e324c58ee3 req-e4d12d5e-70a6-4790-8ac5-8fdb2678caf2 service nova] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-392e102e-33f6-4508-9bb2-f9e324c58ee3 req-e4d12d5e-70a6-4790-8ac5-8fdb2678caf2 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] No waiting events found dispatching network-vif-unplugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:34 user nova-compute[73469]: WARNING nova.compute.manager [req-392e102e-33f6-4508-9bb2-f9e324c58ee3 req-e4d12d5e-70a6-4790-8ac5-8fdb2678caf2 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received unexpected event network-vif-unplugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 for instance with vm_state active and task_state reboot_started_hard.
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.193s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.219s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk 1073741824" returned: 0 in 0.057s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.198s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG nova.network.neutron [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Successfully created port: f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Cannot resize image /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG nova.objects.instance [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lazy-loading 'migration_context' on Instance uuid 5984759d-28f1-45e8-bb4c-27bd8df426f4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Ensure instance console log exists: /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.013s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:35 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Instance destroyed successfully.
Aug 22 02:57:35 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lazy-loading 'resources' on Instance uuid 3ade8cba-6c34-4457-9ad3-484a604dbdb6 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.242s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:54:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-494971023',display_name='tempest-TestMinimumBasicScenario-server-494971023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-494971023',id=12,image_ref='5ba380b7-0fb3-46e0-952a-fad052275037',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxDsMHfXNUJeghB3W0xA7prRk5BeY6oPMAoJykL4RIDk/xEWSZdAtjpo9CxUxeo233tXdy8WnJzPXcbeh3MhyjdPrmU9fA1+DWQ5M4dHqRiQKFKIkjSwtPUa1cuC/c6gw==',key_name='tempest-TestMinimumBasicScenario-286068567',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:55:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ec928b9a04840b18974870663be0d44',ramdisk_id='',reservation_id='r-obngx040',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ba380b7-0fb3-46e0-952a-fad052275037',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-619227623',owner_user_name='tempest-TestMinimumBasicScenario-619227623-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:57:34Z,user_data=None,user_id='f03cf449ec504132b4ea50a033bdf2c0',uuid=3ade8cba-6c34-4457-9ad3-484a604dbdb6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Converting VIF {"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:c1:aa,bridge_name='br-int',has_traffic_filtering=True,id=18fedb7c-3d67-4417-b0a3-d98b54df5150,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fedb7c-3d') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG os_vif [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:c1:aa,bridge_name='br-int',has_traffic_filtering=True,id=18fedb7c-3d67-4417-b0a3-d98b54df5150,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fedb7c-3d') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18fedb7c-3d, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:57:35 user nova-compute[73469]: INFO os_vif [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:c1:aa,bridge_name='br-int',has_traffic_filtering=True,id=18fedb7c-3d67-4417-b0a3-d98b54df5150,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fedb7c-3d')
Aug 22 02:57:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CPFMtrvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:57:35 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:57:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc2b33b-9445-4b9e-a950-b7a862a34777]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[281715f4-7e4f-46f4-950f-b33bc9bec865]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:57:35 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:57:35 user nova-compute[73469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:57:35 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:57:35 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:57:35 user nova-compute[73469]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:57:35 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a41efe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc'): ({'sdg'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Removing single pathed devices sdg {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b351fcd6-c74d-47fd-b3b2-1b64eddeeaa1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c60b7a9-a9f6-4e26-9839-7ec8dc9c53a1]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Flushing IO for device /dev/sdg {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae897f0-26a5-4cce-bce5-cb4bd6851e9a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 02:57:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.059s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[621d763a-9a97-472e-bd8b-88ab8022eae4]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] SCSI volumes sdg have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fb64d4-5b42-4fef-9dbe-ac191e6917ad]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecf0f87-cee5-4999-9e25-9e29feb7bcaa]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc, portal: 172.16.0.220,3260]
Aug 22 02:57:36 user nova-compute[73469]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc, portal: 172.16.0.220,3260] successful.
Aug 22 02:57:36 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[08158d0a-0f35-4a66-9144-862c8e47f0e8]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] <== disconnect_volume: return (379ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Start _get_guest_xml network_info=[{"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5ba380b7-0fb3-46e0-952a-fad052275037,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '5ba380b7-0fb3-46e0-952a-fad052275037'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': 'd396717a-c312-41c8-8584-e6c3d629d310', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CPFMtrvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '3ade8cba-6c34-4457-9ad3-484a604dbdb6', 'attached_at': '', 'detached_at': '', 'volume_id': '09354d33-ec90-4ebe-81cf-9fed080243bc', 'serial': '09354d33-ec90-4ebe-81cf-9fed080243bc'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:57:36 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:57:36 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5ba380b7-0fb3-46e0-952a-fad052275037,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3ade8cba-6c34-4457-9ad3-484a604dbdb6 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CPFMtrvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:57:36 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:57:36 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:57:36 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a98dd92-9cb1-4653-8b0a-8a7acb3c774b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 02:57:36 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ceff049-dc93-48f3-9d1b-ff4bd9f62b37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc] added
Aug 22 02:57:36 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c1e06c-8225-44f9-b988-6bfb0c175df4]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a17cd5b-5a49-46ec-874c-f15f22e06251]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CPFMtrvb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CPFMtrvb" returned: 0 in 0.213s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f7b715-4d8a-4a86-886a-d443ac1eb70f]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CPFMtrvb'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.350s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59405c1-1969-45a3-af0f-a8edc4cea322]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[af82945c-5d84-4de5-ac1d-668da5628629]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:57:36 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:57:36 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:57:36 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:57:36 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-9b858957-cc54-4605-8899-0c771003fa83 req-cb1eac75-3b21-4d20-a8cc-3fcdeb02d878 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received event network-vif-plugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9b858957-cc54-4605-8899-0c771003fa83 req-cb1eac75-3b21-4d20-a8cc-3fcdeb02d878 service nova] Acquiring lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9b858957-cc54-4605-8899-0c771003fa83 req-cb1eac75-3b21-4d20-a8cc-3fcdeb02d878 service nova] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9b858957-cc54-4605-8899-0c771003fa83 req-cb1eac75-3b21-4d20-a8cc-3fcdeb02d878 service nova] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-9b858957-cc54-4605-8899-0c771003fa83 req-cb1eac75-3b21-4d20-a8cc-3fcdeb02d878 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] No waiting events found dispatching network-vif-plugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:36 user nova-compute[73469]: WARNING nova.compute.manager [req-9b858957-cc54-4605-8899-0c771003fa83 req-cb1eac75-3b21-4d20-a8cc-3fcdeb02d878 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received unexpected event network-vif-plugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 for instance with vm_state active and task_state reboot_started_hard.
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-9b858957-cc54-4605-8899-0c771003fa83 req-cb1eac75-3b21-4d20-a8cc-3fcdeb02d878 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received event network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9b858957-cc54-4605-8899-0c771003fa83 req-cb1eac75-3b21-4d20-a8cc-3fcdeb02d878 service nova] Acquiring lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9b858957-cc54-4605-8899-0c771003fa83 req-cb1eac75-3b21-4d20-a8cc-3fcdeb02d878 service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9b858957-cc54-4605-8899-0c771003fa83 req-cb1eac75-3b21-4d20-a8cc-3fcdeb02d878 service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-9b858957-cc54-4605-8899-0c771003fa83 req-cb1eac75-3b21-4d20-a8cc-3fcdeb02d878 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] No waiting events found dispatching network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:36 user nova-compute[73469]: WARNING nova.compute.manager [req-9b858957-cc54-4605-8899-0c771003fa83 req-cb1eac75-3b21-4d20-a8cc-3fcdeb02d878 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received unexpected event network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 for instance with vm_state active and task_state rescuing.
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62cb715-8273-4e4f-9820-0f7c7060dc04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc, portal: 172.16.0.220,3260]
Aug 22 02:57:36 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc, portal: 172.16.0.220,3260] successful.
Aug 22 02:57:36 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[412b3027-1974-4d48-9491-5e7e4fae8158]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c427392c-4c86-4e59-977c-30ced2fb1dbd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:57:36 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:57:36 user nova-compute[73469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:57:36 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:57:36 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:57:36 user nova-compute[73469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:57:36 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.626s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb31b370-3b66-4cbb-8b09-bce6bc5e3d1f]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:57:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CPFMtrvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.network.neutron [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Successfully updated port: f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquired lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.network.neutron [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.network.neutron [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.network.neutron [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Updating instance_info_cache with network_info: [{"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Releasing lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.compute.manager [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Instance network_info: |[{"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Start _get_guest_xml network_info=[{"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:37 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:57:37 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1537383573',display_name='tempest-ServerActionsTestOtherB-server-1537383573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1537383573',id=18,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbR7/rnM2AeZHN+BHEO9wy6tT5C/8gqpz2OLyZ0PrOkSO9sSAq61LBq8B59x8O0SJWkSJu3MS+tJxcGT/zQuOBrkxHQmB8JC+FatiKrmiFApJOgsuSU1qC5st2CAxnTvw==',key_name='tempest-keypair-568897893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9d41329e1ad49bc94369a54d2798ac6',ramdisk_id='',reservation_id='r-6rax0pzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1653559752',owner_user_name='tempest-ServerActionsTestOtherB-1653559752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d3f2f35df22412cac98e90f1bb80b08',uuid=5984759d-28f1-45e8-bb4c-27bd8df426f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Converting VIF {"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.objects.instance [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lazy-loading 'pci_devices' on Instance uuid 5984759d-28f1-45e8-bb4c-27bd8df426f4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:57:37 user nova-compute[73469]:   <uuid>5984759d-28f1-45e8-bb4c-27bd8df426f4</uuid>
Aug 22 02:57:37 user nova-compute[73469]:   <name>instance-00000012</name>
Aug 22 02:57:37 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:57:37 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:57:37 user nova-compute[73469]:   <metadata>
Aug 22 02:57:37 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:57:37 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:57:37 user nova-compute[73469]:       <nova:name>tempest-ServerActionsTestOtherB-server-1537383573</nova:name>
Aug 22 02:57:37 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:57:37</nova:creationTime>
Aug 22 02:57:37 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:57:37 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:57:37 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:57:37 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:57:37 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:57:37 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:57:37 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:57:37 user nova-compute[73469]:       <nova:owner>
Aug 22 02:57:37 user nova-compute[73469]:         <nova:user uuid="6d3f2f35df22412cac98e90f1bb80b08">tempest-ServerActionsTestOtherB-1653559752-project-member</nova:user>
Aug 22 02:57:37 user nova-compute[73469]:         <nova:project uuid="d9d41329e1ad49bc94369a54d2798ac6">tempest-ServerActionsTestOtherB-1653559752</nova:project>
Aug 22 02:57:37 user nova-compute[73469]:       </nova:owner>
Aug 22 02:57:37 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:57:37 user nova-compute[73469]:       <nova:ports>
Aug 22 02:57:37 user nova-compute[73469]:         <nova:port uuid="f38d1396-0fe4-4107-8815-7420deceedab">
Aug 22 02:57:37 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 22 02:57:37 user nova-compute[73469]:         </nova:port>
Aug 22 02:57:37 user nova-compute[73469]:       </nova:ports>
Aug 22 02:57:37 user nova-compute[73469]:     </nova:instance>
Aug 22 02:57:37 user nova-compute[73469]:   </metadata>
Aug 22 02:57:37 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:57:37 user nova-compute[73469]:     <system>
Aug 22 02:57:37 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:57:37 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:57:37 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:57:37 user nova-compute[73469]:       <entry name="serial">5984759d-28f1-45e8-bb4c-27bd8df426f4</entry>
Aug 22 02:57:37 user nova-compute[73469]:       <entry name="uuid">5984759d-28f1-45e8-bb4c-27bd8df426f4</entry>
Aug 22 02:57:37 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:57:37 user nova-compute[73469]:     </system>
Aug 22 02:57:37 user nova-compute[73469]:   </sysinfo>
Aug 22 02:57:37 user nova-compute[73469]:   <os>
Aug 22 02:57:37 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:57:37 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:57:37 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:57:37 user nova-compute[73469]:   </os>
Aug 22 02:57:37 user nova-compute[73469]:   <features>
Aug 22 02:57:37 user nova-compute[73469]:     <acpi/>
Aug 22 02:57:37 user nova-compute[73469]:     <apic/>
Aug 22 02:57:37 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:57:37 user nova-compute[73469]:   </features>
Aug 22 02:57:37 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:57:37 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:57:37 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:57:37 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:57:37 user nova-compute[73469]:   </clock>
Aug 22 02:57:37 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:57:37 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:57:37 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:57:37 user nova-compute[73469]:   </cpu>
Aug 22 02:57:37 user nova-compute[73469]:   <devices>
Aug 22 02:57:37 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:57:37 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:57:37 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk"/>
Aug 22 02:57:37 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:57:37 user nova-compute[73469]:     </disk>
Aug 22 02:57:37 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:57:37 user nova-compute[73469]:       <mac address="fa:16:3e:f8:e1:3e"/>
Aug 22 02:57:37 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:57:37 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:57:37 user nova-compute[73469]:       <target dev="tapf38d1396-0f"/>
Aug 22 02:57:37 user nova-compute[73469]:     </interface>
Aug 22 02:57:37 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:57:37 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/console.log" append="off"/>
Aug 22 02:57:37 user nova-compute[73469]:     </serial>
Aug 22 02:57:37 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:57:37 user nova-compute[73469]:     <video>
Aug 22 02:57:37 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:57:37 user nova-compute[73469]:     </video>
Aug 22 02:57:37 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:57:37 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:57:37 user nova-compute[73469]:     </rng>
Aug 22 02:57:37 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:57:37 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:57:37 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:57:37 user nova-compute[73469]:     </memballoon>
Aug 22 02:57:37 user nova-compute[73469]:   </devices>
Aug 22 02:57:37 user nova-compute[73469]: </domain>
Aug 22 02:57:37 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1537383573',display_name='tempest-ServerActionsTestOtherB-server-1537383573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1537383573',id=18,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbR7/rnM2AeZHN+BHEO9wy6tT5C/8gqpz2OLyZ0PrOkSO9sSAq61LBq8B59x8O0SJWkSJu3MS+tJxcGT/zQuOBrkxHQmB8JC+FatiKrmiFApJOgsuSU1qC5st2CAxnTvw==',key_name='tempest-keypair-568897893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9d41329e1ad49bc94369a54d2798ac6',ramdisk_id='',reservation_id='r-6rax0pzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1653559752',owner_user_name='tempest-ServerActionsTestOtherB-1653559752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d3f2f35df22412cac98e90f1bb80b08',uuid=5984759d-28f1-45e8-bb4c-27bd8df426f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Converting VIF {"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG os_vif [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf38d1396-0f, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf38d1396-0f, col_values=(('external_ids', {'iface-id': 'f38d1396-0fe4-4107-8815-7420deceedab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:e1:3e', 'vm-uuid': '5984759d-28f1-45e8-bb4c-27bd8df426f4'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:37 user nova-compute[73469]: INFO os_vif [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f')
Aug 22 02:57:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] No VIF found with MAC fa:16:3e:f8:e1:3e, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.671s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] <== connect_volume: return (1674ms) {'type': 'block', 'scsi_wwn': '26131646330663762', 'path': '/dev/sdd'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131646330663762', 'path': '/dev/sdd'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:54:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-494971023',display_name='tempest-TestMinimumBasicScenario-server-494971023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-494971023',id=12,image_ref='5ba380b7-0fb3-46e0-952a-fad052275037',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxDsMHfXNUJeghB3W0xA7prRk5BeY6oPMAoJykL4RIDk/xEWSZdAtjpo9CxUxeo233tXdy8WnJzPXcbeh3MhyjdPrmU9fA1+DWQ5M4dHqRiQKFKIkjSwtPUa1cuC/c6gw==',key_name='tempest-TestMinimumBasicScenario-286068567',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:55:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ec928b9a04840b18974870663be0d44',ramdisk_id='',reservation_id='r-obngx040',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ba380b7-0fb3-46e0-952a-fad052275037',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-619227623',owner_user_name='tempest-TestMinimumBasicScenario-619227623-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:57:34Z,user_data=None,user_id='f03cf449ec504132b4ea50a033bdf2c0',uuid=3ade8cba-6c34-4457-9ad3-484a604dbdb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Converting VIF {"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:57:37 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:c1:aa,bridge_name='br-int',has_traffic_filtering=True,id=18fedb7c-3d67-4417-b0a3-d98b54df5150,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fedb7c-3d') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ade8cba-6c34-4457-9ad3-484a604dbdb6 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:57:38 user nova-compute[73469]:   <uuid>3ade8cba-6c34-4457-9ad3-484a604dbdb6</uuid>
Aug 22 02:57:38 user nova-compute[73469]:   <name>instance-0000000c</name>
Aug 22 02:57:38 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:57:38 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:57:38 user nova-compute[73469]:   <metadata>
Aug 22 02:57:38 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:57:38 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:57:38 user nova-compute[73469]:       <nova:name>tempest-TestMinimumBasicScenario-server-494971023</nova:name>
Aug 22 02:57:38 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:57:36</nova:creationTime>
Aug 22 02:57:38 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:57:38 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:57:38 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:57:38 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:57:38 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:57:38 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:57:38 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:57:38 user nova-compute[73469]:       <nova:owner>
Aug 22 02:57:38 user nova-compute[73469]:         <nova:user uuid="f03cf449ec504132b4ea50a033bdf2c0">tempest-TestMinimumBasicScenario-619227623-project-member</nova:user>
Aug 22 02:57:38 user nova-compute[73469]:         <nova:project uuid="1ec928b9a04840b18974870663be0d44">tempest-TestMinimumBasicScenario-619227623</nova:project>
Aug 22 02:57:38 user nova-compute[73469]:       </nova:owner>
Aug 22 02:57:38 user nova-compute[73469]:       <nova:root type="image" uuid="5ba380b7-0fb3-46e0-952a-fad052275037"/>
Aug 22 02:57:38 user nova-compute[73469]:       <nova:ports>
Aug 22 02:57:38 user nova-compute[73469]:         <nova:port uuid="18fedb7c-3d67-4417-b0a3-d98b54df5150">
Aug 22 02:57:38 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 22 02:57:38 user nova-compute[73469]:         </nova:port>
Aug 22 02:57:38 user nova-compute[73469]:       </nova:ports>
Aug 22 02:57:38 user nova-compute[73469]:     </nova:instance>
Aug 22 02:57:38 user nova-compute[73469]:   </metadata>
Aug 22 02:57:38 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:57:38 user nova-compute[73469]:     <system>
Aug 22 02:57:38 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:57:38 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:57:38 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:57:38 user nova-compute[73469]:       <entry name="serial">3ade8cba-6c34-4457-9ad3-484a604dbdb6</entry>
Aug 22 02:57:38 user nova-compute[73469]:       <entry name="uuid">3ade8cba-6c34-4457-9ad3-484a604dbdb6</entry>
Aug 22 02:57:38 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:57:38 user nova-compute[73469]:     </system>
Aug 22 02:57:38 user nova-compute[73469]:   </sysinfo>
Aug 22 02:57:38 user nova-compute[73469]:   <os>
Aug 22 02:57:38 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:57:38 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:57:38 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:57:38 user nova-compute[73469]:   </os>
Aug 22 02:57:38 user nova-compute[73469]:   <features>
Aug 22 02:57:38 user nova-compute[73469]:     <acpi/>
Aug 22 02:57:38 user nova-compute[73469]:     <apic/>
Aug 22 02:57:38 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:57:38 user nova-compute[73469]:   </features>
Aug 22 02:57:38 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:57:38 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:57:38 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:57:38 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:57:38 user nova-compute[73469]:   </clock>
Aug 22 02:57:38 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:57:38 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:57:38 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:57:38 user nova-compute[73469]:   </cpu>
Aug 22 02:57:38 user nova-compute[73469]:   <devices>
Aug 22 02:57:38 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:57:38 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:57:38 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk"/>
Aug 22 02:57:38 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:57:38 user nova-compute[73469]:     </disk>
Aug 22 02:57:38 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 02:57:38 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:57:38 user nova-compute[73469]:       <source dev="/dev/sdd"/>
Aug 22 02:57:38 user nova-compute[73469]:       <target dev="vdb" bus="virtio"/>
Aug 22 02:57:38 user nova-compute[73469]:       <serial>09354d33-ec90-4ebe-81cf-9fed080243bc</serial>
Aug 22 02:57:38 user nova-compute[73469]:     </disk>
Aug 22 02:57:38 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:57:38 user nova-compute[73469]:       <mac address="fa:16:3e:ef:c1:aa"/>
Aug 22 02:57:38 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:57:38 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:57:38 user nova-compute[73469]:       <target dev="tap18fedb7c-3d"/>
Aug 22 02:57:38 user nova-compute[73469]:     </interface>
Aug 22 02:57:38 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:57:38 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/console.log" append="off"/>
Aug 22 02:57:38 user nova-compute[73469]:     </serial>
Aug 22 02:57:38 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:57:38 user nova-compute[73469]:     <video>
Aug 22 02:57:38 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:57:38 user nova-compute[73469]:     </video>
Aug 22 02:57:38 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:57:38 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:57:38 user nova-compute[73469]:     </rng>
Aug 22 02:57:38 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:57:38 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:57:38 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:57:38 user nova-compute[73469]:     </memballoon>
Aug 22 02:57:38 user nova-compute[73469]:   </devices>
Aug 22 02:57:38 user nova-compute[73469]: </domain>
Aug 22 02:57:38 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Removed pending event for 8242cec1-3b35-4d14-9e0b-db8a7e75697d due to event {{(pid=73469) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673058.0422583, 8242cec1-3b35-4d14-9e0b-db8a7e75697d => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:57:38 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] VM Resumed (Lifecycle Event)
Aug 22 02:57:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-99b8e064-d8d6-4742-b2f4-bd689dbb335f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8242cec1-3b35-4d14-9e0b-db8a7e75697d/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673058.0431406, 8242cec1-3b35-4d14-9e0b-db8a7e75697d => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:57:38 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] VM Started (Lifecycle Event)
Aug 22 02:57:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8242cec1-3b35-4d14-9e0b-db8a7e75697d/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8242cec1-3b35-4d14-9e0b-db8a7e75697d/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3ade8cba-6c34-4457-9ad3-484a604dbdb6 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3 --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8242cec1-3b35-4d14-9e0b-db8a7e75697d/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:38 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Error from libvirt while getting description of instance-0000000c: [Error Code 42] Domain not found: no domain with matching uuid '3ade8cba-6c34-4457-9ad3-484a604dbdb6' (instance-0000000c): libvirt.libvirtError: Domain not found: no domain with matching uuid '3ade8cba-6c34-4457-9ad3-484a604dbdb6' (instance-0000000c)
Aug 22 02:57:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-0b1ce85a-30a4-40a7-8846-386c6de4c809 req-39b54a07-9796-49d2-94f1-309e71d1a4b9 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received event network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0b1ce85a-30a4-40a7-8846-386c6de4c809 req-39b54a07-9796-49d2-94f1-309e71d1a4b9 service nova] Acquiring lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0b1ce85a-30a4-40a7-8846-386c6de4c809 req-39b54a07-9796-49d2-94f1-309e71d1a4b9 service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0b1ce85a-30a4-40a7-8846-386c6de4c809 req-39b54a07-9796-49d2-94f1-309e71d1a4b9 service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-0b1ce85a-30a4-40a7-8846-386c6de4c809 req-39b54a07-9796-49d2-94f1-309e71d1a4b9 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] No waiting events found dispatching network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:39 user nova-compute[73469]: WARNING nova.compute.manager [req-0b1ce85a-30a4-40a7-8846-386c6de4c809 req-39b54a07-9796-49d2-94f1-309e71d1a4b9 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received unexpected event network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 for instance with vm_state rescued and task_state None.
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-0b1ce85a-30a4-40a7-8846-386c6de4c809 req-39b54a07-9796-49d2-94f1-309e71d1a4b9 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-changed-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-0b1ce85a-30a4-40a7-8846-386c6de4c809 req-39b54a07-9796-49d2-94f1-309e71d1a4b9 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Refreshing instance network info cache due to event network-changed-f38d1396-0fe4-4107-8815-7420deceedab. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0b1ce85a-30a4-40a7-8846-386c6de4c809 req-39b54a07-9796-49d2-94f1-309e71d1a4b9 service nova] Acquiring lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0b1ce85a-30a4-40a7-8846-386c6de4c809 req-39b54a07-9796-49d2-94f1-309e71d1a4b9 service nova] Acquired lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.network.neutron [req-0b1ce85a-30a4-40a7-8846-386c6de4c809 req-39b54a07-9796-49d2-94f1-309e71d1a4b9 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Refreshing network info cache for port f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3 --force-share --output=json" returned: 0 in 0.764s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-28106929-5677-45ee-bb92-78c6092cdc21 req-148eecd5-91df-4839-9054-a5209217d452 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-28106929-5677-45ee-bb92-78c6092cdc21 req-148eecd5-91df-4839-9054-a5209217d452 service nova] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-28106929-5677-45ee-bb92-78c6092cdc21 req-148eecd5-91df-4839-9054-a5209217d452 service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-28106929-5677-45ee-bb92-78c6092cdc21 req-148eecd5-91df-4839-9054-a5209217d452 service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-28106929-5677-45ee-bb92-78c6092cdc21 req-148eecd5-91df-4839-9054-a5209217d452 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] No waiting events found dispatching network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:39 user nova-compute[73469]: WARNING nova.compute.manager [req-28106929-5677-45ee-bb92-78c6092cdc21 req-148eecd5-91df-4839-9054-a5209217d452 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received unexpected event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab for instance with vm_state building and task_state spawning.
Aug 22 02:57:39 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:57:39 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=7159MB free_disk=25.346458435058594GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json" returned: 0 in 0.425s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Cannot resize image /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lazy-loading 'migration_context' on Instance uuid 3ade8cba-6c34-4457-9ad3-484a604dbdb6 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:54:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-494971023',display_name='tempest-TestMinimumBasicScenario-server-494971023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-494971023',id=12,image_ref='5ba380b7-0fb3-46e0-952a-fad052275037',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxDsMHfXNUJeghB3W0xA7prRk5BeY6oPMAoJykL4RIDk/xEWSZdAtjpo9CxUxeo233tXdy8WnJzPXcbeh3MhyjdPrmU9fA1+DWQ5M4dHqRiQKFKIkjSwtPUa1cuC/c6gw==',key_name='tempest-TestMinimumBasicScenario-286068567',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:55:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='1ec928b9a04840b18974870663be0d44',ramdisk_id='',reservation_id='r-obngx040',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ba380b7-0fb3-46e0-952a-fad052275037',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-619227623',owner_user_name='tempest-TestMinimumBasicScenario-619227623-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:57:34Z,user_data=None,user_id='f03cf449ec504132b4ea50a033bdf2c0',uuid=3ade8cba-6c34-4457-9ad3-484a604dbdb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Converting VIF {"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:c1:aa,bridge_name='br-int',has_traffic_filtering=True,id=18fedb7c-3d67-4417-b0a3-d98b54df5150,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fedb7c-3d') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG os_vif [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:c1:aa,bridge_name='br-int',has_traffic_filtering=True,id=18fedb7c-3d67-4417-b0a3-d98b54df5150,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fedb7c-3d') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18fedb7c-3d, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18fedb7c-3d, col_values=(('external_ids', {'iface-id': '18fedb7c-3d67-4417-b0a3-d98b54df5150', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:c1:aa', 'vm-uuid': '3ade8cba-6c34-4457-9ad3-484a604dbdb6'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:39 user nova-compute[73469]: INFO os_vif [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:c1:aa,bridge_name='br-int',has_traffic_filtering=True,id=18fedb7c-3d67-4417-b0a3-d98b54df5150,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fedb7c-3d')
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d0668c0-7a49-4857-9b69-541021f18ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance dc3f5545-8ebb-4947-97d0-98a91f67e421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f5fdf305-bf02-4b53-bb0d-83e939ae1acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 71874297-5bc8-4816-b99e-58661ec38500 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 3ade8cba-6c34-4457-9ad3-484a604dbdb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8242cec1-3b35-4d14-9e0b-db8a7e75697d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance c1671fd3-e0a4-4a9c-9e38-7a595a405377 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance ddef86ef-9510-4010-b34b-68ac6d95652b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 56f5786e-f554-479f-93a7-0d4834ce9fce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 2e621408-a0af-460b-80a2-3446b5f1aadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 5984759d-28f1-45e8-bb4c-27bd8df426f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 02:57:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 02:57:40 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:57:40 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:57:40 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 02:57:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.916s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:40 user nova-compute[73469]: DEBUG nova.network.neutron [req-0b1ce85a-30a4-40a7-8846-386c6de4c809 req-39b54a07-9796-49d2-94f1-309e71d1a4b9 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Updated VIF entry in instance network info cache for port f38d1396-0fe4-4107-8815-7420deceedab. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:57:40 user nova-compute[73469]: DEBUG nova.network.neutron [req-0b1ce85a-30a4-40a7-8846-386c6de4c809 req-39b54a07-9796-49d2-94f1-309e71d1a4b9 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Updating instance_info_cache with network_info: [{"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:57:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0b1ce85a-30a4-40a7-8846-386c6de4c809 req-39b54a07-9796-49d2-94f1-309e71d1a4b9 service nova] Releasing lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:57:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Didn't find any instances for network info cache update. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-b4a795f9-d662-4350-951d-22caba9ba616 req-c8747943-14e6-4d18-8f1f-4866a7397035 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b4a795f9-d662-4350-951d-22caba9ba616 req-c8747943-14e6-4d18-8f1f-4866a7397035 service nova] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b4a795f9-d662-4350-951d-22caba9ba616 req-c8747943-14e6-4d18-8f1f-4866a7397035 service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b4a795f9-d662-4350-951d-22caba9ba616 req-c8747943-14e6-4d18-8f1f-4866a7397035 service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-b4a795f9-d662-4350-951d-22caba9ba616 req-c8747943-14e6-4d18-8f1f-4866a7397035 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] No waiting events found dispatching network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:41 user nova-compute[73469]: WARNING nova.compute.manager [req-b4a795f9-d662-4350-951d-22caba9ba616 req-c8747943-14e6-4d18-8f1f-4866a7397035 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received unexpected event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab for instance with vm_state building and task_state spawning.
Aug 22 02:57:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-48012af8-3df4-41d8-b943-c6ae4881f4af req-172d82f0-030f-41f2-9c02-cee3270e2212 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received event network-vif-plugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-48012af8-3df4-41d8-b943-c6ae4881f4af req-172d82f0-030f-41f2-9c02-cee3270e2212 service nova] Acquiring lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-48012af8-3df4-41d8-b943-c6ae4881f4af req-172d82f0-030f-41f2-9c02-cee3270e2212 service nova] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-48012af8-3df4-41d8-b943-c6ae4881f4af req-172d82f0-030f-41f2-9c02-cee3270e2212 service nova] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.010s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-48012af8-3df4-41d8-b943-c6ae4881f4af req-172d82f0-030f-41f2-9c02-cee3270e2212 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] No waiting events found dispatching network-vif-plugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:41 user nova-compute[73469]: WARNING nova.compute.manager [req-48012af8-3df4-41d8-b943-c6ae4881f4af req-172d82f0-030f-41f2-9c02-cee3270e2212 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received unexpected event network-vif-plugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 for instance with vm_state active and task_state reboot_started_hard.
Aug 22 02:57:42 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673062.20251, 5984759d-28f1-45e8-bb4c-27bd8df426f4 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:57:42 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] VM Resumed (Lifecycle Event)
Aug 22 02:57:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:57:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:57:42 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Instance spawned successfully.
Aug 22 02:57:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:57:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:57:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:57:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:57:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:57:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:57:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:57:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:57:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:57:42 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:57:42 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673062.2027462, 5984759d-28f1-45e8-bb4c-27bd8df426f4 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:57:42 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] VM Started (Lifecycle Event)
Aug 22 02:57:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:57:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:57:42 user nova-compute[73469]: INFO nova.compute.manager [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Took 7.74 seconds to spawn the instance on the hypervisor.
Aug 22 02:57:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:57:42 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:57:42 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:57:42 user nova-compute[73469]: INFO nova.compute.manager [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Took 8.96 seconds to build instance.
Aug 22 02:57:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-634903bb-5a66-4625-b36d-3e5c618000db tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.122s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:43 user nova-compute[73469]: DEBUG nova.compute.manager [req-d1cd28e1-664f-4ce6-a5d7-cc5d8fc86373 req-71d19283-85c5-4439-9666-031f7bc6ae90 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received event network-vif-plugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:57:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d1cd28e1-664f-4ce6-a5d7-cc5d8fc86373 req-71d19283-85c5-4439-9666-031f7bc6ae90 service nova] Acquiring lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:57:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d1cd28e1-664f-4ce6-a5d7-cc5d8fc86373 req-71d19283-85c5-4439-9666-031f7bc6ae90 service nova] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:57:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d1cd28e1-664f-4ce6-a5d7-cc5d8fc86373 req-71d19283-85c5-4439-9666-031f7bc6ae90 service nova] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:43 user nova-compute[73469]: DEBUG nova.compute.manager [req-d1cd28e1-664f-4ce6-a5d7-cc5d8fc86373 req-71d19283-85c5-4439-9666-031f7bc6ae90 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] No waiting events found dispatching network-vif-plugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:57:43 user nova-compute[73469]: WARNING nova.compute.manager [req-d1cd28e1-664f-4ce6-a5d7-cc5d8fc86373 req-71d19283-85c5-4439-9666-031f7bc6ae90 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received unexpected event network-vif-plugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 for instance with vm_state active and task_state reboot_started_hard.
Aug 22 02:57:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Removed pending event for 3ade8cba-6c34-4457-9ad3-484a604dbdb6 due to event {{(pid=73469) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 22 02:57:44 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673064.160679, 3ade8cba-6c34-4457-9ad3-484a604dbdb6 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:57:44 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] VM Resumed (Lifecycle Event)
Aug 22 02:57:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:57:44 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Instance rebooted successfully.
Aug 22 02:57:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:57:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:57:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:57:44 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 22 02:57:44 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673064.1669285, 3ade8cba-6c34-4457-9ad3-484a604dbdb6 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:57:44 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] VM Started (Lifecycle Event)
Aug 22 02:57:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b90a5c4a-6a1a-4f18-8d5e-df160eb58008 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 10.849s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:57:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:57:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:57:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:57:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:07 user nova-compute[73469]: INFO nova.compute.manager [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Terminating instance
Aug 22 02:58:07 user nova-compute[73469]: DEBUG nova.compute.manager [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 02:58:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-ed299de8-2243-41e9-ae9b-a7d79ce9ae6f req-07a94566-e9bc-4381-ac14-577cc607f937 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Received event network-vif-unplugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ed299de8-2243-41e9-ae9b-a7d79ce9ae6f req-07a94566-e9bc-4381-ac14-577cc607f937 service nova] Acquiring lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ed299de8-2243-41e9-ae9b-a7d79ce9ae6f req-07a94566-e9bc-4381-ac14-577cc607f937 service nova] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ed299de8-2243-41e9-ae9b-a7d79ce9ae6f req-07a94566-e9bc-4381-ac14-577cc607f937 service nova] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-ed299de8-2243-41e9-ae9b-a7d79ce9ae6f req-07a94566-e9bc-4381-ac14-577cc607f937 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] No waiting events found dispatching network-vif-unplugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-ed299de8-2243-41e9-ae9b-a7d79ce9ae6f req-07a94566-e9bc-4381-ac14-577cc607f937 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Received event network-vif-unplugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:08 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Instance destroyed successfully.
Aug 22 02:58:08 user nova-compute[73469]: DEBUG nova.objects.instance [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lazy-loading 'resources' on Instance uuid c1671fd3-e0a4-4a9c-9e38-7a595a405377 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-922527222',display_name='tempest-VolumesAdminNegativeTest-server-922527222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-922527222',id=14,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:56:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39885655a2984da4b2ec082427384bea',ramdisk_id='',reservation_id='r-i01fqrx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1884652392',owner_user_name='tempest-VolumesAdminNegativeTest-1884652392-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:56:14Z,user_data=None,user_id='bd0825598415407d98df7353ed5f08c8',uuid=c1671fd3-e0a4-4a9c-9e38-7a595a405377,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "address": "fa:16:3e:0e:ce:50", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc3c052-24", "ovs_interfaceid": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Converting VIF {"id": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "address": "fa:16:3e:0e:ce:50", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc3c052-24", "ovs_interfaceid": "3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ce:50,bridge_name='br-int',has_traffic_filtering=True,id=3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9,network=Network(b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc3c052-24') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG os_vif [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ce:50,bridge_name='br-int',has_traffic_filtering=True,id=3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9,network=Network(b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc3c052-24') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3cc3c052-24, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:08 user nova-compute[73469]: INFO os_vif [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ce:50,bridge_name='br-int',has_traffic_filtering=True,id=3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9,network=Network(b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc3c052-24')
Aug 22 02:58:08 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Deleting instance files /opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377_del
Aug 22 02:58:08 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Deletion of /opt/stack/data/nova/instances/c1671fd3-e0a4-4a9c-9e38-7a595a405377_del complete
Aug 22 02:58:08 user nova-compute[73469]: INFO nova.compute.manager [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 22 02:58:08 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 02:58:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:09 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:58:09 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Took 0.73 seconds to deallocate network for instance.
Aug 22 02:58:09 user nova-compute[73469]: DEBUG nova.compute.manager [req-3587fad3-e36b-4f1e-b977-7b09bd69e2ef req-a95d919d-9668-4beb-b06c-00b0c2639c2e service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Received event network-vif-deleted-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:09 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:58:09 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:58:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:10 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Deleted allocations for instance c1671fd3-e0a4-4a9c-9e38-7a595a405377
Aug 22 02:58:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-20a792ee-5004-4350-9d1b-63a1fe17ad32 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.251s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:10 user nova-compute[73469]: DEBUG nova.compute.manager [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Received event network-vif-plugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] Acquiring lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:10 user nova-compute[73469]: DEBUG nova.compute.manager [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] No waiting events found dispatching network-vif-plugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:58:10 user nova-compute[73469]: WARNING nova.compute.manager [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Received unexpected event network-vif-plugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 for instance with vm_state deleted and task_state None.
Aug 22 02:58:10 user nova-compute[73469]: DEBUG nova.compute.manager [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Received event network-vif-plugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] Acquiring lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:10 user nova-compute[73469]: DEBUG nova.compute.manager [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] No waiting events found dispatching network-vif-plugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:58:10 user nova-compute[73469]: WARNING nova.compute.manager [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Received unexpected event network-vif-plugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 for instance with vm_state deleted and task_state None.
Aug 22 02:58:10 user nova-compute[73469]: DEBUG nova.compute.manager [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Received event network-vif-plugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] Acquiring lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:10 user nova-compute[73469]: DEBUG nova.compute.manager [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] No waiting events found dispatching network-vif-plugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:58:10 user nova-compute[73469]: WARNING nova.compute.manager [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Received unexpected event network-vif-plugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 for instance with vm_state deleted and task_state None.
Aug 22 02:58:10 user nova-compute[73469]: DEBUG nova.compute.manager [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Received event network-vif-plugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] Acquiring lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] Lock "c1671fd3-e0a4-4a9c-9e38-7a595a405377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:10 user nova-compute[73469]: DEBUG nova.compute.manager [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] No waiting events found dispatching network-vif-plugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:58:10 user nova-compute[73469]: WARNING nova.compute.manager [req-9ee4830b-9e64-4065-85ae-49f2cbac1554 req-07b906e7-74d7-48a8-95c0-003850074c24 service nova] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Received unexpected event network-vif-plugged-3cc3c052-2487-4a7a-8ed7-5d06aa38f1e9 for instance with vm_state deleted and task_state None.
Aug 22 02:58:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:20 user nova-compute[73469]: DEBUG nova.compute.manager [req-eda37f06-9e96-41d9-b037-980781bc63e2 req-2049ec5e-fa90-49fc-919b-29fe152061fa service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received event network-changed-0427a59c-aa48-4b73-9579-e91d5e1830b0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:20 user nova-compute[73469]: DEBUG nova.compute.manager [req-eda37f06-9e96-41d9-b037-980781bc63e2 req-2049ec5e-fa90-49fc-919b-29fe152061fa service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Refreshing instance network info cache due to event network-changed-0427a59c-aa48-4b73-9579-e91d5e1830b0. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:58:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-eda37f06-9e96-41d9-b037-980781bc63e2 req-2049ec5e-fa90-49fc-919b-29fe152061fa service nova] Acquiring lock "refresh_cache-ddef86ef-9510-4010-b34b-68ac6d95652b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:58:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-eda37f06-9e96-41d9-b037-980781bc63e2 req-2049ec5e-fa90-49fc-919b-29fe152061fa service nova] Acquired lock "refresh_cache-ddef86ef-9510-4010-b34b-68ac6d95652b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:58:20 user nova-compute[73469]: DEBUG nova.network.neutron [req-eda37f06-9e96-41d9-b037-980781bc63e2 req-2049ec5e-fa90-49fc-919b-29fe152061fa service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Refreshing network info cache for port 0427a59c-aa48-4b73-9579-e91d5e1830b0 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:58:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquiring lock "interface-ddef86ef-9510-4010-b34b-68ac6d95652b-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "interface-ddef86ef-9510-4010-b34b-68ac6d95652b-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:20 user nova-compute[73469]: DEBUG nova.objects.instance [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lazy-loading 'flavor' on Instance uuid ddef86ef-9510-4010-b34b-68ac6d95652b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Acquiring lock "71874297-5bc8-4816-b99e-58661ec38500" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "71874297-5bc8-4816-b99e-58661ec38500" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Acquiring lock "71874297-5bc8-4816-b99e-58661ec38500-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:21 user nova-compute[73469]: INFO nova.compute.manager [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Terminating instance
Aug 22 02:58:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG nova.objects.instance [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lazy-loading 'pci_requests' on Instance uuid ddef86ef-9510-4010-b34b-68ac6d95652b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG nova.network.neutron [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG nova.policy [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '95599bfe510e4edb80093a2a4365503e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4179baa30282429b8bfff7beafb95390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-16ca811e-8f1f-4dae-bfb6-eadf1e665cf0 req-5820089c-7190-4deb-ac94-43f33d09ffab service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received event network-vif-unplugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-16ca811e-8f1f-4dae-bfb6-eadf1e665cf0 req-5820089c-7190-4deb-ac94-43f33d09ffab service nova] Acquiring lock "71874297-5bc8-4816-b99e-58661ec38500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-16ca811e-8f1f-4dae-bfb6-eadf1e665cf0 req-5820089c-7190-4deb-ac94-43f33d09ffab service nova] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-16ca811e-8f1f-4dae-bfb6-eadf1e665cf0 req-5820089c-7190-4deb-ac94-43f33d09ffab service nova] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-16ca811e-8f1f-4dae-bfb6-eadf1e665cf0 req-5820089c-7190-4deb-ac94-43f33d09ffab service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] No waiting events found dispatching network-vif-unplugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-16ca811e-8f1f-4dae-bfb6-eadf1e665cf0 req-5820089c-7190-4deb-ac94-43f33d09ffab service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received event network-vif-unplugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG nova.network.neutron [req-eda37f06-9e96-41d9-b037-980781bc63e2 req-2049ec5e-fa90-49fc-919b-29fe152061fa service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Updated VIF entry in instance network info cache for port 0427a59c-aa48-4b73-9579-e91d5e1830b0. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG nova.network.neutron [req-eda37f06-9e96-41d9-b037-980781bc63e2 req-2049ec5e-fa90-49fc-919b-29fe152061fa service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Updating instance_info_cache with network_info: [{"id": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "address": "fa:16:3e:7a:e5:d0", "network": {"id": "f787ebbc-4ddc-4671-8a1a-e15d3da6d019", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-677642733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0427a59c-aa", "ovs_interfaceid": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-eda37f06-9e96-41d9-b037-980781bc63e2 req-2049ec5e-fa90-49fc-919b-29fe152061fa service nova] Releasing lock "refresh_cache-ddef86ef-9510-4010-b34b-68ac6d95652b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:58:21 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Instance destroyed successfully.
Aug 22 02:58:21 user nova-compute[73469]: DEBUG nova.objects.instance [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lazy-loading 'resources' on Instance uuid 71874297-5bc8-4816-b99e-58661ec38500 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-22T02:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1381787490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-377659152',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKdydlpBpfM8iUKDYqmt+T3Vb9ogb25mCf0t5qBVWqYu7okcZIbqswy9cY7EzBR1ehqgAhMx+2jQu1gM1ufIoHEPIBlAoobLh2iMYLXMFczVAufMp/nR4kSWj02M0KlhA==',key_name='tempest-keypair-904786919',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:56:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5e945a8b0f0492c9099049690ada404',ramdisk_id='',reservation_id='r-k6v908aw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-436752772',owner_user_name='tempest-ServerActionsV293TestJSON-436752772-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:56:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5ba5f1c3b147388c043d08d17103c1',uuid=71874297-5bc8-4816-b99e-58661ec38500,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "address": "fa:16:3e:b0:64:29", "network": {"id": "c0ca9d32-e425-4576-8e7a-007b037ac6e2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-953287001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5e945a8b0f0492c9099049690ada404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa442f21d-ed", "ovs_interfaceid": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Converting VIF {"id": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "address": "fa:16:3e:b0:64:29", "network": {"id": "c0ca9d32-e425-4576-8e7a-007b037ac6e2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-953287001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5e945a8b0f0492c9099049690ada404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa442f21d-ed", "ovs_interfaceid": "a442f21d-ed03-4b3f-89d7-c5b24175d1f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:64:29,bridge_name='br-int',has_traffic_filtering=True,id=a442f21d-ed03-4b3f-89d7-c5b24175d1f9,network=Network(c0ca9d32-e425-4576-8e7a-007b037ac6e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa442f21d-ed') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG os_vif [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:64:29,bridge_name='br-int',has_traffic_filtering=True,id=a442f21d-ed03-4b3f-89d7-c5b24175d1f9,network=Network(c0ca9d32-e425-4576-8e7a-007b037ac6e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa442f21d-ed') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa442f21d-ed, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:21 user nova-compute[73469]: INFO os_vif [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:64:29,bridge_name='br-int',has_traffic_filtering=True,id=a442f21d-ed03-4b3f-89d7-c5b24175d1f9,network=Network(c0ca9d32-e425-4576-8e7a-007b037ac6e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa442f21d-ed')
Aug 22 02:58:21 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSLPutZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:58:21 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:58:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[866ba075-522d-4513-84c5-9e971a91a485]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ead931-aaf9-4490-a3f9-7a9f1932a52f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:58:22 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:58:22 user nova-compute[73469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:58:22 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:58:22 user nova-compute[73469]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 (non-flash)
Aug 22 02:58:22 user nova-compute[73469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:58:22 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4694280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd9e004-0241-42ed-b192-c83f5677d9a2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a397c2e-4ce8-4608-85b7-a521c0b7a8c7]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.043s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf0f5ba-4dac-4f5c-8740-64864d4828e1]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG nova.network.neutron [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Successfully created port: 44db6566-31ff-47e8-869e-af9454f7975d {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.072s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2fa2ec-3a30-4079-9769-57e8525b1bc9]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1470418e-dae3-48bc-b6d8-3b3f80d369ec]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e598ce3-d1be-48b6-8187-bce68bb84fae]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4, portal: 172.16.0.220,3260]
Aug 22 02:58:22 user nova-compute[73469]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4, portal: 172.16.0.220,3260] successful.
Aug 22 02:58:22 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d2463b5-2a45-4447-b1d6-2753a728a0b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0dc4fa-6de5-480e-b340-7cc2965e2402]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] <== disconnect_volume: return (365ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 02:58:22 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Deleting instance files /opt/stack/data/nova/instances/71874297-5bc8-4816-b99e-58661ec38500_del
Aug 22 02:58:22 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Deletion of /opt/stack/data/nova/instances/71874297-5bc8-4816-b99e-58661ec38500_del complete
Aug 22 02:58:22 user nova-compute[73469]: INFO nova.compute.manager [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 22 02:58:22 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 71874297-5bc8-4816-b99e-58661ec38500] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 02:58:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:23 user nova-compute[73469]: DEBUG nova.network.neutron [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Successfully updated port: 44db6566-31ff-47e8-869e-af9454f7975d {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:58:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquiring lock "refresh_cache-ddef86ef-9510-4010-b34b-68ac6d95652b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:58:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquired lock "refresh_cache-ddef86ef-9510-4010-b34b-68ac6d95652b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:58:23 user nova-compute[73469]: DEBUG nova.network.neutron [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:58:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-9e327f2f-932b-4f11-8409-8b21aa79ede9 req-d4319dab-2571-434c-82c5-14f5e702e6a1 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received event network-changed-44db6566-31ff-47e8-869e-af9454f7975d {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-9e327f2f-932b-4f11-8409-8b21aa79ede9 req-d4319dab-2571-434c-82c5-14f5e702e6a1 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Refreshing instance network info cache due to event network-changed-44db6566-31ff-47e8-869e-af9454f7975d. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:58:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9e327f2f-932b-4f11-8409-8b21aa79ede9 req-d4319dab-2571-434c-82c5-14f5e702e6a1 service nova] Acquiring lock "refresh_cache-ddef86ef-9510-4010-b34b-68ac6d95652b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:58:23 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673088.57624, c1671fd3-e0a4-4a9c-9e38-7a595a405377 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:58:23 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] VM Stopped (Lifecycle Event)
Aug 22 02:58:23 user nova-compute[73469]: DEBUG nova.compute.manager [None req-97c1ce40-7c69-498e-80e7-3e45cf0ab805 None None] [instance: c1671fd3-e0a4-4a9c-9e38-7a595a405377] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:58:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-2e71521e-ea72-40c6-95b5-ac7fce45b6e1 req-2fe0c2f0-1d34-4c71-9a7f-46137bfd029a service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received event network-vif-plugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2e71521e-ea72-40c6-95b5-ac7fce45b6e1 req-2fe0c2f0-1d34-4c71-9a7f-46137bfd029a service nova] Acquiring lock "71874297-5bc8-4816-b99e-58661ec38500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2e71521e-ea72-40c6-95b5-ac7fce45b6e1 req-2fe0c2f0-1d34-4c71-9a7f-46137bfd029a service nova] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2e71521e-ea72-40c6-95b5-ac7fce45b6e1 req-2fe0c2f0-1d34-4c71-9a7f-46137bfd029a service nova] Lock "71874297-5bc8-4816-b99e-58661ec38500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-2e71521e-ea72-40c6-95b5-ac7fce45b6e1 req-2fe0c2f0-1d34-4c71-9a7f-46137bfd029a service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] No waiting events found dispatching network-vif-plugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:58:23 user nova-compute[73469]: WARNING nova.compute.manager [req-2e71521e-ea72-40c6-95b5-ac7fce45b6e1 req-2fe0c2f0-1d34-4c71-9a7f-46137bfd029a service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received unexpected event network-vif-plugged-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 for instance with vm_state active and task_state deleting.
Aug 22 02:58:24 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:58:24 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Took 2.13 seconds to deallocate network for instance.
Aug 22 02:58:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-ff9335d4-c9c6-4605-989c-5bd3339ee23d req-7974b899-dceb-4030-aa1d-968979417c59 service nova] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Received event network-vif-deleted-a442f21d-ed03-4b3f-89d7-c5b24175d1f9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG nova.network.neutron [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Updating instance_info_cache with network_info: [{"id": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "address": "fa:16:3e:7a:e5:d0", "network": {"id": "f787ebbc-4ddc-4671-8a1a-e15d3da6d019", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-677642733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0427a59c-aa", "ovs_interfaceid": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44db6566-31ff-47e8-869e-af9454f7975d", "address": "fa:16:3e:08:fe:80", "network": {"id": "ef2191ea-7a09-4508-9c79-e9f6195c4edb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1754302342", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44db6566-31", "ovs_interfaceid": "44db6566-31ff-47e8-869e-af9454f7975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Releasing lock "refresh_cache-ddef86ef-9510-4010-b34b-68ac6d95652b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9e327f2f-932b-4f11-8409-8b21aa79ede9 req-d4319dab-2571-434c-82c5-14f5e702e6a1 service nova] Acquired lock "refresh_cache-ddef86ef-9510-4010-b34b-68ac6d95652b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG nova.network.neutron [req-9e327f2f-932b-4f11-8409-8b21aa79ede9 req-d4319dab-2571-434c-82c5-14f5e702e6a1 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Refreshing network info cache for port 44db6566-31ff-47e8-869e-af9454f7975d {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258093798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1258093798',id=15,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQKuMRYunlJu8NopZqi0nqkba6dIOrT/1x7SWN1QBY4cmXStVS07i0EQBQsjpw0PFF97qA9J41BXlNPdvO8dtd6gzmgVzrLwxcMsATaGBS/meCQ+o0tinvjbTrFfRBF+A==',key_name='tempest-keypair-187903951',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:56:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4179baa30282429b8bfff7beafb95390',ramdisk_id='',reservation_id='r-jfk6r0p6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-909833900',owner_user_name='tempest-TaggedAttachmentsTest-909833900-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95599bfe510e4edb80093a2a4365503e',uuid=ddef86ef-9510-4010-b34b-68ac6d95652b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44db6566-31ff-47e8-869e-af9454f7975d", "address": "fa:16:3e:08:fe:80", "network": {"id": "ef2191ea-7a09-4508-9c79-e9f6195c4edb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1754302342", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44db6566-31", "ovs_interfaceid": "44db6566-31ff-47e8-869e-af9454f7975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Converting VIF {"id": "44db6566-31ff-47e8-869e-af9454f7975d", "address": "fa:16:3e:08:fe:80", "network": {"id": "ef2191ea-7a09-4508-9c79-e9f6195c4edb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1754302342", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44db6566-31", "ovs_interfaceid": "44db6566-31ff-47e8-869e-af9454f7975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:fe:80,bridge_name='br-int',has_traffic_filtering=True,id=44db6566-31ff-47e8-869e-af9454f7975d,network=Network(ef2191ea-7a09-4508-9c79-e9f6195c4edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44db6566-31') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG os_vif [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:fe:80,bridge_name='br-int',has_traffic_filtering=True,id=44db6566-31ff-47e8-869e-af9454f7975d,network=Network(ef2191ea-7a09-4508-9c79-e9f6195c4edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44db6566-31') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44db6566-31, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap44db6566-31, col_values=(('external_ids', {'iface-id': '44db6566-31ff-47e8-869e-af9454f7975d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:fe:80', 'vm-uuid': 'ddef86ef-9510-4010-b34b-68ac6d95652b'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:24 user nova-compute[73469]: INFO os_vif [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:fe:80,bridge_name='br-int',has_traffic_filtering=True,id=44db6566-31ff-47e8-869e-af9454f7975d,network=Network(ef2191ea-7a09-4508-9c79-e9f6195c4edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44db6566-31')
Aug 22 02:58:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258093798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1258093798',id=15,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQKuMRYunlJu8NopZqi0nqkba6dIOrT/1x7SWN1QBY4cmXStVS07i0EQBQsjpw0PFF97qA9J41BXlNPdvO8dtd6gzmgVzrLwxcMsATaGBS/meCQ+o0tinvjbTrFfRBF+A==',key_name='tempest-keypair-187903951',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:56:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4179baa30282429b8bfff7beafb95390',ramdisk_id='',reservation_id='r-jfk6r0p6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-909833900',owner_user_name='tempest-TaggedAttachmentsTest-909833900-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95599bfe510e4edb80093a2a4365503e',uuid=ddef86ef-9510-4010-b34b-68ac6d95652b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44db6566-31ff-47e8-869e-af9454f7975d", "address": "fa:16:3e:08:fe:80", "network": {"id": "ef2191ea-7a09-4508-9c79-e9f6195c4edb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1754302342", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44db6566-31", "ovs_interfaceid": "44db6566-31ff-47e8-869e-af9454f7975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Converting VIF {"id": "44db6566-31ff-47e8-869e-af9454f7975d", "address": "fa:16:3e:08:fe:80", "network": {"id": "ef2191ea-7a09-4508-9c79-e9f6195c4edb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1754302342", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44db6566-31", "ovs_interfaceid": "44db6566-31ff-47e8-869e-af9454f7975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:fe:80,bridge_name='br-int',has_traffic_filtering=True,id=44db6566-31ff-47e8-869e-af9454f7975d,network=Network(ef2191ea-7a09-4508-9c79-e9f6195c4edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44db6566-31') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] attach device xml: <interface type="ethernet">
Aug 22 02:58:24 user nova-compute[73469]:   <mac address="fa:16:3e:08:fe:80"/>
Aug 22 02:58:24 user nova-compute[73469]:   <model type="virtio"/>
Aug 22 02:58:24 user nova-compute[73469]:   <mtu size="1442"/>
Aug 22 02:58:24 user nova-compute[73469]:   <target dev="tap44db6566-31"/>
Aug 22 02:58:24 user nova-compute[73469]: </interface>
Aug 22 02:58:24 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:25 user nova-compute[73469]: INFO nova.compute.manager [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Took 0.91 seconds to detach 1 volumes for instance.
Aug 22 02:58:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Deleting volume: 6d2463b5-2a45-4447-b1d6-2753a728a0b4 {{(pid=73469) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 22 02:58:25 user nova-compute[73469]: DEBUG nova.network.neutron [req-9e327f2f-932b-4f11-8409-8b21aa79ede9 req-d4319dab-2571-434c-82c5-14f5e702e6a1 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Updated VIF entry in instance network info cache for port 44db6566-31ff-47e8-869e-af9454f7975d. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:58:25 user nova-compute[73469]: DEBUG nova.network.neutron [req-9e327f2f-932b-4f11-8409-8b21aa79ede9 req-d4319dab-2571-434c-82c5-14f5e702e6a1 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Updating instance_info_cache with network_info: [{"id": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "address": "fa:16:3e:7a:e5:d0", "network": {"id": "f787ebbc-4ddc-4671-8a1a-e15d3da6d019", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-677642733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0427a59c-aa", "ovs_interfaceid": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44db6566-31ff-47e8-869e-af9454f7975d", "address": "fa:16:3e:08:fe:80", "network": {"id": "ef2191ea-7a09-4508-9c79-e9f6195c4edb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1754302342", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44db6566-31", "ovs_interfaceid": "44db6566-31ff-47e8-869e-af9454f7975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:58:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9e327f2f-932b-4f11-8409-8b21aa79ede9 req-d4319dab-2571-434c-82c5-14f5e702e6a1 service nova] Releasing lock "refresh_cache-ddef86ef-9510-4010-b34b-68ac6d95652b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:58:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:58:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] No BDM found with device name hda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:58:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] No VIF found with MAC fa:16:3e:7a:e5:d0, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:58:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:58:25 user nova-compute[73469]:   <nova:package version="0.0.0"/>
Aug 22 02:58:25 user nova-compute[73469]:   <nova:name>tempest-device-tagging-server-1258093798</nova:name>
Aug 22 02:58:25 user nova-compute[73469]:   <nova:creationTime>2023-08-22 02:58:25</nova:creationTime>
Aug 22 02:58:25 user nova-compute[73469]:   <nova:flavor name="m1.tiny">
Aug 22 02:58:25 user nova-compute[73469]:     <nova:memory>512</nova:memory>
Aug 22 02:58:25 user nova-compute[73469]:     <nova:disk>1</nova:disk>
Aug 22 02:58:25 user nova-compute[73469]:     <nova:swap>0</nova:swap>
Aug 22 02:58:25 user nova-compute[73469]:     <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:58:25 user nova-compute[73469]:     <nova:vcpus>1</nova:vcpus>
Aug 22 02:58:25 user nova-compute[73469]:   </nova:flavor>
Aug 22 02:58:25 user nova-compute[73469]:   <nova:owner>
Aug 22 02:58:25 user nova-compute[73469]:     <nova:user uuid="95599bfe510e4edb80093a2a4365503e">tempest-TaggedAttachmentsTest-909833900-project-member</nova:user>
Aug 22 02:58:25 user nova-compute[73469]:     <nova:project uuid="4179baa30282429b8bfff7beafb95390">tempest-TaggedAttachmentsTest-909833900</nova:project>
Aug 22 02:58:25 user nova-compute[73469]:   </nova:owner>
Aug 22 02:58:25 user nova-compute[73469]:   <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:58:25 user nova-compute[73469]:   <nova:ports>
Aug 22 02:58:25 user nova-compute[73469]:     <nova:port uuid="0427a59c-aa48-4b73-9579-e91d5e1830b0">
Aug 22 02:58:25 user nova-compute[73469]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 22 02:58:25 user nova-compute[73469]:     </nova:port>
Aug 22 02:58:25 user nova-compute[73469]:     <nova:port uuid="44db6566-31ff-47e8-869e-af9454f7975d">
Aug 22 02:58:25 user nova-compute[73469]:       <nova:ip type="fixed" address="10.10.10.148" ipVersion="4"/>
Aug 22 02:58:25 user nova-compute[73469]:     </nova:port>
Aug 22 02:58:25 user nova-compute[73469]:   </nova:ports>
Aug 22 02:58:25 user nova-compute[73469]: </nova:instance>
Aug 22 02:58:25 user nova-compute[73469]:  {{(pid=73469) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 22 02:58:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-fe71912c-369b-45e1-848e-4c03611cf897 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "interface-ddef86ef-9510-4010-b34b-68ac6d95652b-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.691s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:25 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:58:25 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:58:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquiring lock "ddef86ef-9510-4010-b34b-68ac6d95652b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG nova.objects.instance [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lazy-loading 'flavor' on Instance uuid ddef86ef-9510-4010-b34b-68ac6d95652b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:58:26 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Deleted allocations for instance 71874297-5bc8-4816-b99e-58661ec38500
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a64d1d2d-6b60-41d3-a29c-9ac78eba4a57 tempest-ServerActionsV293TestJSON-436752772 tempest-ServerActionsV293TestJSON-436752772-project-member] Lock "71874297-5bc8-4816-b99e-58661ec38500" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.036s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquiring lock "ddef86ef-9510-4010-b34b-68ac6d95652b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:26 user nova-compute[73469]: INFO nova.compute.manager [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Attaching volume 51dccd0a-1a13-4153-953a-6a35fd1969e2 to /dev/vdb
Aug 22 02:58:26 user nova-compute[73469]: DEBUG os_brick.utils [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29fab91-6ca3-4b7f-ac67-c38fe710935f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af77489-f1f4-4553-aec4-eac98e285fcd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa92a90-0c16-4765-8fa1-3a977792ab25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fedb340-62f6-4e7d-bf7f-6365bf2e2bdc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:58:26 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[258d5169-f5b0-42f3-8fd7-d71d4a337423]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG os_brick.utils [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Updating existing volume attachment record: 65fcbdf8-418d-4aa8-ba2a-cc0618e3595c {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-cad809c0-befc-4f7d-b9b3-cde0470727e5 req-ef3701ef-0ed9-4451-9a1e-c8d967bdf202 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received event network-vif-plugged-44db6566-31ff-47e8-869e-af9454f7975d {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cad809c0-befc-4f7d-b9b3-cde0470727e5 req-ef3701ef-0ed9-4451-9a1e-c8d967bdf202 service nova] Acquiring lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cad809c0-befc-4f7d-b9b3-cde0470727e5 req-ef3701ef-0ed9-4451-9a1e-c8d967bdf202 service nova] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cad809c0-befc-4f7d-b9b3-cde0470727e5 req-ef3701ef-0ed9-4451-9a1e-c8d967bdf202 service nova] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-cad809c0-befc-4f7d-b9b3-cde0470727e5 req-ef3701ef-0ed9-4451-9a1e-c8d967bdf202 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] No waiting events found dispatching network-vif-plugged-44db6566-31ff-47e8-869e-af9454f7975d {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:58:26 user nova-compute[73469]: WARNING nova.compute.manager [req-cad809c0-befc-4f7d-b9b3-cde0470727e5 req-ef3701ef-0ed9-4451-9a1e-c8d967bdf202 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received unexpected event network-vif-plugged-44db6566-31ff-47e8-869e-af9454f7975d for instance with vm_state active and task_state None.
Aug 22 02:58:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-cad809c0-befc-4f7d-b9b3-cde0470727e5 req-ef3701ef-0ed9-4451-9a1e-c8d967bdf202 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received event network-vif-plugged-44db6566-31ff-47e8-869e-af9454f7975d {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cad809c0-befc-4f7d-b9b3-cde0470727e5 req-ef3701ef-0ed9-4451-9a1e-c8d967bdf202 service nova] Acquiring lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cad809c0-befc-4f7d-b9b3-cde0470727e5 req-ef3701ef-0ed9-4451-9a1e-c8d967bdf202 service nova] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cad809c0-befc-4f7d-b9b3-cde0470727e5 req-ef3701ef-0ed9-4451-9a1e-c8d967bdf202 service nova] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-cad809c0-befc-4f7d-b9b3-cde0470727e5 req-ef3701ef-0ed9-4451-9a1e-c8d967bdf202 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] No waiting events found dispatching network-vif-plugged-44db6566-31ff-47e8-869e-af9454f7975d {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:58:26 user nova-compute[73469]: WARNING nova.compute.manager [req-cad809c0-befc-4f7d-b9b3-cde0470727e5 req-ef3701ef-0ed9-4451-9a1e-c8d967bdf202 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received unexpected event network-vif-plugged-44db6566-31ff-47e8-869e-af9454f7975d for instance with vm_state active and task_state None.
Aug 22 02:58:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:58:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "d8433c45-b889-4a7b-88c2-ba00679b1d26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:58:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:58:32 user nova-compute[73469]: INFO nova.compute.claims [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Claim successful on node user
Aug 22 02:58:33 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:58:33 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:58:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:33 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:58:33 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:58:33 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:58:33 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 02:58:33 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:58:33 user nova-compute[73469]: DEBUG nova.policy [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41e697cd5e5f422f8ac90f7496f60936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e1f2f72c7497ca3ad923a4b9459dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:58:33 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:58:33 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:58:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:58:33 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Creating image(s)
Aug 22 02:58:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "/opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "/opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.220s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.204s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk 1073741824" returned: 0 in 0.049s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.219s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Successfully created port: 4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Cannot resize image /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'migration_context' on Instance uuid d8433c45-b889-4a7b-88c2-ba00679b1d26 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Ensure instance console log exists: /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquiring lock "56f5786e-f554-479f-93a7-0d4834ce9fce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "56f5786e-f554-479f-93a7-0d4834ce9fce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquiring lock "56f5786e-f554-479f-93a7-0d4834ce9fce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "56f5786e-f554-479f-93a7-0d4834ce9fce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "56f5786e-f554-479f-93a7-0d4834ce9fce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:34 user nova-compute[73469]: INFO nova.compute.manager [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Terminating instance
Aug 22 02:58:34 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-84fc0241-9e89-4d45-98bc-035791545b38 req-3225a70d-a236-4a1d-8329-4156cfd14fd1 service nova] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Received event network-vif-unplugged-79905cbd-3475-4c02-aba3-aa94a56a2823 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-84fc0241-9e89-4d45-98bc-035791545b38 req-3225a70d-a236-4a1d-8329-4156cfd14fd1 service nova] Acquiring lock "56f5786e-f554-479f-93a7-0d4834ce9fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-84fc0241-9e89-4d45-98bc-035791545b38 req-3225a70d-a236-4a1d-8329-4156cfd14fd1 service nova] Lock "56f5786e-f554-479f-93a7-0d4834ce9fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-84fc0241-9e89-4d45-98bc-035791545b38 req-3225a70d-a236-4a1d-8329-4156cfd14fd1 service nova] Lock "56f5786e-f554-479f-93a7-0d4834ce9fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-84fc0241-9e89-4d45-98bc-035791545b38 req-3225a70d-a236-4a1d-8329-4156cfd14fd1 service nova] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] No waiting events found dispatching network-vif-unplugged-79905cbd-3475-4c02-aba3-aa94a56a2823 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-84fc0241-9e89-4d45-98bc-035791545b38 req-3225a70d-a236-4a1d-8329-4156cfd14fd1 service nova] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Received event network-vif-unplugged-79905cbd-3475-4c02-aba3-aa94a56a2823 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 02:58:35 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Instance destroyed successfully.
Aug 22 02:58:35 user nova-compute[73469]: DEBUG nova.objects.instance [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lazy-loading 'resources' on Instance uuid 56f5786e-f554-479f-93a7-0d4834ce9fce {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:56:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2100391501',display_name='tempest-VolumesActionsTest-instance-2100391501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2100391501',id=16,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:56:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fd1fcacf5614d0782d38743f0f336e0',ramdisk_id='',reservation_id='r-bfxfs8yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1793267254',owner_user_name='tempest-VolumesActionsTest-1793267254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:56:51Z,user_data=None,user_id='7747694d4132438b9d794cb59907a328',uuid=56f5786e-f554-479f-93a7-0d4834ce9fce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79905cbd-3475-4c02-aba3-aa94a56a2823", "address": "fa:16:3e:83:ff:04", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79905cbd-34", "ovs_interfaceid": "79905cbd-3475-4c02-aba3-aa94a56a2823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Converting VIF {"id": "79905cbd-3475-4c02-aba3-aa94a56a2823", "address": "fa:16:3e:83:ff:04", "network": {"id": "843ceaba-5a3c-4324-bb33-81a695f19d7d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413674898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fd1fcacf5614d0782d38743f0f336e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79905cbd-34", "ovs_interfaceid": "79905cbd-3475-4c02-aba3-aa94a56a2823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ff:04,bridge_name='br-int',has_traffic_filtering=True,id=79905cbd-3475-4c02-aba3-aa94a56a2823,network=Network(843ceaba-5a3c-4324-bb33-81a695f19d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79905cbd-34') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG os_vif [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ff:04,bridge_name='br-int',has_traffic_filtering=True,id=79905cbd-3475-4c02-aba3-aa94a56a2823,network=Network(843ceaba-5a3c-4324-bb33-81a695f19d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79905cbd-34') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79905cbd-34, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:58:35 user nova-compute[73469]: INFO os_vif [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ff:04,bridge_name='br-int',has_traffic_filtering=True,id=79905cbd-3475-4c02-aba3-aa94a56a2823,network=Network(843ceaba-5a3c-4324-bb33-81a695f19d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79905cbd-34')
Aug 22 02:58:35 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Deleting instance files /opt/stack/data/nova/instances/56f5786e-f554-479f-93a7-0d4834ce9fce_del
Aug 22 02:58:35 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Deletion of /opt/stack/data/nova/instances/56f5786e-f554-479f-93a7-0d4834ce9fce_del complete
Aug 22 02:58:35 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 02:58:35 user nova-compute[73469]: INFO nova.compute.manager [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 22 02:58:35 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Successfully updated port: 4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquired lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-4044666f-9741-4bd3-95b7-0aeb302fa422 req-797aa9a2-9cd2-4b54-b0ce-d04e83021ea2 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received event network-changed-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-4044666f-9741-4bd3-95b7-0aeb302fa422 req-797aa9a2-9cd2-4b54-b0ce-d04e83021ea2 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Refreshing instance network info cache due to event network-changed-4697b7dd-3290-45e0-baa6-01e13c682505. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4044666f-9741-4bd3-95b7-0aeb302fa422 req-797aa9a2-9cd2-4b54-b0ce-d04e83021ea2 service nova] Acquiring lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Updating instance_info_cache with network_info: [{"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Releasing lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Instance network_info: |[{"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4044666f-9741-4bd3-95b7-0aeb302fa422 req-797aa9a2-9cd2-4b54-b0ce-d04e83021ea2 service nova] Acquired lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.network.neutron [req-4044666f-9741-4bd3-95b7-0aeb302fa422 req-797aa9a2-9cd2-4b54-b0ce-d04e83021ea2 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Refreshing network info cache for port 4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Start _get_guest_xml network_info=[{"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:58:36 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:58:36 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:58:36 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Took 0.69 seconds to deallocate network for instance.
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:58:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-557066596',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-557066596',id=19,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMTW/Tu7Qz4gAEdctdCddqJYGhHttiA4fs+mQuki8sncrz2C58Mwmx016ibO7bJAestH4l3mZDH5pSwtYnqkhyYMBuOsLjWnHvwC5ttu6BXaJxmcDyZpua6cpuuHaMcLA==',key_name='tempest-keypair-510663035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca3e1f2f72c7497ca3ad923a4b9459dc',ramdisk_id='',reservation_id='r-y4g07ft5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-774227889',owner_user_name='tempest-AttachVolumeShelveTestJSON-774227889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:58:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41e697cd5e5f422f8ac90f7496f60936',uuid=d8433c45-b889-4a7b-88c2-ba00679b1d26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converting VIF {"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=4697b7dd-3290-45e0-baa6-01e13c682505,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4697b7dd-32') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'pci_devices' on Instance uuid d8433c45-b889-4a7b-88c2-ba00679b1d26 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:58:36 user nova-compute[73469]:   <uuid>d8433c45-b889-4a7b-88c2-ba00679b1d26</uuid>
Aug 22 02:58:36 user nova-compute[73469]:   <name>instance-00000013</name>
Aug 22 02:58:36 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:58:36 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:58:36 user nova-compute[73469]:   <metadata>
Aug 22 02:58:36 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:58:36 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:58:36 user nova-compute[73469]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-557066596</nova:name>
Aug 22 02:58:36 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:58:36</nova:creationTime>
Aug 22 02:58:36 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:58:36 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:58:36 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:58:36 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:58:36 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:58:36 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:58:36 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:58:36 user nova-compute[73469]:       <nova:owner>
Aug 22 02:58:36 user nova-compute[73469]:         <nova:user uuid="41e697cd5e5f422f8ac90f7496f60936">tempest-AttachVolumeShelveTestJSON-774227889-project-member</nova:user>
Aug 22 02:58:36 user nova-compute[73469]:         <nova:project uuid="ca3e1f2f72c7497ca3ad923a4b9459dc">tempest-AttachVolumeShelveTestJSON-774227889</nova:project>
Aug 22 02:58:36 user nova-compute[73469]:       </nova:owner>
Aug 22 02:58:36 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:58:36 user nova-compute[73469]:       <nova:ports>
Aug 22 02:58:36 user nova-compute[73469]:         <nova:port uuid="4697b7dd-3290-45e0-baa6-01e13c682505">
Aug 22 02:58:36 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 22 02:58:36 user nova-compute[73469]:         </nova:port>
Aug 22 02:58:36 user nova-compute[73469]:       </nova:ports>
Aug 22 02:58:36 user nova-compute[73469]:     </nova:instance>
Aug 22 02:58:36 user nova-compute[73469]:   </metadata>
Aug 22 02:58:36 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:58:36 user nova-compute[73469]:     <system>
Aug 22 02:58:36 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:58:36 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:58:36 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:58:36 user nova-compute[73469]:       <entry name="serial">d8433c45-b889-4a7b-88c2-ba00679b1d26</entry>
Aug 22 02:58:36 user nova-compute[73469]:       <entry name="uuid">d8433c45-b889-4a7b-88c2-ba00679b1d26</entry>
Aug 22 02:58:36 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:58:36 user nova-compute[73469]:     </system>
Aug 22 02:58:36 user nova-compute[73469]:   </sysinfo>
Aug 22 02:58:36 user nova-compute[73469]:   <os>
Aug 22 02:58:36 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:58:36 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:58:36 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:58:36 user nova-compute[73469]:   </os>
Aug 22 02:58:36 user nova-compute[73469]:   <features>
Aug 22 02:58:36 user nova-compute[73469]:     <acpi/>
Aug 22 02:58:36 user nova-compute[73469]:     <apic/>
Aug 22 02:58:36 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:58:36 user nova-compute[73469]:   </features>
Aug 22 02:58:36 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:58:36 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:58:36 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:58:36 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:58:36 user nova-compute[73469]:   </clock>
Aug 22 02:58:36 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:58:36 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:58:36 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:58:36 user nova-compute[73469]:   </cpu>
Aug 22 02:58:36 user nova-compute[73469]:   <devices>
Aug 22 02:58:36 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:58:36 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:58:36 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk"/>
Aug 22 02:58:36 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:58:36 user nova-compute[73469]:     </disk>
Aug 22 02:58:36 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:58:36 user nova-compute[73469]:       <mac address="fa:16:3e:fd:a3:4c"/>
Aug 22 02:58:36 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:58:36 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:58:36 user nova-compute[73469]:       <target dev="tap4697b7dd-32"/>
Aug 22 02:58:36 user nova-compute[73469]:     </interface>
Aug 22 02:58:36 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:58:36 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/console.log" append="off"/>
Aug 22 02:58:36 user nova-compute[73469]:     </serial>
Aug 22 02:58:36 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:58:36 user nova-compute[73469]:     <video>
Aug 22 02:58:36 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:58:36 user nova-compute[73469]:     </video>
Aug 22 02:58:36 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:58:36 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:58:36 user nova-compute[73469]:     </rng>
Aug 22 02:58:36 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:58:36 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:58:36 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:58:36 user nova-compute[73469]:     </memballoon>
Aug 22 02:58:36 user nova-compute[73469]:   </devices>
Aug 22 02:58:36 user nova-compute[73469]: </domain>
Aug 22 02:58:36 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:58:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-557066596',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-557066596',id=19,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMTW/Tu7Qz4gAEdctdCddqJYGhHttiA4fs+mQuki8sncrz2C58Mwmx016ibO7bJAestH4l3mZDH5pSwtYnqkhyYMBuOsLjWnHvwC5ttu6BXaJxmcDyZpua6cpuuHaMcLA==',key_name='tempest-keypair-510663035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca3e1f2f72c7497ca3ad923a4b9459dc',ramdisk_id='',reservation_id='r-y4g07ft5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-774227889',owner_user_name='tempest-AttachVolumeShelveTestJSON-774227889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:58:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41e697cd5e5f422f8ac90f7496f60936',uuid=d8433c45-b889-4a7b-88c2-ba00679b1d26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converting VIF {"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=4697b7dd-3290-45e0-baa6-01e13c682505,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4697b7dd-32') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG os_vif [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=4697b7dd-3290-45e0-baa6-01e13c682505,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4697b7dd-32') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4697b7dd-32, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4697b7dd-32, col_values=(('external_ids', {'iface-id': '4697b7dd-3290-45e0-baa6-01e13c682505', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:a3:4c', 'vm-uuid': 'd8433c45-b889-4a7b-88c2-ba00679b1d26'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:36 user nova-compute[73469]: INFO os_vif [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=4697b7dd-3290-45e0-baa6-01e13c682505,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4697b7dd-32')
Aug 22 02:58:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] No VIF found with MAC fa:16:3e:fd:a3:4c, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:36 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Deleted allocations for instance 56f5786e-f554-479f-93a7-0d4834ce9fce
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673101.9184136, 71874297-5bc8-4816-b99e-58661ec38500 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:58:36 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 71874297-5bc8-4816-b99e-58661ec38500] VM Stopped (Lifecycle Event)
Aug 22 02:58:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6eab0d5f-248b-44fc-9196-1f1b7034d450 None None] [instance: 71874297-5bc8-4816-b99e-58661ec38500] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cee96876-c924-4b8b-ad50-9318e98e949e tempest-VolumesActionsTest-1793267254 tempest-VolumesActionsTest-1793267254-project-member] Lock "56f5786e-f554-479f-93a7-0d4834ce9fce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.194s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG nova.compute.manager [req-c6a88b55-0ead-4d01-a30a-a9ea4a06a8a4 req-ecdba743-6b70-4112-a28e-7e5e3f9b7229 service nova] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Received event network-vif-plugged-79905cbd-3475-4c02-aba3-aa94a56a2823 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c6a88b55-0ead-4d01-a30a-a9ea4a06a8a4 req-ecdba743-6b70-4112-a28e-7e5e3f9b7229 service nova] Acquiring lock "56f5786e-f554-479f-93a7-0d4834ce9fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c6a88b55-0ead-4d01-a30a-a9ea4a06a8a4 req-ecdba743-6b70-4112-a28e-7e5e3f9b7229 service nova] Lock "56f5786e-f554-479f-93a7-0d4834ce9fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c6a88b55-0ead-4d01-a30a-a9ea4a06a8a4 req-ecdba743-6b70-4112-a28e-7e5e3f9b7229 service nova] Lock "56f5786e-f554-479f-93a7-0d4834ce9fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG nova.compute.manager [req-c6a88b55-0ead-4d01-a30a-a9ea4a06a8a4 req-ecdba743-6b70-4112-a28e-7e5e3f9b7229 service nova] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] No waiting events found dispatching network-vif-plugged-79905cbd-3475-4c02-aba3-aa94a56a2823 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:58:37 user nova-compute[73469]: WARNING nova.compute.manager [req-c6a88b55-0ead-4d01-a30a-a9ea4a06a8a4 req-ecdba743-6b70-4112-a28e-7e5e3f9b7229 service nova] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Received unexpected event network-vif-plugged-79905cbd-3475-4c02-aba3-aa94a56a2823 for instance with vm_state deleted and task_state None.
Aug 22 02:58:37 user nova-compute[73469]: DEBUG nova.compute.manager [req-c6a88b55-0ead-4d01-a30a-a9ea4a06a8a4 req-ecdba743-6b70-4112-a28e-7e5e3f9b7229 service nova] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Received event network-vif-deleted-79905cbd-3475-4c02-aba3-aa94a56a2823 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG nova.network.neutron [req-4044666f-9741-4bd3-95b7-0aeb302fa422 req-797aa9a2-9cd2-4b54-b0ce-d04e83021ea2 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Updated VIF entry in instance network info cache for port 4697b7dd-3290-45e0-baa6-01e13c682505. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG nova.network.neutron [req-4044666f-9741-4bd3-95b7-0aeb302fa422 req-797aa9a2-9cd2-4b54-b0ce-d04e83021ea2 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Updating instance_info_cache with network_info: [{"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4044666f-9741-4bd3-95b7-0aeb302fa422 req-797aa9a2-9cd2-4b54-b0ce-d04e83021ea2 service nova] Releasing lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-0f4e667d-37e4-4061-b75d-b924602ec7b4 req-c5dac231-2b09-4e2a-adcf-b76f6021ce32 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received event network-vif-plugged-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0f4e667d-37e4-4061-b75d-b924602ec7b4 req-c5dac231-2b09-4e2a-adcf-b76f6021ce32 service nova] Acquiring lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0f4e667d-37e4-4061-b75d-b924602ec7b4 req-c5dac231-2b09-4e2a-adcf-b76f6021ce32 service nova] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0f4e667d-37e4-4061-b75d-b924602ec7b4 req-c5dac231-2b09-4e2a-adcf-b76f6021ce32 service nova] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-0f4e667d-37e4-4061-b75d-b924602ec7b4 req-c5dac231-2b09-4e2a-adcf-b76f6021ce32 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] No waiting events found dispatching network-vif-plugged-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:58:39 user nova-compute[73469]: WARNING nova.compute.manager [req-0f4e667d-37e4-4061-b75d-b924602ec7b4 req-c5dac231-2b09-4e2a-adcf-b76f6021ce32 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received unexpected event network-vif-plugged-4697b7dd-3290-45e0-baa6-01e13c682505 for instance with vm_state building and task_state spawning.
Aug 22 02:58:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-0f4e667d-37e4-4061-b75d-b924602ec7b4 req-c5dac231-2b09-4e2a-adcf-b76f6021ce32 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received event network-vif-plugged-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0f4e667d-37e4-4061-b75d-b924602ec7b4 req-c5dac231-2b09-4e2a-adcf-b76f6021ce32 service nova] Acquiring lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0f4e667d-37e4-4061-b75d-b924602ec7b4 req-c5dac231-2b09-4e2a-adcf-b76f6021ce32 service nova] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0f4e667d-37e4-4061-b75d-b924602ec7b4 req-c5dac231-2b09-4e2a-adcf-b76f6021ce32 service nova] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-0f4e667d-37e4-4061-b75d-b924602ec7b4 req-c5dac231-2b09-4e2a-adcf-b76f6021ce32 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] No waiting events found dispatching network-vif-plugged-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:58:39 user nova-compute[73469]: WARNING nova.compute.manager [req-0f4e667d-37e4-4061-b75d-b924602ec7b4 req-c5dac231-2b09-4e2a-adcf-b76f6021ce32 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received unexpected event network-vif-plugged-4697b7dd-3290-45e0-baa6-01e13c682505 for instance with vm_state building and task_state spawning.
Aug 22 02:58:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:39 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 02:58:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8242cec1-3b35-4d14-9e0b-db8a7e75697d/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8242cec1-3b35-4d14-9e0b-db8a7e75697d/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8242cec1-3b35-4d14-9e0b-db8a7e75697d/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8242cec1-3b35-4d14-9e0b-db8a7e75697d/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673119.9911368, d8433c45-b889-4a7b-88c2-ba00679b1d26 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:58:40 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] VM Resumed (Lifecycle Event)
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:58:40 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Instance spawned successfully.
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:58:40 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673119.9920194, d8433c45-b889-4a7b-88c2-ba00679b1d26 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:58:40 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] VM Started (Lifecycle Event)
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:58:40 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:58:40 user nova-compute[73469]: INFO nova.compute.manager [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Took 6.64 seconds to spawn the instance on the hypervisor.
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 02:58:40 user nova-compute[73469]: INFO nova.compute.manager [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Took 7.38 seconds to build instance.
Aug 22 02:58:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b4b69bd4-4dc3-4985-bf8c-c3b4c24e627a tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.574s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:40 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:58:40 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=7194MB free_disk=25.358200073242188GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d0668c0-7a49-4857-9b69-541021f18ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance dc3f5545-8ebb-4947-97d0-98a91f67e421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f5fdf305-bf02-4b53-bb0d-83e939ae1acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 3ade8cba-6c34-4457-9ad3-484a604dbdb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8242cec1-3b35-4d14-9e0b-db8a7e75697d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance ddef86ef-9510-4010-b34b-68ac6d95652b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 2e621408-a0af-460b-80a2-3446b5f1aadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 5984759d-28f1-45e8-bb4c-27bd8df426f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance d8433c45-b889-4a7b-88c2-ba00679b1d26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 02:58:40 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlaTVeqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:58:41 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:58:41 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:58:41 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf7d4a1-65c0-49cc-b984-f69d270d6b52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 02:58:41 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c096298-854f-400b-aac4-8243379653eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2] added
Aug 22 02:58:41 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[393093a1-0664-459f-a5b1-406030a5b918]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6c996c-81ef-4db4-8fb8-ad04038ee821]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZlaTVeqW {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZlaTVeqW" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c17e88e-0130-443d-bdba-4a4177e0dad2]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZlaTVeqW'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddbfb27-577d-4ec3-9295-32b6fb8305dd]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.659s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[475feb72-ba22-4138-a1b0-b65eae4a5897]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:58:41 user nova-compute[73469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:58:41 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:58:41 user nova-compute[73469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:58:41 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] There are 0 instances to clean {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3352823e-1eb4-4820-a1f4-3da574b0fef4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2, portal: 172.16.0.220,3260]
Aug 22 02:58:41 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2, portal: 172.16.0.220,3260] successful.
Aug 22 02:58:41 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b420975-ec97-4181-8fe7-b07ebc02b43d]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d2e882-0428-4b89-a750-28a321c5d463]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:58:41 user nova-compute[73469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:58:41 user nova-compute[73469]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 (non-flash)
Aug 22 02:58:41 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:58:41 user nova-compute[73469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:58:41 user nova-compute[73469]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 (non-flash)
Aug 22 02:58:41 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7976a88d-763e-4340-8743-9ba250f5e20a]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:58:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlaTVeqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 02:58:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:58:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '26538626138383266', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:58:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538626138383266', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 02:58:42 user nova-compute[73469]: DEBUG nova.objects.instance [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lazy-loading 'flavor' on Instance uuid ddef86ef-9510-4010-b34b-68ac6d95652b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:58:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 02:58:42 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:58:42 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 02:58:42 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 02:58:42 user nova-compute[73469]:   <serial>51dccd0a-1a13-4153-953a-6a35fd1969e2</serial>
Aug 22 02:58:42 user nova-compute[73469]: </disk>
Aug 22 02:58:42 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 02:58:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:58:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] No BDM found with device name hda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:58:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] No VIF found with MAC fa:16:3e:7a:e5:d0, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:58:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-767bd0da-5e0f-482b-a4a0-74b9387c21a1 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.266s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:43 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:58:43 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:58:43 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:58:43 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 02:58:43 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 02:58:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-bda33a54-edf0-4809-9469-f1774fdc5b12" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:58:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-bda33a54-edf0-4809-9469-f1774fdc5b12" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:58:43 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 02:58:43 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid bda33a54-edf0-4809-9469-f1774fdc5b12 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:58:44 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Updating instance_info_cache with network_info: [{"id": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "address": "fa:16:3e:bb:16:09", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2932ec7b-19", "ovs_interfaceid": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:58:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-bda33a54-edf0-4809-9469-f1774fdc5b12" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:58:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 02:58:44 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:58:44 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:58:44 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:58:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 02:58:44 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:58:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquiring lock "ddef86ef-9510-4010-b34b-68ac6d95652b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:45 user nova-compute[73469]: INFO nova.compute.manager [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Detaching volume 51dccd0a-1a13-4153-953a-6a35fd1969e2
Aug 22 02:58:45 user nova-compute[73469]: INFO nova.virt.block_device [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Attempting to driver detach volume 51dccd0a-1a13-4153-953a-6a35fd1969e2 from mountpoint /dev/vdb
Aug 22 02:58:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Attempting to detach device vdb from instance ddef86ef-9510-4010-b34b-68ac6d95652b from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 02:58:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 02:58:45 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:58:45 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 02:58:45 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 02:58:45 user nova-compute[73469]:   <serial>51dccd0a-1a13-4153-953a-6a35fd1969e2</serial>
Aug 22 02:58:45 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 22 02:58:45 user nova-compute[73469]: </disk>
Aug 22 02:58:45 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 02:58:45 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Successfully detached device vdb from instance ddef86ef-9510-4010-b34b-68ac6d95652b from the persistent domain config.
Aug 22 02:58:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ddef86ef-9510-4010-b34b-68ac6d95652b from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 02:58:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 02:58:45 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:58:45 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 02:58:45 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 02:58:45 user nova-compute[73469]:   <serial>51dccd0a-1a13-4153-953a-6a35fd1969e2</serial>
Aug 22 02:58:45 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 22 02:58:45 user nova-compute[73469]: </disk>
Aug 22 02:58:45 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692673126.3270001, ddef86ef-9510-4010-b34b-68ac6d95652b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ddef86ef-9510-4010-b34b-68ac6d95652b {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 02:58:46 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Successfully detached device vdb from instance ddef86ef-9510-4010-b34b-68ac6d95652b from the live domain config.
Aug 22 02:58:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlaTVeqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:58:46 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:58:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c054d8f6-6f48-4d2e-838a-cc704eacc5e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[584d0763-a94f-4293-9746-ee7084dc24eb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:58:46 user nova-compute[73469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:58:46 user nova-compute[73469]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 (non-flash)
Aug 22 02:58:46 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:58:46 user nova-compute[73469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:58:46 user nova-compute[73469]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 (non-flash)
Aug 22 02:58:46 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7980780430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8601d72-cdeb-456c-a32f-68b9f8f597b5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f73e74a-0079-46c3-b2c3-d24b4e929ab7]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7ba7af-69a7-4b3a-b1b3-493de2118533]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[83651b06-7afe-46dc-8cc9-f61655925186]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[22902143-a8fd-4956-941e-1f685e5ae3ce]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5a30fc-eb4c-45a8-9978-2381bf8d8ec2]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2, portal: 172.16.0.220,3260]
Aug 22 02:58:46 user nova-compute[73469]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2, portal: 172.16.0.220,3260] successful.
Aug 22 02:58:46 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51dccd0a-1a13-4153-953a-6a35fd1969e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a75437-db4e-4c56-bb46-84cbd4ea3e93]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] <== disconnect_volume: return (296ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:58:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 02:58:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-88bc8711-2786-411a-a09b-5e915cf84575 req-b580cbfb-0828-4cd6-8b57-ed628f86dc20 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received event network-changed-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-88bc8711-2786-411a-a09b-5e915cf84575 req-b580cbfb-0828-4cd6-8b57-ed628f86dc20 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Refreshing instance network info cache due to event network-changed-1b3de561-7dd1-4d48-8932-05c4e4770538. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:58:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-88bc8711-2786-411a-a09b-5e915cf84575 req-b580cbfb-0828-4cd6-8b57-ed628f86dc20 service nova] Acquiring lock "refresh_cache-2e621408-a0af-460b-80a2-3446b5f1aadb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:58:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-88bc8711-2786-411a-a09b-5e915cf84575 req-b580cbfb-0828-4cd6-8b57-ed628f86dc20 service nova] Acquired lock "refresh_cache-2e621408-a0af-460b-80a2-3446b5f1aadb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:58:49 user nova-compute[73469]: DEBUG nova.network.neutron [req-88bc8711-2786-411a-a09b-5e915cf84575 req-b580cbfb-0828-4cd6-8b57-ed628f86dc20 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Refreshing network info cache for port 1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:58:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:50 user nova-compute[73469]: DEBUG nova.network.neutron [req-88bc8711-2786-411a-a09b-5e915cf84575 req-b580cbfb-0828-4cd6-8b57-ed628f86dc20 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Updated VIF entry in instance network info cache for port 1b3de561-7dd1-4d48-8932-05c4e4770538. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:58:50 user nova-compute[73469]: DEBUG nova.network.neutron [req-88bc8711-2786-411a-a09b-5e915cf84575 req-b580cbfb-0828-4cd6-8b57-ed628f86dc20 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Updating instance_info_cache with network_info: [{"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:58:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-88bc8711-2786-411a-a09b-5e915cf84575 req-b580cbfb-0828-4cd6-8b57-ed628f86dc20 service nova] Releasing lock "refresh_cache-2e621408-a0af-460b-80a2-3446b5f1aadb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:58:50 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673115.3835769, 56f5786e-f554-479f-93a7-0d4834ce9fce => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:58:50 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] VM Stopped (Lifecycle Event)
Aug 22 02:58:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7cbb33-4503-484e-a44b-a3073c46322a None None] [instance: 56f5786e-f554-479f-93a7-0d4834ce9fce] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:58:50 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:58:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid bda33a54-edf0-4809-9469-f1774fdc5b12 {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 02:58:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid 9d0668c0-7a49-4857-9b69-541021f18ab2 {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 02:58:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid dc3f5545-8ebb-4947-97d0-98a91f67e421 {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 02:58:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid f5fdf305-bf02-4b53-bb0d-83e939ae1acb {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 02:58:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid 3ade8cba-6c34-4457-9ad3-484a604dbdb6 {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 02:58:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid 8242cec1-3b35-4d14-9e0b-db8a7e75697d {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 02:58:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid ddef86ef-9510-4010-b34b-68ac6d95652b {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 02:58:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 02:58:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid 5984759d-28f1-45e8-bb4c-27bd8df426f4 {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 02:58:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid d8433c45-b889-4a7b-88c2-ba00679b1d26 {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 02:58:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "bda33a54-edf0-4809-9469-f1774fdc5b12" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "bda33a54-edf0-4809-9469-f1774fdc5b12" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "9d0668c0-7a49-4857-9b69-541021f18ab2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "dc3f5545-8ebb-4947-97d0-98a91f67e421" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "ddef86ef-9510-4010-b34b-68ac6d95652b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "d8433c45-b889-4a7b-88c2-ba00679b1d26" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.189s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.192s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.202s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.208s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.216s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.213s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.222s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.224s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "bda33a54-edf0-4809-9469-f1774fdc5b12" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.236s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "82e872a7-70b0-4290-9a11-5316765aed01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "82e872a7-70b0-4290-9a11-5316765aed01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:53 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 02:58:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:53 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 02:58:53 user nova-compute[73469]: INFO nova.compute.claims [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Claim successful on node user
Aug 22 02:58:53 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Refreshing inventories for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 22 02:58:53 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Updating ProviderTree inventory for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 22 02:58:53 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Updating inventory in ProviderTree for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 22 02:58:53 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Refreshing aggregate associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, aggregates: None {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Refreshing trait associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.objects.instance [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lazy-loading 'flavor' on Instance uuid ddef86ef-9510-4010-b34b-68ac6d95652b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-310c420d-8d55-42de-8c66-99fb59d07079 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.599s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.393s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.736s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquiring lock "interface-ddef86ef-9510-4010-b34b-68ac6d95652b-44db6566-31ff-47e8-869e-af9454f7975d" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "interface-ddef86ef-9510-4010-b34b-68ac6d95652b-44db6566-31ff-47e8-869e-af9454f7975d" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lazy-loading 'flavor' on Instance uuid ddef86ef-9510-4010-b34b-68ac6d95652b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258093798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1258093798',id=15,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQKuMRYunlJu8NopZqi0nqkba6dIOrT/1x7SWN1QBY4cmXStVS07i0EQBQsjpw0PFF97qA9J41BXlNPdvO8dtd6gzmgVzrLwxcMsATaGBS/meCQ+o0tinvjbTrFfRBF+A==',key_name='tempest-keypair-187903951',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:56:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4179baa30282429b8bfff7beafb95390',ramdisk_id='',reservation_id='r-jfk6r0p6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-909833900',owner_user_name='tempest-TaggedAttachmentsTest-909833900-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95599bfe510e4edb80093a2a4365503e',uuid=ddef86ef-9510-4010-b34b-68ac6d95652b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44db6566-31ff-47e8-869e-af9454f7975d", "address": "fa:16:3e:08:fe:80", "network": {"id": "ef2191ea-7a09-4508-9c79-e9f6195c4edb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1754302342", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44db6566-31", "ovs_interfaceid": "44db6566-31ff-47e8-869e-af9454f7975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Converting VIF {"id": "44db6566-31ff-47e8-869e-af9454f7975d", "address": "fa:16:3e:08:fe:80", "network": {"id": "ef2191ea-7a09-4508-9c79-e9f6195c4edb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1754302342", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44db6566-31", "ovs_interfaceid": "44db6566-31ff-47e8-869e-af9454f7975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:fe:80,bridge_name='br-int',has_traffic_filtering=True,id=44db6566-31ff-47e8-869e-af9454f7975d,network=Network(ef2191ea-7a09-4508-9c79-e9f6195c4edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44db6566-31') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:08:fe:80"/><model type="virtio"/><mtu size="1442"/><target dev="tap44db6566-31"/></interface> {{(pid=73469) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:08:fe:80"/><model type="virtio"/><mtu size="1442"/><target dev="tap44db6566-31"/></interface> {{(pid=73469) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Attempting to detach device tap44db6566-31 from instance ddef86ef-9510-4010-b34b-68ac6d95652b from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] detach device xml: <interface type="ethernet">
Aug 22 02:58:54 user nova-compute[73469]:   <mac address="fa:16:3e:08:fe:80"/>
Aug 22 02:58:54 user nova-compute[73469]:   <model type="virtio"/>
Aug 22 02:58:54 user nova-compute[73469]:   <mtu size="1442"/>
Aug 22 02:58:54 user nova-compute[73469]:   <target dev="tap44db6566-31"/>
Aug 22 02:58:54 user nova-compute[73469]: </interface>
Aug 22 02:58:54 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:08:fe:80"/><model type="virtio"/><mtu size="1442"/><target dev="tap44db6566-31"/></interface> {{(pid=73469) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:08:fe:80"/><model type="virtio"/><mtu size="1442"/><target dev="tap44db6566-31"/></interface>not found in domain: <domain type='kvm' id='16'>
Aug 22 02:58:54 user nova-compute[73469]:   <name>instance-0000000f</name>
Aug 22 02:58:54 user nova-compute[73469]:   <uuid>ddef86ef-9510-4010-b34b-68ac6d95652b</uuid>
Aug 22 02:58:54 user nova-compute[73469]:   <metadata>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:58:54 user nova-compute[73469]:   <nova:package version="0.0.0"/>
Aug 22 02:58:54 user nova-compute[73469]:   <nova:name>tempest-device-tagging-server-1258093798</nova:name>
Aug 22 02:58:54 user nova-compute[73469]:   <nova:creationTime>2023-08-22 02:58:25</nova:creationTime>
Aug 22 02:58:54 user nova-compute[73469]:   <nova:flavor name="m1.tiny">
Aug 22 02:58:54 user nova-compute[73469]:     <nova:memory>512</nova:memory>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:disk>1</nova:disk>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:swap>0</nova:swap>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:vcpus>1</nova:vcpus>
Aug 22 02:58:54 user nova-compute[73469]:   </nova:flavor>
Aug 22 02:58:54 user nova-compute[73469]:   <nova:owner>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:user uuid="95599bfe510e4edb80093a2a4365503e">tempest-TaggedAttachmentsTest-909833900-project-member</nova:user>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:project uuid="4179baa30282429b8bfff7beafb95390">tempest-TaggedAttachmentsTest-909833900</nova:project>
Aug 22 02:58:54 user nova-compute[73469]:   </nova:owner>
Aug 22 02:58:54 user nova-compute[73469]:   <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:58:54 user nova-compute[73469]:   <nova:ports>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:port uuid="0427a59c-aa48-4b73-9579-e91d5e1830b0">
Aug 22 02:58:54 user nova-compute[73469]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 22 02:58:54 user nova-compute[73469]:     </nova:port>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:port uuid="44db6566-31ff-47e8-869e-af9454f7975d">
Aug 22 02:58:54 user nova-compute[73469]:       <nova:ip type="fixed" address="10.10.10.148" ipVersion="4"/>
Aug 22 02:58:54 user nova-compute[73469]:     </nova:port>
Aug 22 02:58:54 user nova-compute[73469]:   </nova:ports>
Aug 22 02:58:54 user nova-compute[73469]: </nova:instance>
Aug 22 02:58:54 user nova-compute[73469]:   </metadata>
Aug 22 02:58:54 user nova-compute[73469]:   <memory unit='KiB'>524288</memory>
Aug 22 02:58:54 user nova-compute[73469]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 22 02:58:54 user nova-compute[73469]:   <vcpu placement='static'>1</vcpu>
Aug 22 02:58:54 user nova-compute[73469]:   <resource>
Aug 22 02:58:54 user nova-compute[73469]:     <partition>/machine</partition>
Aug 22 02:58:54 user nova-compute[73469]:   </resource>
Aug 22 02:58:54 user nova-compute[73469]:   <sysinfo type='smbios'>
Aug 22 02:58:54 user nova-compute[73469]:     <system>
Aug 22 02:58:54 user nova-compute[73469]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 22 02:58:54 user nova-compute[73469]:       <entry name='product'>OpenStack Nova</entry>
Aug 22 02:58:54 user nova-compute[73469]:       <entry name='version'>0.0.0</entry>
Aug 22 02:58:54 user nova-compute[73469]:       <entry name='serial'>ddef86ef-9510-4010-b34b-68ac6d95652b</entry>
Aug 22 02:58:54 user nova-compute[73469]:       <entry name='uuid'>ddef86ef-9510-4010-b34b-68ac6d95652b</entry>
Aug 22 02:58:54 user nova-compute[73469]:       <entry name='family'>Virtual Machine</entry>
Aug 22 02:58:54 user nova-compute[73469]:     </system>
Aug 22 02:58:54 user nova-compute[73469]:   </sysinfo>
Aug 22 02:58:54 user nova-compute[73469]:   <os>
Aug 22 02:58:54 user nova-compute[73469]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 22 02:58:54 user nova-compute[73469]:     <boot dev='hd'/>
Aug 22 02:58:54 user nova-compute[73469]:     <smbios mode='sysinfo'/>
Aug 22 02:58:54 user nova-compute[73469]:   </os>
Aug 22 02:58:54 user nova-compute[73469]:   <features>
Aug 22 02:58:54 user nova-compute[73469]:     <acpi/>
Aug 22 02:58:54 user nova-compute[73469]:     <apic/>
Aug 22 02:58:54 user nova-compute[73469]:     <vmcoreinfo state='on'/>
Aug 22 02:58:54 user nova-compute[73469]:   </features>
Aug 22 02:58:54 user nova-compute[73469]:   <cpu mode='custom' match='exact' check='full'>
Aug 22 02:58:54 user nova-compute[73469]:     <model fallback='forbid'>Nehalem</model>
Aug 22 02:58:54 user nova-compute[73469]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 22 02:58:54 user nova-compute[73469]:     <feature policy='require' name='vme'/>
Aug 22 02:58:54 user nova-compute[73469]:     <feature policy='require' name='x2apic'/>
Aug 22 02:58:54 user nova-compute[73469]:     <feature policy='require' name='hypervisor'/>
Aug 22 02:58:54 user nova-compute[73469]:   </cpu>
Aug 22 02:58:54 user nova-compute[73469]:   <clock offset='utc'>
Aug 22 02:58:54 user nova-compute[73469]:     <timer name='pit' tickpolicy='delay'/>
Aug 22 02:58:54 user nova-compute[73469]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 22 02:58:54 user nova-compute[73469]:     <timer name='hpet' present='no'/>
Aug 22 02:58:54 user nova-compute[73469]:   </clock>
Aug 22 02:58:54 user nova-compute[73469]:   <on_poweroff>destroy</on_poweroff>
Aug 22 02:58:54 user nova-compute[73469]:   <on_reboot>restart</on_reboot>
Aug 22 02:58:54 user nova-compute[73469]:   <on_crash>destroy</on_crash>
Aug 22 02:58:54 user nova-compute[73469]:   <devices>
Aug 22 02:58:54 user nova-compute[73469]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 22 02:58:54 user nova-compute[73469]:     <disk type='file' device='disk'>
Aug 22 02:58:54 user nova-compute[73469]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 22 02:58:54 user nova-compute[73469]:       <source file='/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk' index='2'/>
Aug 22 02:58:54 user nova-compute[73469]:       <backingStore type='file' index='3'>
Aug 22 02:58:54 user nova-compute[73469]:         <format type='raw'/>
Aug 22 02:58:54 user nova-compute[73469]:         <source file='/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc'/>
Aug 22 02:58:54 user nova-compute[73469]:         <backingStore/>
Aug 22 02:58:54 user nova-compute[73469]:       </backingStore>
Aug 22 02:58:54 user nova-compute[73469]:       <target dev='vda' bus='virtio'/>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='virtio-disk0'/>
Aug 22 02:58:54 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </disk>
Aug 22 02:58:54 user nova-compute[73469]:     <disk type='file' device='cdrom'>
Aug 22 02:58:54 user nova-compute[73469]:       <driver name='qemu' type='raw' cache='none'/>
Aug 22 02:58:54 user nova-compute[73469]:       <source file='/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk.config' index='1'/>
Aug 22 02:58:54 user nova-compute[73469]:       <backingStore/>
Aug 22 02:58:54 user nova-compute[73469]:       <target dev='hda' bus='ide'/>
Aug 22 02:58:54 user nova-compute[73469]:       <readonly/>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='ide0-0-0'/>
Aug 22 02:58:54 user nova-compute[73469]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </disk>
Aug 22 02:58:54 user nova-compute[73469]:     <controller type='usb' index='0' model='none'>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='usb'/>
Aug 22 02:58:54 user nova-compute[73469]:     </controller>
Aug 22 02:58:54 user nova-compute[73469]:     <controller type='pci' index='0' model='pci-root'>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='pci.0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </controller>
Aug 22 02:58:54 user nova-compute[73469]:     <controller type='ide' index='0'>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='ide'/>
Aug 22 02:58:54 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 22 02:58:54 user nova-compute[73469]:     </controller>
Aug 22 02:58:54 user nova-compute[73469]:     <interface type='ethernet'>
Aug 22 02:58:54 user nova-compute[73469]:       <mac address='fa:16:3e:7a:e5:d0'/>
Aug 22 02:58:54 user nova-compute[73469]:       <target dev='tap0427a59c-aa'/>
Aug 22 02:58:54 user nova-compute[73469]:       <model type='virtio'/>
Aug 22 02:58:54 user nova-compute[73469]:       <mtu size='1442'/>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='net0'/>
Aug 22 02:58:54 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </interface>
Aug 22 02:58:54 user nova-compute[73469]:     <interface type='ethernet'>
Aug 22 02:58:54 user nova-compute[73469]:       <mac address='fa:16:3e:08:fe:80'/>
Aug 22 02:58:54 user nova-compute[73469]:       <target dev='tap44db6566-31'/>
Aug 22 02:58:54 user nova-compute[73469]:       <model type='virtio'/>
Aug 22 02:58:54 user nova-compute[73469]:       <mtu size='1442'/>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='net1'/>
Aug 22 02:58:54 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </interface>
Aug 22 02:58:54 user nova-compute[73469]:     <serial type='pty'>
Aug 22 02:58:54 user nova-compute[73469]:       <source path='/dev/pts/5'/>
Aug 22 02:58:54 user nova-compute[73469]:       <log file='/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/console.log' append='off'/>
Aug 22 02:58:54 user nova-compute[73469]:       <target type='isa-serial' port='0'>
Aug 22 02:58:54 user nova-compute[73469]:         <model name='isa-serial'/>
Aug 22 02:58:54 user nova-compute[73469]:       </target>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='serial0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </serial>
Aug 22 02:58:54 user nova-compute[73469]:     <console type='pty' tty='/dev/pts/5'>
Aug 22 02:58:54 user nova-compute[73469]:       <source path='/dev/pts/5'/>
Aug 22 02:58:54 user nova-compute[73469]:       <log file='/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/console.log' append='off'/>
Aug 22 02:58:54 user nova-compute[73469]:       <target type='serial' port='0'/>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='serial0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </console>
Aug 22 02:58:54 user nova-compute[73469]:     <input type='mouse' bus='ps2'>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='input0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </input>
Aug 22 02:58:54 user nova-compute[73469]:     <input type='keyboard' bus='ps2'>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='input1'/>
Aug 22 02:58:54 user nova-compute[73469]:     </input>
Aug 22 02:58:54 user nova-compute[73469]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 22 02:58:54 user nova-compute[73469]:       <listen type='address' address='0.0.0.0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </graphics>
Aug 22 02:58:54 user nova-compute[73469]:     <audio id='1' type='none'/>
Aug 22 02:58:54 user nova-compute[73469]:     <video>
Aug 22 02:58:54 user nova-compute[73469]:       <model type='virtio' heads='1' primary='yes'/>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='video0'/>
Aug 22 02:58:54 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </video>
Aug 22 02:58:54 user nova-compute[73469]:     <memballoon model='virtio'>
Aug 22 02:58:54 user nova-compute[73469]:       <stats period='10'/>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='balloon0'/>
Aug 22 02:58:54 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </memballoon>
Aug 22 02:58:54 user nova-compute[73469]:     <rng model='virtio'>
Aug 22 02:58:54 user nova-compute[73469]:       <backend model='random'>/dev/urandom</backend>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='rng0'/>
Aug 22 02:58:54 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </rng>
Aug 22 02:58:54 user nova-compute[73469]:   </devices>
Aug 22 02:58:54 user nova-compute[73469]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 22 02:58:54 user nova-compute[73469]:     <label>libvirt-ddef86ef-9510-4010-b34b-68ac6d95652b</label>
Aug 22 02:58:54 user nova-compute[73469]:     <imagelabel>libvirt-ddef86ef-9510-4010-b34b-68ac6d95652b</imagelabel>
Aug 22 02:58:54 user nova-compute[73469]:   </seclabel>
Aug 22 02:58:54 user nova-compute[73469]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 22 02:58:54 user nova-compute[73469]:     <label>+64055:+108</label>
Aug 22 02:58:54 user nova-compute[73469]:     <imagelabel>+64055:+108</imagelabel>
Aug 22 02:58:54 user nova-compute[73469]:   </seclabel>
Aug 22 02:58:54 user nova-compute[73469]: </domain>
Aug 22 02:58:54 user nova-compute[73469]:  {{(pid=73469) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 22 02:58:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Successfully detached device tap44db6566-31 from instance ddef86ef-9510-4010-b34b-68ac6d95652b from the persistent domain config.
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] (1/8): Attempting to detach device tap44db6566-31 with device alias net1 from instance ddef86ef-9510-4010-b34b-68ac6d95652b from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] detach device xml: <interface type="ethernet">
Aug 22 02:58:54 user nova-compute[73469]:   <mac address="fa:16:3e:08:fe:80"/>
Aug 22 02:58:54 user nova-compute[73469]:   <model type="virtio"/>
Aug 22 02:58:54 user nova-compute[73469]:   <mtu size="1442"/>
Aug 22 02:58:54 user nova-compute[73469]:   <target dev="tap44db6566-31"/>
Aug 22 02:58:54 user nova-compute[73469]: </interface>
Aug 22 02:58:54 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 02:58:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.policy [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b47d6cefd0d4949bf4c3c0fc72a9cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1c312e979e47558b06d4fa70bc103a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 02:58:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Creating image(s)
Aug 22 02:58:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "/opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "/opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "/opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692673134.8677197, ddef86ef-9510-4010-b34b-68ac6d95652b => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Start waiting for the detach event from libvirt for device tap44db6566-31 with device alias net1 for instance ddef86ef-9510-4010-b34b-68ac6d95652b {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:08:fe:80"/><model type="virtio"/><mtu size="1442"/><target dev="tap44db6566-31"/></interface> {{(pid=73469) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:08:fe:80"/><model type="virtio"/><mtu size="1442"/><target dev="tap44db6566-31"/></interface>not found in domain: <domain type='kvm' id='16'>
Aug 22 02:58:54 user nova-compute[73469]:   <name>instance-0000000f</name>
Aug 22 02:58:54 user nova-compute[73469]:   <uuid>ddef86ef-9510-4010-b34b-68ac6d95652b</uuid>
Aug 22 02:58:54 user nova-compute[73469]:   <metadata>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:58:54 user nova-compute[73469]:   <nova:package version="0.0.0"/>
Aug 22 02:58:54 user nova-compute[73469]:   <nova:name>tempest-device-tagging-server-1258093798</nova:name>
Aug 22 02:58:54 user nova-compute[73469]:   <nova:creationTime>2023-08-22 02:58:25</nova:creationTime>
Aug 22 02:58:54 user nova-compute[73469]:   <nova:flavor name="m1.tiny">
Aug 22 02:58:54 user nova-compute[73469]:     <nova:memory>512</nova:memory>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:disk>1</nova:disk>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:swap>0</nova:swap>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:vcpus>1</nova:vcpus>
Aug 22 02:58:54 user nova-compute[73469]:   </nova:flavor>
Aug 22 02:58:54 user nova-compute[73469]:   <nova:owner>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:user uuid="95599bfe510e4edb80093a2a4365503e">tempest-TaggedAttachmentsTest-909833900-project-member</nova:user>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:project uuid="4179baa30282429b8bfff7beafb95390">tempest-TaggedAttachmentsTest-909833900</nova:project>
Aug 22 02:58:54 user nova-compute[73469]:   </nova:owner>
Aug 22 02:58:54 user nova-compute[73469]:   <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:58:54 user nova-compute[73469]:   <nova:ports>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:port uuid="0427a59c-aa48-4b73-9579-e91d5e1830b0">
Aug 22 02:58:54 user nova-compute[73469]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 22 02:58:54 user nova-compute[73469]:     </nova:port>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:port uuid="44db6566-31ff-47e8-869e-af9454f7975d">
Aug 22 02:58:54 user nova-compute[73469]:       <nova:ip type="fixed" address="10.10.10.148" ipVersion="4"/>
Aug 22 02:58:54 user nova-compute[73469]:     </nova:port>
Aug 22 02:58:54 user nova-compute[73469]:   </nova:ports>
Aug 22 02:58:54 user nova-compute[73469]: </nova:instance>
Aug 22 02:58:54 user nova-compute[73469]:   </metadata>
Aug 22 02:58:54 user nova-compute[73469]:   <memory unit='KiB'>524288</memory>
Aug 22 02:58:54 user nova-compute[73469]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 22 02:58:54 user nova-compute[73469]:   <vcpu placement='static'>1</vcpu>
Aug 22 02:58:54 user nova-compute[73469]:   <resource>
Aug 22 02:58:54 user nova-compute[73469]:     <partition>/machine</partition>
Aug 22 02:58:54 user nova-compute[73469]:   </resource>
Aug 22 02:58:54 user nova-compute[73469]:   <sysinfo type='smbios'>
Aug 22 02:58:54 user nova-compute[73469]:     <system>
Aug 22 02:58:54 user nova-compute[73469]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 22 02:58:54 user nova-compute[73469]:       <entry name='product'>OpenStack Nova</entry>
Aug 22 02:58:54 user nova-compute[73469]:       <entry name='version'>0.0.0</entry>
Aug 22 02:58:54 user nova-compute[73469]:       <entry name='serial'>ddef86ef-9510-4010-b34b-68ac6d95652b</entry>
Aug 22 02:58:54 user nova-compute[73469]:       <entry name='uuid'>ddef86ef-9510-4010-b34b-68ac6d95652b</entry>
Aug 22 02:58:54 user nova-compute[73469]:       <entry name='family'>Virtual Machine</entry>
Aug 22 02:58:54 user nova-compute[73469]:     </system>
Aug 22 02:58:54 user nova-compute[73469]:   </sysinfo>
Aug 22 02:58:54 user nova-compute[73469]:   <os>
Aug 22 02:58:54 user nova-compute[73469]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 22 02:58:54 user nova-compute[73469]:     <boot dev='hd'/>
Aug 22 02:58:54 user nova-compute[73469]:     <smbios mode='sysinfo'/>
Aug 22 02:58:54 user nova-compute[73469]:   </os>
Aug 22 02:58:54 user nova-compute[73469]:   <features>
Aug 22 02:58:54 user nova-compute[73469]:     <acpi/>
Aug 22 02:58:54 user nova-compute[73469]:     <apic/>
Aug 22 02:58:54 user nova-compute[73469]:     <vmcoreinfo state='on'/>
Aug 22 02:58:54 user nova-compute[73469]:   </features>
Aug 22 02:58:54 user nova-compute[73469]:   <cpu mode='custom' match='exact' check='full'>
Aug 22 02:58:54 user nova-compute[73469]:     <model fallback='forbid'>Nehalem</model>
Aug 22 02:58:54 user nova-compute[73469]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 22 02:58:54 user nova-compute[73469]:     <feature policy='require' name='vme'/>
Aug 22 02:58:54 user nova-compute[73469]:     <feature policy='require' name='x2apic'/>
Aug 22 02:58:54 user nova-compute[73469]:     <feature policy='require' name='hypervisor'/>
Aug 22 02:58:54 user nova-compute[73469]:   </cpu>
Aug 22 02:58:54 user nova-compute[73469]:   <clock offset='utc'>
Aug 22 02:58:54 user nova-compute[73469]:     <timer name='pit' tickpolicy='delay'/>
Aug 22 02:58:54 user nova-compute[73469]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 22 02:58:54 user nova-compute[73469]:     <timer name='hpet' present='no'/>
Aug 22 02:58:54 user nova-compute[73469]:   </clock>
Aug 22 02:58:54 user nova-compute[73469]:   <on_poweroff>destroy</on_poweroff>
Aug 22 02:58:54 user nova-compute[73469]:   <on_reboot>restart</on_reboot>
Aug 22 02:58:54 user nova-compute[73469]:   <on_crash>destroy</on_crash>
Aug 22 02:58:54 user nova-compute[73469]:   <devices>
Aug 22 02:58:54 user nova-compute[73469]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 22 02:58:54 user nova-compute[73469]:     <disk type='file' device='disk'>
Aug 22 02:58:54 user nova-compute[73469]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 22 02:58:54 user nova-compute[73469]:       <source file='/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk' index='2'/>
Aug 22 02:58:54 user nova-compute[73469]:       <backingStore type='file' index='3'>
Aug 22 02:58:54 user nova-compute[73469]:         <format type='raw'/>
Aug 22 02:58:54 user nova-compute[73469]:         <source file='/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc'/>
Aug 22 02:58:54 user nova-compute[73469]:         <backingStore/>
Aug 22 02:58:54 user nova-compute[73469]:       </backingStore>
Aug 22 02:58:54 user nova-compute[73469]:       <target dev='vda' bus='virtio'/>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='virtio-disk0'/>
Aug 22 02:58:54 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </disk>
Aug 22 02:58:54 user nova-compute[73469]:     <disk type='file' device='cdrom'>
Aug 22 02:58:54 user nova-compute[73469]:       <driver name='qemu' type='raw' cache='none'/>
Aug 22 02:58:54 user nova-compute[73469]:       <source file='/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk.config' index='1'/>
Aug 22 02:58:54 user nova-compute[73469]:       <backingStore/>
Aug 22 02:58:54 user nova-compute[73469]:       <target dev='hda' bus='ide'/>
Aug 22 02:58:54 user nova-compute[73469]:       <readonly/>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='ide0-0-0'/>
Aug 22 02:58:54 user nova-compute[73469]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </disk>
Aug 22 02:58:54 user nova-compute[73469]:     <controller type='usb' index='0' model='none'>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='usb'/>
Aug 22 02:58:54 user nova-compute[73469]:     </controller>
Aug 22 02:58:54 user nova-compute[73469]:     <controller type='pci' index='0' model='pci-root'>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='pci.0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </controller>
Aug 22 02:58:54 user nova-compute[73469]:     <controller type='ide' index='0'>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='ide'/>
Aug 22 02:58:54 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 22 02:58:54 user nova-compute[73469]:     </controller>
Aug 22 02:58:54 user nova-compute[73469]:     <interface type='ethernet'>
Aug 22 02:58:54 user nova-compute[73469]:       <mac address='fa:16:3e:7a:e5:d0'/>
Aug 22 02:58:54 user nova-compute[73469]:       <target dev='tap0427a59c-aa'/>
Aug 22 02:58:54 user nova-compute[73469]:       <model type='virtio'/>
Aug 22 02:58:54 user nova-compute[73469]:       <mtu size='1442'/>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='net0'/>
Aug 22 02:58:54 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </interface>
Aug 22 02:58:54 user nova-compute[73469]:     <serial type='pty'>
Aug 22 02:58:54 user nova-compute[73469]:       <source path='/dev/pts/5'/>
Aug 22 02:58:54 user nova-compute[73469]:       <log file='/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/console.log' append='off'/>
Aug 22 02:58:54 user nova-compute[73469]:       <target type='isa-serial' port='0'>
Aug 22 02:58:54 user nova-compute[73469]:         <model name='isa-serial'/>
Aug 22 02:58:54 user nova-compute[73469]:       </target>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='serial0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </serial>
Aug 22 02:58:54 user nova-compute[73469]:     <console type='pty' tty='/dev/pts/5'>
Aug 22 02:58:54 user nova-compute[73469]:       <source path='/dev/pts/5'/>
Aug 22 02:58:54 user nova-compute[73469]:       <log file='/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/console.log' append='off'/>
Aug 22 02:58:54 user nova-compute[73469]:       <target type='serial' port='0'/>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='serial0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </console>
Aug 22 02:58:54 user nova-compute[73469]:     <input type='mouse' bus='ps2'>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='input0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </input>
Aug 22 02:58:54 user nova-compute[73469]:     <input type='keyboard' bus='ps2'>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='input1'/>
Aug 22 02:58:54 user nova-compute[73469]:     </input>
Aug 22 02:58:54 user nova-compute[73469]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 22 02:58:54 user nova-compute[73469]:       <listen type='address' address='0.0.0.0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </graphics>
Aug 22 02:58:54 user nova-compute[73469]:     <audio id='1' type='none'/>
Aug 22 02:58:54 user nova-compute[73469]:     <video>
Aug 22 02:58:54 user nova-compute[73469]:       <model type='virtio' heads='1' primary='yes'/>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='video0'/>
Aug 22 02:58:54 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </video>
Aug 22 02:58:54 user nova-compute[73469]:     <memballoon model='virtio'>
Aug 22 02:58:54 user nova-compute[73469]:       <stats period='10'/>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='balloon0'/>
Aug 22 02:58:54 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </memballoon>
Aug 22 02:58:54 user nova-compute[73469]:     <rng model='virtio'>
Aug 22 02:58:54 user nova-compute[73469]:       <backend model='random'>/dev/urandom</backend>
Aug 22 02:58:54 user nova-compute[73469]:       <alias name='rng0'/>
Aug 22 02:58:54 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 22 02:58:54 user nova-compute[73469]:     </rng>
Aug 22 02:58:54 user nova-compute[73469]:   </devices>
Aug 22 02:58:54 user nova-compute[73469]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 22 02:58:54 user nova-compute[73469]:     <label>libvirt-ddef86ef-9510-4010-b34b-68ac6d95652b</label>
Aug 22 02:58:54 user nova-compute[73469]:     <imagelabel>libvirt-ddef86ef-9510-4010-b34b-68ac6d95652b</imagelabel>
Aug 22 02:58:54 user nova-compute[73469]:   </seclabel>
Aug 22 02:58:54 user nova-compute[73469]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 22 02:58:54 user nova-compute[73469]:     <label>+64055:+108</label>
Aug 22 02:58:54 user nova-compute[73469]:     <imagelabel>+64055:+108</imagelabel>
Aug 22 02:58:54 user nova-compute[73469]:   </seclabel>
Aug 22 02:58:54 user nova-compute[73469]: </domain>
Aug 22 02:58:54 user nova-compute[73469]:  {{(pid=73469) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 22 02:58:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Successfully detached device tap44db6566-31 from instance ddef86ef-9510-4010-b34b-68ac6d95652b from the live domain config.
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258093798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1258093798',id=15,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQKuMRYunlJu8NopZqi0nqkba6dIOrT/1x7SWN1QBY4cmXStVS07i0EQBQsjpw0PFF97qA9J41BXlNPdvO8dtd6gzmgVzrLwxcMsATaGBS/meCQ+o0tinvjbTrFfRBF+A==',key_name='tempest-keypair-187903951',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:56:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4179baa30282429b8bfff7beafb95390',ramdisk_id='',reservation_id='r-jfk6r0p6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-909833900',owner_user_name='tempest-TaggedAttachmentsTest-909833900-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95599bfe510e4edb80093a2a4365503e',uuid=ddef86ef-9510-4010-b34b-68ac6d95652b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44db6566-31ff-47e8-869e-af9454f7975d", "address": "fa:16:3e:08:fe:80", "network": {"id": "ef2191ea-7a09-4508-9c79-e9f6195c4edb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1754302342", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44db6566-31", "ovs_interfaceid": "44db6566-31ff-47e8-869e-af9454f7975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Converting VIF {"id": "44db6566-31ff-47e8-869e-af9454f7975d", "address": "fa:16:3e:08:fe:80", "network": {"id": "ef2191ea-7a09-4508-9c79-e9f6195c4edb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1754302342", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44db6566-31", "ovs_interfaceid": "44db6566-31ff-47e8-869e-af9454f7975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:fe:80,bridge_name='br-int',has_traffic_filtering=True,id=44db6566-31ff-47e8-869e-af9454f7975d,network=Network(ef2191ea-7a09-4508-9c79-e9f6195c4edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44db6566-31') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG os_vif [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:fe:80,bridge_name='br-int',has_traffic_filtering=True,id=44db6566-31ff-47e8-869e-af9454f7975d,network=Network(ef2191ea-7a09-4508-9c79-e9f6195c4edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44db6566-31') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.objects.instance [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'flavor' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44db6566-31, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:58:54 user nova-compute[73469]: INFO os_vif [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:fe:80,bridge_name='br-int',has_traffic_filtering=True,id=44db6566-31ff-47e8-869e-af9454f7975d,network=Network(ef2191ea-7a09-4508-9c79-e9f6195c4edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44db6566-31')
Aug 22 02:58:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:58:54 user nova-compute[73469]:   <nova:package version="0.0.0"/>
Aug 22 02:58:54 user nova-compute[73469]:   <nova:name>tempest-device-tagging-server-1258093798</nova:name>
Aug 22 02:58:54 user nova-compute[73469]:   <nova:creationTime>2023-08-22 02:58:54</nova:creationTime>
Aug 22 02:58:54 user nova-compute[73469]:   <nova:flavor name="m1.tiny">
Aug 22 02:58:54 user nova-compute[73469]:     <nova:memory>512</nova:memory>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:disk>1</nova:disk>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:swap>0</nova:swap>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:vcpus>1</nova:vcpus>
Aug 22 02:58:54 user nova-compute[73469]:   </nova:flavor>
Aug 22 02:58:54 user nova-compute[73469]:   <nova:owner>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:user uuid="95599bfe510e4edb80093a2a4365503e">tempest-TaggedAttachmentsTest-909833900-project-member</nova:user>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:project uuid="4179baa30282429b8bfff7beafb95390">tempest-TaggedAttachmentsTest-909833900</nova:project>
Aug 22 02:58:54 user nova-compute[73469]:   </nova:owner>
Aug 22 02:58:54 user nova-compute[73469]:   <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:58:54 user nova-compute[73469]:   <nova:ports>
Aug 22 02:58:54 user nova-compute[73469]:     <nova:port uuid="0427a59c-aa48-4b73-9579-e91d5e1830b0">
Aug 22 02:58:54 user nova-compute[73469]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 22 02:58:54 user nova-compute[73469]:     </nova:port>
Aug 22 02:58:54 user nova-compute[73469]:   </nova:ports>
Aug 22 02:58:54 user nova-compute[73469]: </nova:instance>
Aug 22 02:58:54 user nova-compute[73469]:  {{(pid=73469) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.219s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.113s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-347f7598-b8ed-4b36-9c3b-9c3125150040 req-959f865e-e8bb-48bb-b857-5036d5ddefe8 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received event network-vif-unplugged-44db6566-31ff-47e8-869e-af9454f7975d {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-347f7598-b8ed-4b36-9c3b-9c3125150040 req-959f865e-e8bb-48bb-b857-5036d5ddefe8 service nova] Acquiring lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-347f7598-b8ed-4b36-9c3b-9c3125150040 req-959f865e-e8bb-48bb-b857-5036d5ddefe8 service nova] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-347f7598-b8ed-4b36-9c3b-9c3125150040 req-959f865e-e8bb-48bb-b857-5036d5ddefe8 service nova] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-347f7598-b8ed-4b36-9c3b-9c3125150040 req-959f865e-e8bb-48bb-b857-5036d5ddefe8 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] No waiting events found dispatching network-vif-unplugged-44db6566-31ff-47e8-869e-af9454f7975d {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:58:55 user nova-compute[73469]: WARNING nova.compute.manager [req-347f7598-b8ed-4b36-9c3b-9c3125150040 req-959f865e-e8bb-48bb-b857-5036d5ddefe8 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received unexpected event network-vif-unplugged-44db6566-31ff-47e8-869e-af9454f7975d for instance with vm_state active and task_state None.
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.204s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk 1073741824" returned: 0 in 0.061s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:55 user nova-compute[73469]: INFO nova.compute.manager [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Attaching volume 27716b1b-781f-47e7-992b-7521fda49ee3 to /dev/vdb
Aug 22 02:58:55 user nova-compute[73469]: DEBUG os_brick.utils [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f3aeb7-3004-45d5-b23e-1da81a2daf00]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[be21d8eb-20cf-4322-ac09-26bbc4098958]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[49292302-3969-45e1-8297-06565c9b9e47]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf677ea-618f-48b2-9034-c504b0970347]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.240s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 02:58:55 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ef695b-8367-44d4-ad94-0028c4d7042b]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG os_brick.utils [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Updating existing volume attachment record: 502da398-e338-4d94-bd96-9714803c355f {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-2731e4b4-ca11-4634-b610-705876d2d08a req-3619d6f5-e40a-47ca-9a05-5e6b310598ab service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received event network-vif-deleted-44db6566-31ff-47e8-869e-af9454f7975d {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:55 user nova-compute[73469]: INFO nova.compute.manager [req-2731e4b4-ca11-4634-b610-705876d2d08a req-3619d6f5-e40a-47ca-9a05-5e6b310598ab service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Neutron deleted interface 44db6566-31ff-47e8-869e-af9454f7975d; detaching it from the instance and deleting it from the info cache
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.network.neutron [req-2731e4b4-ca11-4634-b610-705876d2d08a req-3619d6f5-e40a-47ca-9a05-5e6b310598ab service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Updating instance_info_cache with network_info: [{"id": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "address": "fa:16:3e:7a:e5:d0", "network": {"id": "f787ebbc-4ddc-4671-8a1a-e15d3da6d019", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-677642733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0427a59c-aa", "ovs_interfaceid": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Successfully created port: 78ca747b-f8a3-4bde-8c6d-bfd860eca41b {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.objects.instance [req-2731e4b4-ca11-4634-b610-705876d2d08a req-3619d6f5-e40a-47ca-9a05-5e6b310598ab service nova] Lazy-loading 'system_metadata' on Instance uuid ddef86ef-9510-4010-b34b-68ac6d95652b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquiring lock "refresh_cache-ddef86ef-9510-4010-b34b-68ac6d95652b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquired lock "refresh_cache-ddef86ef-9510-4010-b34b-68ac6d95652b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.objects.instance [req-2731e4b4-ca11-4634-b610-705876d2d08a req-3619d6f5-e40a-47ca-9a05-5e6b310598ab service nova] Lazy-loading 'flavor' on Instance uuid ddef86ef-9510-4010-b34b-68ac6d95652b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [req-2731e4b4-ca11-4634-b610-705876d2d08a req-3619d6f5-e40a-47ca-9a05-5e6b310598ab service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258093798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1258093798',id=15,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQKuMRYunlJu8NopZqi0nqkba6dIOrT/1x7SWN1QBY4cmXStVS07i0EQBQsjpw0PFF97qA9J41BXlNPdvO8dtd6gzmgVzrLwxcMsATaGBS/meCQ+o0tinvjbTrFfRBF+A==',key_name='tempest-keypair-187903951',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:56:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4179baa30282429b8bfff7beafb95390',ramdisk_id='',reservation_id='r-jfk6r0p6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-909833900',owner_user_name='tempest-TaggedAttachmentsTest-909833900-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95599bfe510e4edb80093a2a4365503e',uuid=ddef86ef-9510-4010-b34b-68ac6d95652b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44db6566-31ff-47e8-869e-af9454f7975d", "address": "fa:16:3e:08:fe:80", "network": {"id": "ef2191ea-7a09-4508-9c79-e9f6195c4edb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1754302342", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44db6566-31", "ovs_interfaceid": "44db6566-31ff-47e8-869e-af9454f7975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.network.os_vif_util [req-2731e4b4-ca11-4634-b610-705876d2d08a req-3619d6f5-e40a-47ca-9a05-5e6b310598ab service nova] Converting VIF {"id": "44db6566-31ff-47e8-869e-af9454f7975d", "address": "fa:16:3e:08:fe:80", "network": {"id": "ef2191ea-7a09-4508-9c79-e9f6195c4edb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1754302342", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44db6566-31", "ovs_interfaceid": "44db6566-31ff-47e8-869e-af9454f7975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.network.os_vif_util [req-2731e4b4-ca11-4634-b610-705876d2d08a req-3619d6f5-e40a-47ca-9a05-5e6b310598ab service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:fe:80,bridge_name='br-int',has_traffic_filtering=True,id=44db6566-31ff-47e8-869e-af9454f7975d,network=Network(ef2191ea-7a09-4508-9c79-e9f6195c4edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44db6566-31') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Cannot resize image /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'migration_context' on Instance uuid 82e872a7-70b0-4290-9a11-5316765aed01 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [req-2731e4b4-ca11-4634-b610-705876d2d08a req-3619d6f5-e40a-47ca-9a05-5e6b310598ab service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:08:fe:80"/><model type="virtio"/><mtu size="1442"/><target dev="tap44db6566-31"/></interface> {{(pid=73469) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [req-2731e4b4-ca11-4634-b610-705876d2d08a req-3619d6f5-e40a-47ca-9a05-5e6b310598ab service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:08:fe:80"/><model type="virtio"/><mtu size="1442"/><target dev="tap44db6566-31"/></interface>not found in domain: <domain type='kvm' id='16'>
Aug 22 02:58:55 user nova-compute[73469]:   <name>instance-0000000f</name>
Aug 22 02:58:55 user nova-compute[73469]:   <uuid>ddef86ef-9510-4010-b34b-68ac6d95652b</uuid>
Aug 22 02:58:55 user nova-compute[73469]:   <metadata>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:58:55 user nova-compute[73469]:   <nova:package version="0.0.0"/>
Aug 22 02:58:55 user nova-compute[73469]:   <nova:name>tempest-device-tagging-server-1258093798</nova:name>
Aug 22 02:58:55 user nova-compute[73469]:   <nova:creationTime>2023-08-22 02:58:54</nova:creationTime>
Aug 22 02:58:55 user nova-compute[73469]:   <nova:flavor name="m1.tiny">
Aug 22 02:58:55 user nova-compute[73469]:     <nova:memory>512</nova:memory>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:disk>1</nova:disk>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:swap>0</nova:swap>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:vcpus>1</nova:vcpus>
Aug 22 02:58:55 user nova-compute[73469]:   </nova:flavor>
Aug 22 02:58:55 user nova-compute[73469]:   <nova:owner>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:user uuid="95599bfe510e4edb80093a2a4365503e">tempest-TaggedAttachmentsTest-909833900-project-member</nova:user>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:project uuid="4179baa30282429b8bfff7beafb95390">tempest-TaggedAttachmentsTest-909833900</nova:project>
Aug 22 02:58:55 user nova-compute[73469]:   </nova:owner>
Aug 22 02:58:55 user nova-compute[73469]:   <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:58:55 user nova-compute[73469]:   <nova:ports>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:port uuid="0427a59c-aa48-4b73-9579-e91d5e1830b0">
Aug 22 02:58:55 user nova-compute[73469]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 22 02:58:55 user nova-compute[73469]:     </nova:port>
Aug 22 02:58:55 user nova-compute[73469]:   </nova:ports>
Aug 22 02:58:55 user nova-compute[73469]: </nova:instance>
Aug 22 02:58:55 user nova-compute[73469]:   </metadata>
Aug 22 02:58:55 user nova-compute[73469]:   <memory unit='KiB'>524288</memory>
Aug 22 02:58:55 user nova-compute[73469]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 22 02:58:55 user nova-compute[73469]:   <vcpu placement='static'>1</vcpu>
Aug 22 02:58:55 user nova-compute[73469]:   <resource>
Aug 22 02:58:55 user nova-compute[73469]:     <partition>/machine</partition>
Aug 22 02:58:55 user nova-compute[73469]:   </resource>
Aug 22 02:58:55 user nova-compute[73469]:   <sysinfo type='smbios'>
Aug 22 02:58:55 user nova-compute[73469]:     <system>
Aug 22 02:58:55 user nova-compute[73469]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 22 02:58:55 user nova-compute[73469]:       <entry name='product'>OpenStack Nova</entry>
Aug 22 02:58:55 user nova-compute[73469]:       <entry name='version'>0.0.0</entry>
Aug 22 02:58:55 user nova-compute[73469]:       <entry name='serial'>ddef86ef-9510-4010-b34b-68ac6d95652b</entry>
Aug 22 02:58:55 user nova-compute[73469]:       <entry name='uuid'>ddef86ef-9510-4010-b34b-68ac6d95652b</entry>
Aug 22 02:58:55 user nova-compute[73469]:       <entry name='family'>Virtual Machine</entry>
Aug 22 02:58:55 user nova-compute[73469]:     </system>
Aug 22 02:58:55 user nova-compute[73469]:   </sysinfo>
Aug 22 02:58:55 user nova-compute[73469]:   <os>
Aug 22 02:58:55 user nova-compute[73469]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 22 02:58:55 user nova-compute[73469]:     <boot dev='hd'/>
Aug 22 02:58:55 user nova-compute[73469]:     <smbios mode='sysinfo'/>
Aug 22 02:58:55 user nova-compute[73469]:   </os>
Aug 22 02:58:55 user nova-compute[73469]:   <features>
Aug 22 02:58:55 user nova-compute[73469]:     <acpi/>
Aug 22 02:58:55 user nova-compute[73469]:     <apic/>
Aug 22 02:58:55 user nova-compute[73469]:     <vmcoreinfo state='on'/>
Aug 22 02:58:55 user nova-compute[73469]:   </features>
Aug 22 02:58:55 user nova-compute[73469]:   <cpu mode='custom' match='exact' check='full'>
Aug 22 02:58:55 user nova-compute[73469]:     <model fallback='forbid'>Nehalem</model>
Aug 22 02:58:55 user nova-compute[73469]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 22 02:58:55 user nova-compute[73469]:     <feature policy='require' name='vme'/>
Aug 22 02:58:55 user nova-compute[73469]:     <feature policy='require' name='x2apic'/>
Aug 22 02:58:55 user nova-compute[73469]:     <feature policy='require' name='hypervisor'/>
Aug 22 02:58:55 user nova-compute[73469]:   </cpu>
Aug 22 02:58:55 user nova-compute[73469]:   <clock offset='utc'>
Aug 22 02:58:55 user nova-compute[73469]:     <timer name='pit' tickpolicy='delay'/>
Aug 22 02:58:55 user nova-compute[73469]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 22 02:58:55 user nova-compute[73469]:     <timer name='hpet' present='no'/>
Aug 22 02:58:55 user nova-compute[73469]:   </clock>
Aug 22 02:58:55 user nova-compute[73469]:   <on_poweroff>destroy</on_poweroff>
Aug 22 02:58:55 user nova-compute[73469]:   <on_reboot>restart</on_reboot>
Aug 22 02:58:55 user nova-compute[73469]:   <on_crash>destroy</on_crash>
Aug 22 02:58:55 user nova-compute[73469]:   <devices>
Aug 22 02:58:55 user nova-compute[73469]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 22 02:58:55 user nova-compute[73469]:     <disk type='file' device='disk'>
Aug 22 02:58:55 user nova-compute[73469]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 22 02:58:55 user nova-compute[73469]:       <source file='/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk' index='2'/>
Aug 22 02:58:55 user nova-compute[73469]:       <backingStore type='file' index='3'>
Aug 22 02:58:55 user nova-compute[73469]:         <format type='raw'/>
Aug 22 02:58:55 user nova-compute[73469]:         <source file='/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc'/>
Aug 22 02:58:55 user nova-compute[73469]:         <backingStore/>
Aug 22 02:58:55 user nova-compute[73469]:       </backingStore>
Aug 22 02:58:55 user nova-compute[73469]:       <target dev='vda' bus='virtio'/>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='virtio-disk0'/>
Aug 22 02:58:55 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </disk>
Aug 22 02:58:55 user nova-compute[73469]:     <disk type='file' device='cdrom'>
Aug 22 02:58:55 user nova-compute[73469]:       <driver name='qemu' type='raw' cache='none'/>
Aug 22 02:58:55 user nova-compute[73469]:       <source file='/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk.config' index='1'/>
Aug 22 02:58:55 user nova-compute[73469]:       <backingStore/>
Aug 22 02:58:55 user nova-compute[73469]:       <target dev='hda' bus='ide'/>
Aug 22 02:58:55 user nova-compute[73469]:       <readonly/>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='ide0-0-0'/>
Aug 22 02:58:55 user nova-compute[73469]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </disk>
Aug 22 02:58:55 user nova-compute[73469]:     <controller type='usb' index='0' model='none'>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='usb'/>
Aug 22 02:58:55 user nova-compute[73469]:     </controller>
Aug 22 02:58:55 user nova-compute[73469]:     <controller type='pci' index='0' model='pci-root'>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='pci.0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </controller>
Aug 22 02:58:55 user nova-compute[73469]:     <controller type='ide' index='0'>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='ide'/>
Aug 22 02:58:55 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 22 02:58:55 user nova-compute[73469]:     </controller>
Aug 22 02:58:55 user nova-compute[73469]:     <interface type='ethernet'>
Aug 22 02:58:55 user nova-compute[73469]:       <mac address='fa:16:3e:7a:e5:d0'/>
Aug 22 02:58:55 user nova-compute[73469]:       <target dev='tap0427a59c-aa'/>
Aug 22 02:58:55 user nova-compute[73469]:       <model type='virtio'/>
Aug 22 02:58:55 user nova-compute[73469]:       <mtu size='1442'/>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='net0'/>
Aug 22 02:58:55 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </interface>
Aug 22 02:58:55 user nova-compute[73469]:     <serial type='pty'>
Aug 22 02:58:55 user nova-compute[73469]:       <source path='/dev/pts/5'/>
Aug 22 02:58:55 user nova-compute[73469]:       <log file='/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/console.log' append='off'/>
Aug 22 02:58:55 user nova-compute[73469]:       <target type='isa-serial' port='0'>
Aug 22 02:58:55 user nova-compute[73469]:         <model name='isa-serial'/>
Aug 22 02:58:55 user nova-compute[73469]:       </target>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='serial0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </serial>
Aug 22 02:58:55 user nova-compute[73469]:     <console type='pty' tty='/dev/pts/5'>
Aug 22 02:58:55 user nova-compute[73469]:       <source path='/dev/pts/5'/>
Aug 22 02:58:55 user nova-compute[73469]:       <log file='/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/console.log' append='off'/>
Aug 22 02:58:55 user nova-compute[73469]:       <target type='serial' port='0'/>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='serial0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </console>
Aug 22 02:58:55 user nova-compute[73469]:     <input type='mouse' bus='ps2'>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='input0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </input>
Aug 22 02:58:55 user nova-compute[73469]:     <input type='keyboard' bus='ps2'>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='input1'/>
Aug 22 02:58:55 user nova-compute[73469]:     </input>
Aug 22 02:58:55 user nova-compute[73469]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 22 02:58:55 user nova-compute[73469]:       <listen type='address' address='0.0.0.0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </graphics>
Aug 22 02:58:55 user nova-compute[73469]:     <audio id='1' type='none'/>
Aug 22 02:58:55 user nova-compute[73469]:     <video>
Aug 22 02:58:55 user nova-compute[73469]:       <model type='virtio' heads='1' primary='yes'/>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='video0'/>
Aug 22 02:58:55 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </video>
Aug 22 02:58:55 user nova-compute[73469]:     <memballoon model='virtio'>
Aug 22 02:58:55 user nova-compute[73469]:       <stats period='10'/>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='balloon0'/>
Aug 22 02:58:55 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </memballoon>
Aug 22 02:58:55 user nova-compute[73469]:     <rng model='virtio'>
Aug 22 02:58:55 user nova-compute[73469]:       <backend model='random'>/dev/urandom</backend>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='rng0'/>
Aug 22 02:58:55 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </rng>
Aug 22 02:58:55 user nova-compute[73469]:   </devices>
Aug 22 02:58:55 user nova-compute[73469]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 22 02:58:55 user nova-compute[73469]:     <label>libvirt-ddef86ef-9510-4010-b34b-68ac6d95652b</label>
Aug 22 02:58:55 user nova-compute[73469]:     <imagelabel>libvirt-ddef86ef-9510-4010-b34b-68ac6d95652b</imagelabel>
Aug 22 02:58:55 user nova-compute[73469]:   </seclabel>
Aug 22 02:58:55 user nova-compute[73469]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 22 02:58:55 user nova-compute[73469]:     <label>+64055:+108</label>
Aug 22 02:58:55 user nova-compute[73469]:     <imagelabel>+64055:+108</imagelabel>
Aug 22 02:58:55 user nova-compute[73469]:   </seclabel>
Aug 22 02:58:55 user nova-compute[73469]: </domain>
Aug 22 02:58:55 user nova-compute[73469]:  {{(pid=73469) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [req-2731e4b4-ca11-4634-b610-705876d2d08a req-3619d6f5-e40a-47ca-9a05-5e6b310598ab service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:08:fe:80"/><model type="virtio"/><mtu size="1442"/><target dev="tap44db6566-31"/></interface> {{(pid=73469) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Ensure instance console log exists: /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [req-2731e4b4-ca11-4634-b610-705876d2d08a req-3619d6f5-e40a-47ca-9a05-5e6b310598ab service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:08:fe:80"/><model type="virtio"/><mtu size="1442"/><target dev="tap44db6566-31"/></interface>not found in domain: <domain type='kvm' id='16'>
Aug 22 02:58:55 user nova-compute[73469]:   <name>instance-0000000f</name>
Aug 22 02:58:55 user nova-compute[73469]:   <uuid>ddef86ef-9510-4010-b34b-68ac6d95652b</uuid>
Aug 22 02:58:55 user nova-compute[73469]:   <metadata>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:58:55 user nova-compute[73469]:   <nova:package version="0.0.0"/>
Aug 22 02:58:55 user nova-compute[73469]:   <nova:name>tempest-device-tagging-server-1258093798</nova:name>
Aug 22 02:58:55 user nova-compute[73469]:   <nova:creationTime>2023-08-22 02:58:54</nova:creationTime>
Aug 22 02:58:55 user nova-compute[73469]:   <nova:flavor name="m1.tiny">
Aug 22 02:58:55 user nova-compute[73469]:     <nova:memory>512</nova:memory>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:disk>1</nova:disk>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:swap>0</nova:swap>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:vcpus>1</nova:vcpus>
Aug 22 02:58:55 user nova-compute[73469]:   </nova:flavor>
Aug 22 02:58:55 user nova-compute[73469]:   <nova:owner>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:user uuid="95599bfe510e4edb80093a2a4365503e">tempest-TaggedAttachmentsTest-909833900-project-member</nova:user>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:project uuid="4179baa30282429b8bfff7beafb95390">tempest-TaggedAttachmentsTest-909833900</nova:project>
Aug 22 02:58:55 user nova-compute[73469]:   </nova:owner>
Aug 22 02:58:55 user nova-compute[73469]:   <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:58:55 user nova-compute[73469]:   <nova:ports>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:port uuid="0427a59c-aa48-4b73-9579-e91d5e1830b0">
Aug 22 02:58:55 user nova-compute[73469]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 22 02:58:55 user nova-compute[73469]:     </nova:port>
Aug 22 02:58:55 user nova-compute[73469]:   </nova:ports>
Aug 22 02:58:55 user nova-compute[73469]: </nova:instance>
Aug 22 02:58:55 user nova-compute[73469]:   </metadata>
Aug 22 02:58:55 user nova-compute[73469]:   <memory unit='KiB'>524288</memory>
Aug 22 02:58:55 user nova-compute[73469]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 22 02:58:55 user nova-compute[73469]:   <vcpu placement='static'>1</vcpu>
Aug 22 02:58:55 user nova-compute[73469]:   <resource>
Aug 22 02:58:55 user nova-compute[73469]:     <partition>/machine</partition>
Aug 22 02:58:55 user nova-compute[73469]:   </resource>
Aug 22 02:58:55 user nova-compute[73469]:   <sysinfo type='smbios'>
Aug 22 02:58:55 user nova-compute[73469]:     <system>
Aug 22 02:58:55 user nova-compute[73469]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 22 02:58:55 user nova-compute[73469]:       <entry name='product'>OpenStack Nova</entry>
Aug 22 02:58:55 user nova-compute[73469]:       <entry name='version'>0.0.0</entry>
Aug 22 02:58:55 user nova-compute[73469]:       <entry name='serial'>ddef86ef-9510-4010-b34b-68ac6d95652b</entry>
Aug 22 02:58:55 user nova-compute[73469]:       <entry name='uuid'>ddef86ef-9510-4010-b34b-68ac6d95652b</entry>
Aug 22 02:58:55 user nova-compute[73469]:       <entry name='family'>Virtual Machine</entry>
Aug 22 02:58:55 user nova-compute[73469]:     </system>
Aug 22 02:58:55 user nova-compute[73469]:   </sysinfo>
Aug 22 02:58:55 user nova-compute[73469]:   <os>
Aug 22 02:58:55 user nova-compute[73469]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 22 02:58:55 user nova-compute[73469]:     <boot dev='hd'/>
Aug 22 02:58:55 user nova-compute[73469]:     <smbios mode='sysinfo'/>
Aug 22 02:58:55 user nova-compute[73469]:   </os>
Aug 22 02:58:55 user nova-compute[73469]:   <features>
Aug 22 02:58:55 user nova-compute[73469]:     <acpi/>
Aug 22 02:58:55 user nova-compute[73469]:     <apic/>
Aug 22 02:58:55 user nova-compute[73469]:     <vmcoreinfo state='on'/>
Aug 22 02:58:55 user nova-compute[73469]:   </features>
Aug 22 02:58:55 user nova-compute[73469]:   <cpu mode='custom' match='exact' check='full'>
Aug 22 02:58:55 user nova-compute[73469]:     <model fallback='forbid'>Nehalem</model>
Aug 22 02:58:55 user nova-compute[73469]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 22 02:58:55 user nova-compute[73469]:     <feature policy='require' name='vme'/>
Aug 22 02:58:55 user nova-compute[73469]:     <feature policy='require' name='x2apic'/>
Aug 22 02:58:55 user nova-compute[73469]:     <feature policy='require' name='hypervisor'/>
Aug 22 02:58:55 user nova-compute[73469]:   </cpu>
Aug 22 02:58:55 user nova-compute[73469]:   <clock offset='utc'>
Aug 22 02:58:55 user nova-compute[73469]:     <timer name='pit' tickpolicy='delay'/>
Aug 22 02:58:55 user nova-compute[73469]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 22 02:58:55 user nova-compute[73469]:     <timer name='hpet' present='no'/>
Aug 22 02:58:55 user nova-compute[73469]:   </clock>
Aug 22 02:58:55 user nova-compute[73469]:   <on_poweroff>destroy</on_poweroff>
Aug 22 02:58:55 user nova-compute[73469]:   <on_reboot>restart</on_reboot>
Aug 22 02:58:55 user nova-compute[73469]:   <on_crash>destroy</on_crash>
Aug 22 02:58:55 user nova-compute[73469]:   <devices>
Aug 22 02:58:55 user nova-compute[73469]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 22 02:58:55 user nova-compute[73469]:     <disk type='file' device='disk'>
Aug 22 02:58:55 user nova-compute[73469]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 22 02:58:55 user nova-compute[73469]:       <source file='/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk' index='2'/>
Aug 22 02:58:55 user nova-compute[73469]:       <backingStore type='file' index='3'>
Aug 22 02:58:55 user nova-compute[73469]:         <format type='raw'/>
Aug 22 02:58:55 user nova-compute[73469]:         <source file='/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc'/>
Aug 22 02:58:55 user nova-compute[73469]:         <backingStore/>
Aug 22 02:58:55 user nova-compute[73469]:       </backingStore>
Aug 22 02:58:55 user nova-compute[73469]:       <target dev='vda' bus='virtio'/>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='virtio-disk0'/>
Aug 22 02:58:55 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </disk>
Aug 22 02:58:55 user nova-compute[73469]:     <disk type='file' device='cdrom'>
Aug 22 02:58:55 user nova-compute[73469]:       <driver name='qemu' type='raw' cache='none'/>
Aug 22 02:58:55 user nova-compute[73469]:       <source file='/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk.config' index='1'/>
Aug 22 02:58:55 user nova-compute[73469]:       <backingStore/>
Aug 22 02:58:55 user nova-compute[73469]:       <target dev='hda' bus='ide'/>
Aug 22 02:58:55 user nova-compute[73469]:       <readonly/>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='ide0-0-0'/>
Aug 22 02:58:55 user nova-compute[73469]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </disk>
Aug 22 02:58:55 user nova-compute[73469]:     <controller type='usb' index='0' model='none'>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='usb'/>
Aug 22 02:58:55 user nova-compute[73469]:     </controller>
Aug 22 02:58:55 user nova-compute[73469]:     <controller type='pci' index='0' model='pci-root'>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='pci.0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </controller>
Aug 22 02:58:55 user nova-compute[73469]:     <controller type='ide' index='0'>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='ide'/>
Aug 22 02:58:55 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 22 02:58:55 user nova-compute[73469]:     </controller>
Aug 22 02:58:55 user nova-compute[73469]:     <interface type='ethernet'>
Aug 22 02:58:55 user nova-compute[73469]:       <mac address='fa:16:3e:7a:e5:d0'/>
Aug 22 02:58:55 user nova-compute[73469]:       <target dev='tap0427a59c-aa'/>
Aug 22 02:58:55 user nova-compute[73469]:       <model type='virtio'/>
Aug 22 02:58:55 user nova-compute[73469]:       <mtu size='1442'/>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='net0'/>
Aug 22 02:58:55 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </interface>
Aug 22 02:58:55 user nova-compute[73469]:     <serial type='pty'>
Aug 22 02:58:55 user nova-compute[73469]:       <source path='/dev/pts/5'/>
Aug 22 02:58:55 user nova-compute[73469]:       <log file='/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/console.log' append='off'/>
Aug 22 02:58:55 user nova-compute[73469]:       <target type='isa-serial' port='0'>
Aug 22 02:58:55 user nova-compute[73469]:         <model name='isa-serial'/>
Aug 22 02:58:55 user nova-compute[73469]:       </target>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='serial0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </serial>
Aug 22 02:58:55 user nova-compute[73469]:     <console type='pty' tty='/dev/pts/5'>
Aug 22 02:58:55 user nova-compute[73469]:       <source path='/dev/pts/5'/>
Aug 22 02:58:55 user nova-compute[73469]:       <log file='/opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/console.log' append='off'/>
Aug 22 02:58:55 user nova-compute[73469]:       <target type='serial' port='0'/>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='serial0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </console>
Aug 22 02:58:55 user nova-compute[73469]:     <input type='mouse' bus='ps2'>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='input0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </input>
Aug 22 02:58:55 user nova-compute[73469]:     <input type='keyboard' bus='ps2'>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='input1'/>
Aug 22 02:58:55 user nova-compute[73469]:     </input>
Aug 22 02:58:55 user nova-compute[73469]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 22 02:58:55 user nova-compute[73469]:       <listen type='address' address='0.0.0.0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </graphics>
Aug 22 02:58:55 user nova-compute[73469]:     <audio id='1' type='none'/>
Aug 22 02:58:55 user nova-compute[73469]:     <video>
Aug 22 02:58:55 user nova-compute[73469]:       <model type='virtio' heads='1' primary='yes'/>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='video0'/>
Aug 22 02:58:55 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </video>
Aug 22 02:58:55 user nova-compute[73469]:     <memballoon model='virtio'>
Aug 22 02:58:55 user nova-compute[73469]:       <stats period='10'/>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='balloon0'/>
Aug 22 02:58:55 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </memballoon>
Aug 22 02:58:55 user nova-compute[73469]:     <rng model='virtio'>
Aug 22 02:58:55 user nova-compute[73469]:       <backend model='random'>/dev/urandom</backend>
Aug 22 02:58:55 user nova-compute[73469]:       <alias name='rng0'/>
Aug 22 02:58:55 user nova-compute[73469]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 22 02:58:55 user nova-compute[73469]:     </rng>
Aug 22 02:58:55 user nova-compute[73469]:   </devices>
Aug 22 02:58:55 user nova-compute[73469]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 22 02:58:55 user nova-compute[73469]:     <label>libvirt-ddef86ef-9510-4010-b34b-68ac6d95652b</label>
Aug 22 02:58:55 user nova-compute[73469]:     <imagelabel>libvirt-ddef86ef-9510-4010-b34b-68ac6d95652b</imagelabel>
Aug 22 02:58:55 user nova-compute[73469]:   </seclabel>
Aug 22 02:58:55 user nova-compute[73469]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 22 02:58:55 user nova-compute[73469]:     <label>+64055:+108</label>
Aug 22 02:58:55 user nova-compute[73469]:     <imagelabel>+64055:+108</imagelabel>
Aug 22 02:58:55 user nova-compute[73469]:   </seclabel>
Aug 22 02:58:55 user nova-compute[73469]: </domain>
Aug 22 02:58:55 user nova-compute[73469]:  {{(pid=73469) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 22 02:58:55 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [req-2731e4b4-ca11-4634-b610-705876d2d08a req-3619d6f5-e40a-47ca-9a05-5e6b310598ab service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Detaching interface fa:16:3e:08:fe:80 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap44db6566-31' not found.
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [req-2731e4b4-ca11-4634-b610-705876d2d08a req-3619d6f5-e40a-47ca-9a05-5e6b310598ab service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258093798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1258093798',id=15,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQKuMRYunlJu8NopZqi0nqkba6dIOrT/1x7SWN1QBY4cmXStVS07i0EQBQsjpw0PFF97qA9J41BXlNPdvO8dtd6gzmgVzrLwxcMsATaGBS/meCQ+o0tinvjbTrFfRBF+A==',key_name='tempest-keypair-187903951',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:56:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4179baa30282429b8bfff7beafb95390',ramdisk_id='',reservation_id='r-jfk6r0p6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-909833900',owner_user_name='tempest-TaggedAttachmentsTest-909833900-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95599bfe510e4edb80093a2a4365503e',uuid=ddef86ef-9510-4010-b34b-68ac6d95652b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44db6566-31ff-47e8-869e-af9454f7975d", "address": "fa:16:3e:08:fe:80", "network": {"id": "ef2191ea-7a09-4508-9c79-e9f6195c4edb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1754302342", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44db6566-31", "ovs_interfaceid": "44db6566-31ff-47e8-869e-af9454f7975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.network.os_vif_util [req-2731e4b4-ca11-4634-b610-705876d2d08a req-3619d6f5-e40a-47ca-9a05-5e6b310598ab service nova] Converting VIF {"id": "44db6566-31ff-47e8-869e-af9454f7975d", "address": "fa:16:3e:08:fe:80", "network": {"id": "ef2191ea-7a09-4508-9c79-e9f6195c4edb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1754302342", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44db6566-31", "ovs_interfaceid": "44db6566-31ff-47e8-869e-af9454f7975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.network.os_vif_util [req-2731e4b4-ca11-4634-b610-705876d2d08a req-3619d6f5-e40a-47ca-9a05-5e6b310598ab service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:fe:80,bridge_name='br-int',has_traffic_filtering=True,id=44db6566-31ff-47e8-869e-af9454f7975d,network=Network(ef2191ea-7a09-4508-9c79-e9f6195c4edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44db6566-31') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG os_vif [req-2731e4b4-ca11-4634-b610-705876d2d08a req-3619d6f5-e40a-47ca-9a05-5e6b310598ab service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:fe:80,bridge_name='br-int',has_traffic_filtering=True,id=44db6566-31ff-47e8-869e-af9454f7975d,network=Network(ef2191ea-7a09-4508-9c79-e9f6195c4edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44db6566-31') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44db6566-31, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:58:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:58:55 user nova-compute[73469]: INFO os_vif [req-2731e4b4-ca11-4634-b610-705876d2d08a req-3619d6f5-e40a-47ca-9a05-5e6b310598ab service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:fe:80,bridge_name='br-int',has_traffic_filtering=True,id=44db6566-31ff-47e8-869e-af9454f7975d,network=Network(ef2191ea-7a09-4508-9c79-e9f6195c4edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44db6566-31')
Aug 22 02:58:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [req-2731e4b4-ca11-4634-b610-705876d2d08a req-3619d6f5-e40a-47ca-9a05-5e6b310598ab service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:58:55 user nova-compute[73469]:   <nova:package version="0.0.0"/>
Aug 22 02:58:55 user nova-compute[73469]:   <nova:name>tempest-device-tagging-server-1258093798</nova:name>
Aug 22 02:58:55 user nova-compute[73469]:   <nova:creationTime>2023-08-22 02:58:55</nova:creationTime>
Aug 22 02:58:55 user nova-compute[73469]:   <nova:flavor name="m1.tiny">
Aug 22 02:58:55 user nova-compute[73469]:     <nova:memory>512</nova:memory>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:disk>1</nova:disk>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:swap>0</nova:swap>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:vcpus>1</nova:vcpus>
Aug 22 02:58:55 user nova-compute[73469]:   </nova:flavor>
Aug 22 02:58:55 user nova-compute[73469]:   <nova:owner>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:user uuid="95599bfe510e4edb80093a2a4365503e">tempest-TaggedAttachmentsTest-909833900-project-member</nova:user>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:project uuid="4179baa30282429b8bfff7beafb95390">tempest-TaggedAttachmentsTest-909833900</nova:project>
Aug 22 02:58:55 user nova-compute[73469]:   </nova:owner>
Aug 22 02:58:55 user nova-compute[73469]:   <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:58:55 user nova-compute[73469]:   <nova:ports>
Aug 22 02:58:55 user nova-compute[73469]:     <nova:port uuid="0427a59c-aa48-4b73-9579-e91d5e1830b0">
Aug 22 02:58:55 user nova-compute[73469]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 22 02:58:55 user nova-compute[73469]:     </nova:port>
Aug 22 02:58:55 user nova-compute[73469]:   </nova:ports>
Aug 22 02:58:55 user nova-compute[73469]: </nova:instance>
Aug 22 02:58:55 user nova-compute[73469]:  {{(pid=73469) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Updating instance_info_cache with network_info: [{"id": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "address": "fa:16:3e:7a:e5:d0", "network": {"id": "f787ebbc-4ddc-4671-8a1a-e15d3da6d019", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-677642733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0427a59c-aa", "ovs_interfaceid": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Releasing lock "refresh_cache-ddef86ef-9510-4010-b34b-68ac6d95652b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1911e2bd-d7bf-4c54-b53a-1e419ef6bc0c tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "interface-ddef86ef-9510-4010-b34b-68ac6d95652b-44db6566-31ff-47e8-869e-af9454f7975d" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.603s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Successfully updated port: 78ca747b-f8a3-4bde-8c6d-bfd860eca41b {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquired lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Updating instance_info_cache with network_info: [{"id": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "address": "fa:16:3e:0d:d7:78", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ca747b-f8", "ovs_interfaceid": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Releasing lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Instance network_info: |[{"id": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "address": "fa:16:3e:0d:d7:78", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ca747b-f8", "ovs_interfaceid": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Start _get_guest_xml network_info=[{"id": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "address": "fa:16:3e:0d:d7:78", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ca747b-f8", "ovs_interfaceid": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 02:58:56 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:58:56 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-692250773',display_name='tempest-ServerActionsTestOtherA-server-692250773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-692250773',id=20,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqna53ychrrpICcXpgxhDHdrzJyFFu88HUxTxIQK5z+xOZfcw7kHrC8QJBeI4lEfQOxVPYITpSoaAG4B9QNlgmIHoEX0gtT1wKkQ7bp7nCHyaP40f+//buUPKlKHlWXEA==',key_name='tempest-keypair-651522654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d1c312e979e47558b06d4fa70bc103a',ramdisk_id='',reservation_id='r-ovyefov7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1751677379',owner_user_name='tempest-ServerActionsTestOtherA-1751677379-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:58:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b47d6cefd0d4949bf4c3c0fc72a9cd5',uuid=82e872a7-70b0-4290-9a11-5316765aed01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "address": "fa:16:3e:0d:d7:78", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ca747b-f8", "ovs_interfaceid": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converting VIF {"id": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "address": "fa:16:3e:0d:d7:78", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ca747b-f8", "ovs_interfaceid": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d7:78,bridge_name='br-int',has_traffic_filtering=True,id=78ca747b-f8a3-4bde-8c6d-bfd860eca41b,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ca747b-f8') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'pci_devices' on Instance uuid 82e872a7-70b0-4290-9a11-5316765aed01 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] End _get_guest_xml xml=<domain type="kvm">
Aug 22 02:58:56 user nova-compute[73469]:   <uuid>82e872a7-70b0-4290-9a11-5316765aed01</uuid>
Aug 22 02:58:56 user nova-compute[73469]:   <name>instance-00000014</name>
Aug 22 02:58:56 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 02:58:56 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 02:58:56 user nova-compute[73469]:   <metadata>
Aug 22 02:58:56 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 02:58:56 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 02:58:56 user nova-compute[73469]:       <nova:name>tempest-ServerActionsTestOtherA-server-692250773</nova:name>
Aug 22 02:58:56 user nova-compute[73469]:       <nova:creationTime>2023-08-22 02:58:56</nova:creationTime>
Aug 22 02:58:56 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 02:58:56 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 02:58:56 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 02:58:56 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 02:58:56 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 02:58:56 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 02:58:56 user nova-compute[73469]:       </nova:flavor>
Aug 22 02:58:56 user nova-compute[73469]:       <nova:owner>
Aug 22 02:58:56 user nova-compute[73469]:         <nova:user uuid="8b47d6cefd0d4949bf4c3c0fc72a9cd5">tempest-ServerActionsTestOtherA-1751677379-project-member</nova:user>
Aug 22 02:58:56 user nova-compute[73469]:         <nova:project uuid="2d1c312e979e47558b06d4fa70bc103a">tempest-ServerActionsTestOtherA-1751677379</nova:project>
Aug 22 02:58:56 user nova-compute[73469]:       </nova:owner>
Aug 22 02:58:56 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 02:58:56 user nova-compute[73469]:       <nova:ports>
Aug 22 02:58:56 user nova-compute[73469]:         <nova:port uuid="78ca747b-f8a3-4bde-8c6d-bfd860eca41b">
Aug 22 02:58:56 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 22 02:58:56 user nova-compute[73469]:         </nova:port>
Aug 22 02:58:56 user nova-compute[73469]:       </nova:ports>
Aug 22 02:58:56 user nova-compute[73469]:     </nova:instance>
Aug 22 02:58:56 user nova-compute[73469]:   </metadata>
Aug 22 02:58:56 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 02:58:56 user nova-compute[73469]:     <system>
Aug 22 02:58:56 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 02:58:56 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 02:58:56 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 02:58:56 user nova-compute[73469]:       <entry name="serial">82e872a7-70b0-4290-9a11-5316765aed01</entry>
Aug 22 02:58:56 user nova-compute[73469]:       <entry name="uuid">82e872a7-70b0-4290-9a11-5316765aed01</entry>
Aug 22 02:58:56 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 02:58:56 user nova-compute[73469]:     </system>
Aug 22 02:58:56 user nova-compute[73469]:   </sysinfo>
Aug 22 02:58:56 user nova-compute[73469]:   <os>
Aug 22 02:58:56 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 02:58:56 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 02:58:56 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 02:58:56 user nova-compute[73469]:   </os>
Aug 22 02:58:56 user nova-compute[73469]:   <features>
Aug 22 02:58:56 user nova-compute[73469]:     <acpi/>
Aug 22 02:58:56 user nova-compute[73469]:     <apic/>
Aug 22 02:58:56 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 02:58:56 user nova-compute[73469]:   </features>
Aug 22 02:58:56 user nova-compute[73469]:   <clock offset="utc">
Aug 22 02:58:56 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 02:58:56 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 02:58:56 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 02:58:56 user nova-compute[73469]:   </clock>
Aug 22 02:58:56 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 02:58:56 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 02:58:56 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 02:58:56 user nova-compute[73469]:   </cpu>
Aug 22 02:58:56 user nova-compute[73469]:   <devices>
Aug 22 02:58:56 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 02:58:56 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 02:58:56 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk"/>
Aug 22 02:58:56 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 02:58:56 user nova-compute[73469]:     </disk>
Aug 22 02:58:56 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 02:58:56 user nova-compute[73469]:       <mac address="fa:16:3e:0d:d7:78"/>
Aug 22 02:58:56 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:58:56 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 02:58:56 user nova-compute[73469]:       <target dev="tap78ca747b-f8"/>
Aug 22 02:58:56 user nova-compute[73469]:     </interface>
Aug 22 02:58:56 user nova-compute[73469]:     <serial type="pty">
Aug 22 02:58:56 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/console.log" append="off"/>
Aug 22 02:58:56 user nova-compute[73469]:     </serial>
Aug 22 02:58:56 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 02:58:56 user nova-compute[73469]:     <video>
Aug 22 02:58:56 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 02:58:56 user nova-compute[73469]:     </video>
Aug 22 02:58:56 user nova-compute[73469]:     <rng model="virtio">
Aug 22 02:58:56 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 02:58:56 user nova-compute[73469]:     </rng>
Aug 22 02:58:56 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 02:58:56 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 02:58:56 user nova-compute[73469]:       <stats period="10"/>
Aug 22 02:58:56 user nova-compute[73469]:     </memballoon>
Aug 22 02:58:56 user nova-compute[73469]:   </devices>
Aug 22 02:58:56 user nova-compute[73469]: </domain>
Aug 22 02:58:56 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-692250773',display_name='tempest-ServerActionsTestOtherA-server-692250773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-692250773',id=20,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqna53ychrrpICcXpgxhDHdrzJyFFu88HUxTxIQK5z+xOZfcw7kHrC8QJBeI4lEfQOxVPYITpSoaAG4B9QNlgmIHoEX0gtT1wKkQ7bp7nCHyaP40f+//buUPKlKHlWXEA==',key_name='tempest-keypair-651522654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d1c312e979e47558b06d4fa70bc103a',ramdisk_id='',reservation_id='r-ovyefov7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1751677379',owner_user_name='tempest-ServerActionsTestOtherA-1751677379-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:58:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b47d6cefd0d4949bf4c3c0fc72a9cd5',uuid=82e872a7-70b0-4290-9a11-5316765aed01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "address": "fa:16:3e:0d:d7:78", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ca747b-f8", "ovs_interfaceid": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converting VIF {"id": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "address": "fa:16:3e:0d:d7:78", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ca747b-f8", "ovs_interfaceid": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d7:78,bridge_name='br-int',has_traffic_filtering=True,id=78ca747b-f8a3-4bde-8c6d-bfd860eca41b,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ca747b-f8') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG os_vif [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d7:78,bridge_name='br-int',has_traffic_filtering=True,id=78ca747b-f8a3-4bde-8c6d-bfd860eca41b,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ca747b-f8') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:58:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 02:58:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78ca747b-f8, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:58:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap78ca747b-f8, col_values=(('external_ids', {'iface-id': '78ca747b-f8a3-4bde-8c6d-bfd860eca41b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:d7:78', 'vm-uuid': '82e872a7-70b0-4290-9a11-5316765aed01'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:58:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:58:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:57 user nova-compute[73469]: INFO os_vif [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d7:78,bridge_name='br-int',has_traffic_filtering=True,id=78ca747b-f8a3-4bde-8c6d-bfd860eca41b,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ca747b-f8')
Aug 22 02:58:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:58:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] No VIF found with MAC fa:16:3e:0d:d7:78, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:58:57 user nova-compute[73469]: DEBUG nova.compute.manager [req-dd686a85-a178-43aa-827c-6bfa1993b7a8 req-f81e896d-26de-405f-8822-1ad893f3f958 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received event network-vif-plugged-44db6566-31ff-47e8-869e-af9454f7975d {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dd686a85-a178-43aa-827c-6bfa1993b7a8 req-f81e896d-26de-405f-8822-1ad893f3f958 service nova] Acquiring lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dd686a85-a178-43aa-827c-6bfa1993b7a8 req-f81e896d-26de-405f-8822-1ad893f3f958 service nova] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dd686a85-a178-43aa-827c-6bfa1993b7a8 req-f81e896d-26de-405f-8822-1ad893f3f958 service nova] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:57 user nova-compute[73469]: DEBUG nova.compute.manager [req-dd686a85-a178-43aa-827c-6bfa1993b7a8 req-f81e896d-26de-405f-8822-1ad893f3f958 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] No waiting events found dispatching network-vif-plugged-44db6566-31ff-47e8-869e-af9454f7975d {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:58:57 user nova-compute[73469]: WARNING nova.compute.manager [req-dd686a85-a178-43aa-827c-6bfa1993b7a8 req-f81e896d-26de-405f-8822-1ad893f3f958 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received unexpected event network-vif-plugged-44db6566-31ff-47e8-869e-af9454f7975d for instance with vm_state active and task_state None.
Aug 22 02:58:57 user nova-compute[73469]: DEBUG nova.compute.manager [req-dd686a85-a178-43aa-827c-6bfa1993b7a8 req-f81e896d-26de-405f-8822-1ad893f3f958 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Received event network-changed-78ca747b-f8a3-4bde-8c6d-bfd860eca41b {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:57 user nova-compute[73469]: DEBUG nova.compute.manager [req-dd686a85-a178-43aa-827c-6bfa1993b7a8 req-f81e896d-26de-405f-8822-1ad893f3f958 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Refreshing instance network info cache due to event network-changed-78ca747b-f8a3-4bde-8c6d-bfd860eca41b. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:58:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dd686a85-a178-43aa-827c-6bfa1993b7a8 req-f81e896d-26de-405f-8822-1ad893f3f958 service nova] Acquiring lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:58:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dd686a85-a178-43aa-827c-6bfa1993b7a8 req-f81e896d-26de-405f-8822-1ad893f3f958 service nova] Acquired lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:58:57 user nova-compute[73469]: DEBUG nova.network.neutron [req-dd686a85-a178-43aa-827c-6bfa1993b7a8 req-f81e896d-26de-405f-8822-1ad893f3f958 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Refreshing network info cache for port 78ca747b-f8a3-4bde-8c6d-bfd860eca41b {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:58:57 user nova-compute[73469]: DEBUG nova.network.neutron [req-dd686a85-a178-43aa-827c-6bfa1993b7a8 req-f81e896d-26de-405f-8822-1ad893f3f958 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Updated VIF entry in instance network info cache for port 78ca747b-f8a3-4bde-8c6d-bfd860eca41b. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:58:57 user nova-compute[73469]: DEBUG nova.network.neutron [req-dd686a85-a178-43aa-827c-6bfa1993b7a8 req-f81e896d-26de-405f-8822-1ad893f3f958 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Updating instance_info_cache with network_info: [{"id": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "address": "fa:16:3e:0d:d7:78", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ca747b-f8", "ovs_interfaceid": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:58:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dd686a85-a178-43aa-827c-6bfa1993b7a8 req-f81e896d-26de-405f-8822-1ad893f3f958 service nova] Releasing lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:58:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:58 user nova-compute[73469]: DEBUG nova.compute.manager [req-d0183609-c6b0-460f-9a7b-41204184eb9b req-94291396-9e3d-432f-a29e-e4fe2dd6577f service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Received event network-vif-plugged-78ca747b-f8a3-4bde-8c6d-bfd860eca41b {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:58:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d0183609-c6b0-460f-9a7b-41204184eb9b req-94291396-9e3d-432f-a29e-e4fe2dd6577f service nova] Acquiring lock "82e872a7-70b0-4290-9a11-5316765aed01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:58:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d0183609-c6b0-460f-9a7b-41204184eb9b req-94291396-9e3d-432f-a29e-e4fe2dd6577f service nova] Lock "82e872a7-70b0-4290-9a11-5316765aed01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:58:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d0183609-c6b0-460f-9a7b-41204184eb9b req-94291396-9e3d-432f-a29e-e4fe2dd6577f service nova] Lock "82e872a7-70b0-4290-9a11-5316765aed01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:58:58 user nova-compute[73469]: DEBUG nova.compute.manager [req-d0183609-c6b0-460f-9a7b-41204184eb9b req-94291396-9e3d-432f-a29e-e4fe2dd6577f service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] No waiting events found dispatching network-vif-plugged-78ca747b-f8a3-4bde-8c6d-bfd860eca41b {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:58:58 user nova-compute[73469]: WARNING nova.compute.manager [req-d0183609-c6b0-460f-9a7b-41204184eb9b req-94291396-9e3d-432f-a29e-e4fe2dd6577f service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Received unexpected event network-vif-plugged-78ca747b-f8a3-4bde-8c6d-bfd860eca41b for instance with vm_state building and task_state spawning.
Aug 22 02:58:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:58:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:00 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673140.5253646, 82e872a7-70b0-4290-9a11-5316765aed01 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:59:00 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] VM Resumed (Lifecycle Event)
Aug 22 02:59:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 02:59:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 02:59:00 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Instance spawned successfully.
Aug 22 02:59:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 02:59:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:59:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:59:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:59:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:59:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:59:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:59:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:59:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 02:59:00 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:59:00 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673140.5268986, 82e872a7-70b0-4290-9a11-5316765aed01 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:59:00 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] VM Started (Lifecycle Event)
Aug 22 02:59:00 user nova-compute[73469]: DEBUG nova.compute.manager [req-50d5e65e-c545-4a17-8f61-7b723dd4ba42 req-38a287f7-3ed4-4020-b0f9-a871c2786590 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Received event network-vif-plugged-78ca747b-f8a3-4bde-8c6d-bfd860eca41b {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-50d5e65e-c545-4a17-8f61-7b723dd4ba42 req-38a287f7-3ed4-4020-b0f9-a871c2786590 service nova] Acquiring lock "82e872a7-70b0-4290-9a11-5316765aed01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-50d5e65e-c545-4a17-8f61-7b723dd4ba42 req-38a287f7-3ed4-4020-b0f9-a871c2786590 service nova] Lock "82e872a7-70b0-4290-9a11-5316765aed01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-50d5e65e-c545-4a17-8f61-7b723dd4ba42 req-38a287f7-3ed4-4020-b0f9-a871c2786590 service nova] Lock "82e872a7-70b0-4290-9a11-5316765aed01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:00 user nova-compute[73469]: DEBUG nova.compute.manager [req-50d5e65e-c545-4a17-8f61-7b723dd4ba42 req-38a287f7-3ed4-4020-b0f9-a871c2786590 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] No waiting events found dispatching network-vif-plugged-78ca747b-f8a3-4bde-8c6d-bfd860eca41b {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:59:00 user nova-compute[73469]: WARNING nova.compute.manager [req-50d5e65e-c545-4a17-8f61-7b723dd4ba42 req-38a287f7-3ed4-4020-b0f9-a871c2786590 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Received unexpected event network-vif-plugged-78ca747b-f8a3-4bde-8c6d-bfd860eca41b for instance with vm_state building and task_state spawning.
Aug 22 02:59:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:59:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:59:00 user nova-compute[73469]: INFO nova.compute.manager [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Took 5.92 seconds to spawn the instance on the hypervisor.
Aug 22 02:59:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:59:00 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 02:59:00 user nova-compute[73469]: INFO nova.compute.manager [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Took 7.16 seconds to build instance.
Aug 22 02:59:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad91659d-5a6e-4d33-98df-687fdc5ef60f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "82e872a7-70b0-4290-9a11-5316765aed01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.257s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjUoOpBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:59:06 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:59:06 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:59:06 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2eafffe-e27a-418a-a588-04c49c11df1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 02:59:06 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ed762d-3a2a-4744-9d8d-6b0ff256787c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3] added
Aug 22 02:59:06 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3e5b3d-4f94-44cc-83f9-09227dc7f46e]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3714c28-d15b-4fa4-af9a-2d691da593bb]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjUoOpBX {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjUoOpBX" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa4d57a-0e31-4529-8e4e-dfa85ebc6a9a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wjUoOpBX'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[667e37ca-87ab-4891-a003-f8fd072e31b1]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f960c53-ef6c-4278-8d03-0727fc747edf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:59:06 user nova-compute[73469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:59:06 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:59:06 user nova-compute[73469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:59:06 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc82c9a-3c60-4333-93ec-0ee3990f3b53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3, portal: 172.16.0.220,3260]
Aug 22 02:59:06 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3, portal: 172.16.0.220,3260] successful.
Aug 22 02:59:06 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[114c1dd2-d419-4529-b649-bb464d42103f]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[85849957-56d2-4dd4-a843-5f0fbe691ec3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:59:06 user nova-compute[73469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:59:06 user nova-compute[73469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 02:59:06 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:59:06 user nova-compute[73469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:59:06 user nova-compute[73469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 02:59:06 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f759bca9-0f56-4471-a61b-62f04ba6f7ef]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:06 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:59:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:07 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 02:59:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjUoOpBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 02:59:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:59:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26366663964396237', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:59:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366663964396237', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 02:59:07 user nova-compute[73469]: DEBUG nova.objects.instance [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'flavor' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:59:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 02:59:08 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:59:08 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 02:59:08 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 02:59:08 user nova-compute[73469]:   <serial>27716b1b-781f-47e7-992b-7521fda49ee3</serial>
Aug 22 02:59:08 user nova-compute[73469]: </disk>
Aug 22 02:59:08 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 02:59:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:59:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 02:59:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] No VIF found with MAC fa:16:3e:d7:a2:07, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 02:59:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-51d4cc90-2438-45b5-b050-46d4e1873200 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.265s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ea8e4e5a-20ab-479f-aeea-b5bcbac3923a tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ea8e4e5a-20ab-479f-aeea-b5bcbac3923a tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:09 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ea8e4e5a-20ab-479f-aeea-b5bcbac3923a tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:59:09 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ea8e4e5a-20ab-479f-aeea-b5bcbac3923a tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73469) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 22 02:59:09 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ea8e4e5a-20ab-479f-aeea-b5bcbac3923a tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'flavor' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:59:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:09 user nova-compute[73469]: DEBUG nova.compute.manager [req-290de8d6-225d-4d5b-8354-5d1b28e26cac req-3bcc42f2-0360-48fe-b4d1-0914086fa1cb service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received event network-vif-unplugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-290de8d6-225d-4d5b-8354-5d1b28e26cac req-3bcc42f2-0360-48fe-b4d1-0914086fa1cb service nova] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-290de8d6-225d-4d5b-8354-5d1b28e26cac req-3bcc42f2-0360-48fe-b4d1-0914086fa1cb service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-290de8d6-225d-4d5b-8354-5d1b28e26cac req-3bcc42f2-0360-48fe-b4d1-0914086fa1cb service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:09 user nova-compute[73469]: DEBUG nova.compute.manager [req-290de8d6-225d-4d5b-8354-5d1b28e26cac req-3bcc42f2-0360-48fe-b4d1-0914086fa1cb service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] No waiting events found dispatching network-vif-unplugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:59:09 user nova-compute[73469]: WARNING nova.compute.manager [req-290de8d6-225d-4d5b-8354-5d1b28e26cac req-3bcc42f2-0360-48fe-b4d1-0914086fa1cb service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received unexpected event network-vif-unplugged-1b3de561-7dd1-4d48-8932-05c4e4770538 for instance with vm_state active and task_state powering-off.
Aug 22 02:59:10 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Instance destroyed successfully.
Aug 22 02:59:10 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ea8e4e5a-20ab-479f-aeea-b5bcbac3923a tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:59:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ea8e4e5a-20ab-479f-aeea-b5bcbac3923a tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.908s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:11 user nova-compute[73469]: DEBUG nova.compute.manager [req-c3a13084-c692-4f5b-9220-c0cfd719c279 req-f0af7164-75f4-4e99-8bad-7506a14197fa service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received event network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c3a13084-c692-4f5b-9220-c0cfd719c279 req-f0af7164-75f4-4e99-8bad-7506a14197fa service nova] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c3a13084-c692-4f5b-9220-c0cfd719c279 req-f0af7164-75f4-4e99-8bad-7506a14197fa service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c3a13084-c692-4f5b-9220-c0cfd719c279 req-f0af7164-75f4-4e99-8bad-7506a14197fa service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:11 user nova-compute[73469]: DEBUG nova.compute.manager [req-c3a13084-c692-4f5b-9220-c0cfd719c279 req-f0af7164-75f4-4e99-8bad-7506a14197fa service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] No waiting events found dispatching network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:59:11 user nova-compute[73469]: WARNING nova.compute.manager [req-c3a13084-c692-4f5b-9220-c0cfd719c279 req-f0af7164-75f4-4e99-8bad-7506a14197fa service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received unexpected event network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 for instance with vm_state stopped and task_state None.
Aug 22 02:59:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:13 user nova-compute[73469]: INFO nova.compute.manager [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Terminating instance
Aug 22 02:59:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:13 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Instance destroyed successfully.
Aug 22 02:59:13 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lazy-loading 'resources' on Instance uuid f5fdf305-bf02-4b53-bb0d-83e939ae1acb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1302387054',display_name='tempest-VolumesAdminNegativeTest-server-1302387054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1302387054',id=5,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd9maV4fKnxtWLxuACn7FIZwYpeZBBpKyHfJTpYXpgkHcXQeMuPsiYHPWu8OMtMg+/AVjMygAp9vAI3jGWRPU04msJz485Fn004nvYgGQJkEPTstjoAC3UUs25v+STOBw==',key_name='tempest-keypair-140235032',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:53:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39885655a2984da4b2ec082427384bea',ramdisk_id='',reservation_id='r-01ml0ful',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1884652392',owner_user_name='tempest-VolumesAdminNegativeTest-1884652392-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:53:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd0825598415407d98df7353ed5f08c8',uuid=f5fdf305-bf02-4b53-bb0d-83e939ae1acb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "address": "fa:16:3e:70:a3:62", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dffa70d-3c", "ovs_interfaceid": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Converting VIF {"id": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "address": "fa:16:3e:70:a3:62", "network": {"id": "b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-163337859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39885655a2984da4b2ec082427384bea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dffa70d-3c", "ovs_interfaceid": "1dffa70d-3c6e-4c82-9c6b-4d182c9f0365", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=1dffa70d-3c6e-4c82-9c6b-4d182c9f0365,network=Network(b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dffa70d-3c') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG os_vif [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=1dffa70d-3c6e-4c82-9c6b-4d182c9f0365,network=Network(b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dffa70d-3c') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dffa70d-3c, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:13 user nova-compute[73469]: INFO os_vif [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=1dffa70d-3c6e-4c82-9c6b-4d182c9f0365,network=Network(b3d84bbe-2770-4ded-bbb2-31bd3e6fbd9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dffa70d-3c')
Aug 22 02:59:13 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Deleting instance files /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb_del
Aug 22 02:59:13 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Deletion of /opt/stack/data/nova/instances/f5fdf305-bf02-4b53-bb0d-83e939ae1acb_del complete
Aug 22 02:59:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-e68f6115-8232-48f3-8533-7e18e6e443c7 req-2644fdac-171f-482d-9412-9cbf75e971f1 service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Received event network-vif-unplugged-1dffa70d-3c6e-4c82-9c6b-4d182c9f0365 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e68f6115-8232-48f3-8533-7e18e6e443c7 req-2644fdac-171f-482d-9412-9cbf75e971f1 service nova] Acquiring lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e68f6115-8232-48f3-8533-7e18e6e443c7 req-2644fdac-171f-482d-9412-9cbf75e971f1 service nova] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e68f6115-8232-48f3-8533-7e18e6e443c7 req-2644fdac-171f-482d-9412-9cbf75e971f1 service nova] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-e68f6115-8232-48f3-8533-7e18e6e443c7 req-2644fdac-171f-482d-9412-9cbf75e971f1 service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] No waiting events found dispatching network-vif-unplugged-1dffa70d-3c6e-4c82-9c6b-4d182c9f0365 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:59:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-e68f6115-8232-48f3-8533-7e18e6e443c7 req-2644fdac-171f-482d-9412-9cbf75e971f1 service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Received event network-vif-unplugged-1dffa70d-3c6e-4c82-9c6b-4d182c9f0365 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 02:59:14 user nova-compute[73469]: INFO nova.compute.manager [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 22 02:59:14 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 02:59:14 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 02:59:14 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 02:59:14 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:59:14 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Took 0.92 seconds to deallocate network for instance.
Aug 22 02:59:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-9e392b4f-76ea-4e15-9d4b-2a7baaf7e0c8 req-3b27c9eb-d2c4-42bf-9c65-642c6c2bca3f service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Received event network-vif-deleted-1dffa70d-3c6e-4c82-9c6b-4d182c9f0365 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:14 user nova-compute[73469]: INFO nova.compute.manager [req-9e392b4f-76ea-4e15-9d4b-2a7baaf7e0c8 req-3b27c9eb-d2c4-42bf-9c65-642c6c2bca3f service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Neutron deleted interface 1dffa70d-3c6e-4c82-9c6b-4d182c9f0365; detaching it from the instance and deleting it from the info cache
Aug 22 02:59:14 user nova-compute[73469]: DEBUG nova.network.neutron [req-9e392b4f-76ea-4e15-9d4b-2a7baaf7e0c8 req-3b27c9eb-d2c4-42bf-9c65-642c6c2bca3f service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:59:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-9e392b4f-76ea-4e15-9d4b-2a7baaf7e0c8 req-3b27c9eb-d2c4-42bf-9c65-642c6c2bca3f service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Detach interface failed, port_id=1dffa70d-3c6e-4c82-9c6b-4d182c9f0365, reason: Instance f5fdf305-bf02-4b53-bb0d-83e939ae1acb could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 02:59:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:15 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:59:15 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:59:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:15 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Deleted allocations for instance f5fdf305-bf02-4b53-bb0d-83e939ae1acb
Aug 22 02:59:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1b6e3d6f-b119-4d30-8d3b-a0092d5c1c42 tempest-VolumesAdminNegativeTest-1884652392 tempest-VolumesAdminNegativeTest-1884652392-project-member] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.457s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:15 user nova-compute[73469]: DEBUG nova.compute.manager [req-31179e18-87f7-4527-a120-051532955d9f req-366b58b8-0c78-4a9c-8194-670977264c86 service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Received event network-vif-plugged-1dffa70d-3c6e-4c82-9c6b-4d182c9f0365 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-31179e18-87f7-4527-a120-051532955d9f req-366b58b8-0c78-4a9c-8194-670977264c86 service nova] Acquiring lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-31179e18-87f7-4527-a120-051532955d9f req-366b58b8-0c78-4a9c-8194-670977264c86 service nova] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-31179e18-87f7-4527-a120-051532955d9f req-366b58b8-0c78-4a9c-8194-670977264c86 service nova] Lock "f5fdf305-bf02-4b53-bb0d-83e939ae1acb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:15 user nova-compute[73469]: DEBUG nova.compute.manager [req-31179e18-87f7-4527-a120-051532955d9f req-366b58b8-0c78-4a9c-8194-670977264c86 service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] No waiting events found dispatching network-vif-plugged-1dffa70d-3c6e-4c82-9c6b-4d182c9f0365 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:59:15 user nova-compute[73469]: WARNING nova.compute.manager [req-31179e18-87f7-4527-a120-051532955d9f req-366b58b8-0c78-4a9c-8194-670977264c86 service nova] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Received unexpected event network-vif-plugged-1dffa70d-3c6e-4c82-9c6b-4d182c9f0365 for instance with vm_state deleted and task_state None.
Aug 22 02:59:16 user nova-compute[73469]: INFO nova.compute.manager [None req-503062f0-ad13-49bf-803d-39b681f6c736 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Unrescuing
Aug 22 02:59:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-503062f0-ad13-49bf-803d-39b681f6c736 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:59:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-503062f0-ad13-49bf-803d-39b681f6c736 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquired lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:59:16 user nova-compute[73469]: DEBUG nova.network.neutron [None req-503062f0-ad13-49bf-803d-39b681f6c736 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:59:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:17 user nova-compute[73469]: DEBUG nova.network.neutron [None req-503062f0-ad13-49bf-803d-39b681f6c736 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Updating instance_info_cache with network_info: [{"id": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "address": "fa:16:3e:8e:27:47", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6148435c-1c", "ovs_interfaceid": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:59:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-503062f0-ad13-49bf-803d-39b681f6c736 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Releasing lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:59:17 user nova-compute[73469]: DEBUG nova.objects.instance [None req-503062f0-ad13-49bf-803d-39b681f6c736 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'flavor' on Instance uuid 9d0668c0-7a49-4857-9b69-541021f18ab2 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:59:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:17 user nova-compute[73469]: DEBUG nova.compute.manager [req-30e33526-530b-480e-a592-d12a95c91a23 req-5518cec6-8049-428b-94d1-a124c00d79ec service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received event network-vif-unplugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-30e33526-530b-480e-a592-d12a95c91a23 req-5518cec6-8049-428b-94d1-a124c00d79ec service nova] Acquiring lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-30e33526-530b-480e-a592-d12a95c91a23 req-5518cec6-8049-428b-94d1-a124c00d79ec service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-30e33526-530b-480e-a592-d12a95c91a23 req-5518cec6-8049-428b-94d1-a124c00d79ec service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:17 user nova-compute[73469]: DEBUG nova.compute.manager [req-30e33526-530b-480e-a592-d12a95c91a23 req-5518cec6-8049-428b-94d1-a124c00d79ec service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] No waiting events found dispatching network-vif-unplugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:59:17 user nova-compute[73469]: WARNING nova.compute.manager [req-30e33526-530b-480e-a592-d12a95c91a23 req-5518cec6-8049-428b-94d1-a124c00d79ec service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received unexpected event network-vif-unplugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 for instance with vm_state rescued and task_state unrescuing.
Aug 22 02:59:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:18 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Instance destroyed successfully.
Aug 22 02:59:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:19 user nova-compute[73469]: DEBUG nova.compute.manager [req-57c5742f-3f82-4415-b958-830a2c03afc0 req-4eaa5b29-a3a6-4532-a81e-e538c6e02dd4 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received event network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-57c5742f-3f82-4415-b958-830a2c03afc0 req-4eaa5b29-a3a6-4532-a81e-e538c6e02dd4 service nova] Acquiring lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-57c5742f-3f82-4415-b958-830a2c03afc0 req-4eaa5b29-a3a6-4532-a81e-e538c6e02dd4 service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-57c5742f-3f82-4415-b958-830a2c03afc0 req-4eaa5b29-a3a6-4532-a81e-e538c6e02dd4 service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:19 user nova-compute[73469]: DEBUG nova.compute.manager [req-57c5742f-3f82-4415-b958-830a2c03afc0 req-4eaa5b29-a3a6-4532-a81e-e538c6e02dd4 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] No waiting events found dispatching network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:59:19 user nova-compute[73469]: WARNING nova.compute.manager [req-57c5742f-3f82-4415-b958-830a2c03afc0 req-4eaa5b29-a3a6-4532-a81e-e538c6e02dd4 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received unexpected event network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 for instance with vm_state rescued and task_state unrescuing.
Aug 22 02:59:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:20 user nova-compute[73469]: INFO nova.compute.manager [None req-aa129d15-ab60-4231-9caf-07c20e65838e tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Unrescuing
Aug 22 02:59:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-aa129d15-ab60-4231-9caf-07c20e65838e tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "refresh_cache-8242cec1-3b35-4d14-9e0b-db8a7e75697d" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:59:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-aa129d15-ab60-4231-9caf-07c20e65838e tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquired lock "refresh_cache-8242cec1-3b35-4d14-9e0b-db8a7e75697d" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:59:20 user nova-compute[73469]: DEBUG nova.network.neutron [None req-aa129d15-ab60-4231-9caf-07c20e65838e tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG nova.network.neutron [None req-aa129d15-ab60-4231-9caf-07c20e65838e tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Updating instance_info_cache with network_info: [{"id": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "address": "fa:16:3e:4f:6e:44", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec640a77-a1", "ovs_interfaceid": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-aa129d15-ab60-4231-9caf-07c20e65838e tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Releasing lock "refresh_cache-8242cec1-3b35-4d14-9e0b-db8a7e75697d" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG nova.objects.instance [None req-aa129d15-ab60-4231-9caf-07c20e65838e tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'flavor' on Instance uuid 8242cec1-3b35-4d14-9e0b-db8a7e75697d {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-90fd1100-951e-4375-8c00-5b6658ca485b req-3cb441e0-9941-4549-938d-436ac44c615a service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received event network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-90fd1100-951e-4375-8c00-5b6658ca485b req-3cb441e0-9941-4549-938d-436ac44c615a service nova] Acquiring lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-90fd1100-951e-4375-8c00-5b6658ca485b req-3cb441e0-9941-4549-938d-436ac44c615a service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-90fd1100-951e-4375-8c00-5b6658ca485b req-3cb441e0-9941-4549-938d-436ac44c615a service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-90fd1100-951e-4375-8c00-5b6658ca485b req-3cb441e0-9941-4549-938d-436ac44c615a service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] No waiting events found dispatching network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:59:21 user nova-compute[73469]: WARNING nova.compute.manager [req-90fd1100-951e-4375-8c00-5b6658ca485b req-3cb441e0-9941-4549-938d-436ac44c615a service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received unexpected event network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 for instance with vm_state rescued and task_state unrescuing.
Aug 22 02:59:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-90fd1100-951e-4375-8c00-5b6658ca485b req-3cb441e0-9941-4549-938d-436ac44c615a service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received event network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-90fd1100-951e-4375-8c00-5b6658ca485b req-3cb441e0-9941-4549-938d-436ac44c615a service nova] Acquiring lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-90fd1100-951e-4375-8c00-5b6658ca485b req-3cb441e0-9941-4549-938d-436ac44c615a service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-90fd1100-951e-4375-8c00-5b6658ca485b req-3cb441e0-9941-4549-938d-436ac44c615a service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-90fd1100-951e-4375-8c00-5b6658ca485b req-3cb441e0-9941-4549-938d-436ac44c615a service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] No waiting events found dispatching network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:59:21 user nova-compute[73469]: WARNING nova.compute.manager [req-90fd1100-951e-4375-8c00-5b6658ca485b req-3cb441e0-9941-4549-938d-436ac44c615a service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received unexpected event network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 for instance with vm_state rescued and task_state unrescuing.
Aug 22 02:59:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-90fd1100-951e-4375-8c00-5b6658ca485b req-3cb441e0-9941-4549-938d-436ac44c615a service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received event network-vif-unplugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-90fd1100-951e-4375-8c00-5b6658ca485b req-3cb441e0-9941-4549-938d-436ac44c615a service nova] Acquiring lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-90fd1100-951e-4375-8c00-5b6658ca485b req-3cb441e0-9941-4549-938d-436ac44c615a service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-90fd1100-951e-4375-8c00-5b6658ca485b req-3cb441e0-9941-4549-938d-436ac44c615a service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-90fd1100-951e-4375-8c00-5b6658ca485b req-3cb441e0-9941-4549-938d-436ac44c615a service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] No waiting events found dispatching network-vif-unplugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:59:21 user nova-compute[73469]: WARNING nova.compute.manager [req-90fd1100-951e-4375-8c00-5b6658ca485b req-3cb441e0-9941-4549-938d-436ac44c615a service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received unexpected event network-vif-unplugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 for instance with vm_state rescued and task_state unrescuing.
Aug 22 02:59:21 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Removed pending event for 9d0668c0-7a49-4857-9b69-541021f18ab2 due to event {{(pid=73469) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 22 02:59:21 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673161.9885018, 9d0668c0-7a49-4857-9b69-541021f18ab2 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:59:21 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] VM Resumed (Lifecycle Event)
Aug 22 02:59:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-503062f0-ad13-49bf-803d-39b681f6c736 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:59:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:59:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:59:22 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 22 02:59:22 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673161.991939, 9d0668c0-7a49-4857-9b69-541021f18ab2 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:59:22 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] VM Started (Lifecycle Event)
Aug 22 02:59:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:59:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:59:22 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Instance destroyed successfully.
Aug 22 02:59:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-89fc5283-1378-4d7f-9db8-27e3a9079bf3 req-376d0d86-d369-4926-a3e2-a62076f3d26b service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received event network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-89fc5283-1378-4d7f-9db8-27e3a9079bf3 req-376d0d86-d369-4926-a3e2-a62076f3d26b service nova] Acquiring lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-89fc5283-1378-4d7f-9db8-27e3a9079bf3 req-376d0d86-d369-4926-a3e2-a62076f3d26b service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-89fc5283-1378-4d7f-9db8-27e3a9079bf3 req-376d0d86-d369-4926-a3e2-a62076f3d26b service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-89fc5283-1378-4d7f-9db8-27e3a9079bf3 req-376d0d86-d369-4926-a3e2-a62076f3d26b service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] No waiting events found dispatching network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:59:24 user nova-compute[73469]: WARNING nova.compute.manager [req-89fc5283-1378-4d7f-9db8-27e3a9079bf3 req-376d0d86-d369-4926-a3e2-a62076f3d26b service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received unexpected event network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 for instance with vm_state rescued and task_state unrescuing.
Aug 22 02:59:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-89fc5283-1378-4d7f-9db8-27e3a9079bf3 req-376d0d86-d369-4926-a3e2-a62076f3d26b service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received event network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-89fc5283-1378-4d7f-9db8-27e3a9079bf3 req-376d0d86-d369-4926-a3e2-a62076f3d26b service nova] Acquiring lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-89fc5283-1378-4d7f-9db8-27e3a9079bf3 req-376d0d86-d369-4926-a3e2-a62076f3d26b service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-89fc5283-1378-4d7f-9db8-27e3a9079bf3 req-376d0d86-d369-4926-a3e2-a62076f3d26b service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-89fc5283-1378-4d7f-9db8-27e3a9079bf3 req-376d0d86-d369-4926-a3e2-a62076f3d26b service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] No waiting events found dispatching network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:59:24 user nova-compute[73469]: WARNING nova.compute.manager [req-89fc5283-1378-4d7f-9db8-27e3a9079bf3 req-376d0d86-d369-4926-a3e2-a62076f3d26b service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received unexpected event network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 for instance with vm_state rescued and task_state unrescuing.
Aug 22 02:59:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-133737d0-fa35-422c-b744-4791507a76af req-77e4927a-80a6-43e9-914d-8b5d914e17a2 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-changed-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-133737d0-fa35-422c-b744-4791507a76af req-77e4927a-80a6-43e9-914d-8b5d914e17a2 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Refreshing instance network info cache due to event network-changed-f38d1396-0fe4-4107-8815-7420deceedab. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:59:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-133737d0-fa35-422c-b744-4791507a76af req-77e4927a-80a6-43e9-914d-8b5d914e17a2 service nova] Acquiring lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:59:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-133737d0-fa35-422c-b744-4791507a76af req-77e4927a-80a6-43e9-914d-8b5d914e17a2 service nova] Acquired lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:59:24 user nova-compute[73469]: DEBUG nova.network.neutron [req-133737d0-fa35-422c-b744-4791507a76af req-77e4927a-80a6-43e9-914d-8b5d914e17a2 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Refreshing network info cache for port f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:59:25 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673150.1296155, 2e621408-a0af-460b-80a2-3446b5f1aadb => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:59:25 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] VM Stopped (Lifecycle Event)
Aug 22 02:59:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-dbaea056-177c-4e7a-9568-048cf7815511 None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:59:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-dbaea056-177c-4e7a-9568-048cf7815511 None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:59:25 user nova-compute[73469]: DEBUG nova.network.neutron [req-133737d0-fa35-422c-b744-4791507a76af req-77e4927a-80a6-43e9-914d-8b5d914e17a2 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Updated VIF entry in instance network info cache for port f38d1396-0fe4-4107-8815-7420deceedab. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:59:25 user nova-compute[73469]: DEBUG nova.network.neutron [req-133737d0-fa35-422c-b744-4791507a76af req-77e4927a-80a6-43e9-914d-8b5d914e17a2 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Updating instance_info_cache with network_info: [{"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:59:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-133737d0-fa35-422c-b744-4791507a76af req-77e4927a-80a6-43e9-914d-8b5d914e17a2 service nova] Releasing lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:59:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-aa129d15-ab60-4231-9caf-07c20e65838e tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:59:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Removed pending event for 8242cec1-3b35-4d14-9e0b-db8a7e75697d due to event {{(pid=73469) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 22 02:59:25 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673165.876819, 8242cec1-3b35-4d14-9e0b-db8a7e75697d => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:59:25 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] VM Resumed (Lifecycle Event)
Aug 22 02:59:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:59:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:59:25 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 22 02:59:25 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673165.8769503, 8242cec1-3b35-4d14-9e0b-db8a7e75697d => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:59:25 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] VM Started (Lifecycle Event)
Aug 22 02:59:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:59:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 02:59:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-eef039e5-2bb3-4826-bf33-f84a188c5ca9 req-c3f09257-e310-4ca1-bb8f-9a1b19b13a26 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received event network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-eef039e5-2bb3-4826-bf33-f84a188c5ca9 req-c3f09257-e310-4ca1-bb8f-9a1b19b13a26 service nova] Acquiring lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-eef039e5-2bb3-4826-bf33-f84a188c5ca9 req-c3f09257-e310-4ca1-bb8f-9a1b19b13a26 service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-eef039e5-2bb3-4826-bf33-f84a188c5ca9 req-c3f09257-e310-4ca1-bb8f-9a1b19b13a26 service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-eef039e5-2bb3-4826-bf33-f84a188c5ca9 req-c3f09257-e310-4ca1-bb8f-9a1b19b13a26 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] No waiting events found dispatching network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:59:26 user nova-compute[73469]: WARNING nova.compute.manager [req-eef039e5-2bb3-4826-bf33-f84a188c5ca9 req-c3f09257-e310-4ca1-bb8f-9a1b19b13a26 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received unexpected event network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 for instance with vm_state active and task_state None.
Aug 22 02:59:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-d1b4d374-e2af-448e-855b-46476f988bbc req-6b983dff-0f19-4b56-aebe-88a00ea764da service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received event network-changed-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-d1b4d374-e2af-448e-855b-46476f988bbc req-6b983dff-0f19-4b56-aebe-88a00ea764da service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Refreshing instance network info cache due to event network-changed-18fedb7c-3d67-4417-b0a3-d98b54df5150. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:59:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d1b4d374-e2af-448e-855b-46476f988bbc req-6b983dff-0f19-4b56-aebe-88a00ea764da service nova] Acquiring lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:59:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d1b4d374-e2af-448e-855b-46476f988bbc req-6b983dff-0f19-4b56-aebe-88a00ea764da service nova] Acquired lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:59:26 user nova-compute[73469]: DEBUG nova.network.neutron [req-d1b4d374-e2af-448e-855b-46476f988bbc req-6b983dff-0f19-4b56-aebe-88a00ea764da service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Refreshing network info cache for port 18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:59:27 user nova-compute[73469]: DEBUG nova.network.neutron [req-d1b4d374-e2af-448e-855b-46476f988bbc req-6b983dff-0f19-4b56-aebe-88a00ea764da service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Updated VIF entry in instance network info cache for port 18fedb7c-3d67-4417-b0a3-d98b54df5150. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:59:27 user nova-compute[73469]: DEBUG nova.network.neutron [req-d1b4d374-e2af-448e-855b-46476f988bbc req-6b983dff-0f19-4b56-aebe-88a00ea764da service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Updating instance_info_cache with network_info: [{"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:59:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d1b4d374-e2af-448e-855b-46476f988bbc req-6b983dff-0f19-4b56-aebe-88a00ea764da service nova] Releasing lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:59:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:27 user nova-compute[73469]: INFO nova.compute.manager [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Detaching volume 09354d33-ec90-4ebe-81cf-9fed080243bc
Aug 22 02:59:27 user nova-compute[73469]: INFO nova.virt.block_device [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Attempting to driver detach volume 09354d33-ec90-4ebe-81cf-9fed080243bc from mountpoint /dev/vdb
Aug 22 02:59:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Attempting to detach device vdb from instance 3ade8cba-6c34-4457-9ad3-484a604dbdb6 from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 02:59:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 02:59:27 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:59:27 user nova-compute[73469]:   <source dev="/dev/sdd"/>
Aug 22 02:59:27 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 02:59:27 user nova-compute[73469]:   <serial>09354d33-ec90-4ebe-81cf-9fed080243bc</serial>
Aug 22 02:59:27 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 22 02:59:27 user nova-compute[73469]: </disk>
Aug 22 02:59:27 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 02:59:27 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Successfully detached device vdb from instance 3ade8cba-6c34-4457-9ad3-484a604dbdb6 from the persistent domain config.
Aug 22 02:59:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3ade8cba-6c34-4457-9ad3-484a604dbdb6 from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 02:59:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 02:59:27 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 02:59:27 user nova-compute[73469]:   <source dev="/dev/sdd"/>
Aug 22 02:59:27 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 02:59:27 user nova-compute[73469]:   <serial>09354d33-ec90-4ebe-81cf-9fed080243bc</serial>
Aug 22 02:59:27 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 22 02:59:27 user nova-compute[73469]: </disk>
Aug 22 02:59:27 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692673168.3147373, 3ade8cba-6c34-4457-9ad3-484a604dbdb6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3ade8cba-6c34-4457-9ad3-484a604dbdb6 {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 02:59:28 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Successfully detached device vdb from instance 3ade8cba-6c34-4457-9ad3-484a604dbdb6 from the live domain config.
Aug 22 02:59:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CPFMtrvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 02:59:28 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 02:59:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[712dd378-4949-4730-a538-ae4e4a2dcede]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9b22eb-fd2f-472d-8b96-76a6420aa910]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:59:28 user nova-compute[73469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:59:28 user nova-compute[73469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 02:59:28 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 02:59:28 user nova-compute[73469]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc (non-flash)
Aug 22 02:59:28 user nova-compute[73469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 02:59:28 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a41c3400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc'): ({'sdd'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Removing single pathed devices sdd {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb07e74-c1d8-4d83-8f3c-658a3175e90e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3f49ab-e0ad-4011-83d2-6ea24f1e3ca9]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Flushing IO for device /dev/sdd {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec1bde5-97ea-412a-922d-8c366cb48104]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5b8601-abff-42a5-9dab-195c77c061db]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-7ee3f1b4-7957-4121-a263-dc97bed1e0f3 req-cb0b3c05-622e-4f92-9f91-6a5c1ab0dea9 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received event network-changed-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-7ee3f1b4-7957-4121-a263-dc97bed1e0f3 req-cb0b3c05-622e-4f92-9f91-6a5c1ab0dea9 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Refreshing instance network info cache due to event network-changed-18fedb7c-3d67-4417-b0a3-d98b54df5150. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7ee3f1b4-7957-4121-a263-dc97bed1e0f3 req-cb0b3c05-622e-4f92-9f91-6a5c1ab0dea9 service nova] Acquiring lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7ee3f1b4-7957-4121-a263-dc97bed1e0f3 req-cb0b3c05-622e-4f92-9f91-6a5c1ab0dea9 service nova] Acquired lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG nova.network.neutron [req-7ee3f1b4-7957-4121-a263-dc97bed1e0f3 req-cb0b3c05-622e-4f92-9f91-6a5c1ab0dea9 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Refreshing network info cache for port 18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[06aa81a2-9db4-4747-8daa-ef406a5a8354]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be3fd27-0ddf-4527-8451-938bce38ec80]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc, portal: 172.16.0.220,3260]
Aug 22 02:59:28 user nova-compute[73469]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc, portal: 172.16.0.220,3260] successful.
Aug 22 02:59:28 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09354d33-ec90-4ebe-81cf-9fed080243bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[149c115a-73bf-4ab2-a03c-1a6db2543dfb]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] <== disconnect_volume: return (301ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673153.8664515, f5fdf305-bf02-4b53-bb0d-83e939ae1acb => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 02:59:28 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] VM Stopped (Lifecycle Event)
Aug 22 02:59:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e9aed26d-21e5-4f65-981c-3ca295bfa988 None None] [instance: f5fdf305-bf02-4b53-bb0d-83e939ae1acb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 02:59:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:29 user nova-compute[73469]: DEBUG nova.network.neutron [req-7ee3f1b4-7957-4121-a263-dc97bed1e0f3 req-cb0b3c05-622e-4f92-9f91-6a5c1ab0dea9 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Updated VIF entry in instance network info cache for port 18fedb7c-3d67-4417-b0a3-d98b54df5150. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 02:59:29 user nova-compute[73469]: DEBUG nova.network.neutron [req-7ee3f1b4-7957-4121-a263-dc97bed1e0f3 req-cb0b3c05-622e-4f92-9f91-6a5c1ab0dea9 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Updating instance_info_cache with network_info: [{"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:59:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7ee3f1b4-7957-4121-a263-dc97bed1e0f3 req-cb0b3c05-622e-4f92-9f91-6a5c1ab0dea9 service nova] Releasing lock "refresh_cache-3ade8cba-6c34-4457-9ad3-484a604dbdb6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:59:29 user nova-compute[73469]: DEBUG nova.objects.instance [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lazy-loading 'flavor' on Instance uuid 3ade8cba-6c34-4457-9ad3-484a604dbdb6 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:59:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-367283b2-4708-41a6-9a45-f0d64b5a5b5f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.786s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:34 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:59:35 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:59:37 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:59:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:37 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 02:59:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:39 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 02:59:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 02:59:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 02:59:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 02:59:42 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:59:42 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 02:59:42 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=7319MB free_disk=25.323959350585938GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 02:59:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:42 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:59:42 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d0668c0-7a49-4857-9b69-541021f18ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:59:42 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance dc3f5545-8ebb-4947-97d0-98a91f67e421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:59:42 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 3ade8cba-6c34-4457-9ad3-484a604dbdb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:59:42 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8242cec1-3b35-4d14-9e0b-db8a7e75697d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:59:42 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance ddef86ef-9510-4010-b34b-68ac6d95652b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:59:42 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 2e621408-a0af-460b-80a2-3446b5f1aadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:59:42 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 5984759d-28f1-45e8-bb4c-27bd8df426f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:59:42 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance d8433c45-b889-4a7b-88c2-ba00679b1d26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:59:42 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82e872a7-70b0-4290-9a11-5316765aed01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 02:59:42 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 02:59:42 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 02:59:42 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:59:42 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:59:42 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 02:59:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:43 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:59:43 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:59:43 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 02:59:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 02:59:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 02:59:43 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 02:59:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:45 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Updating instance_info_cache with network_info: [{"id": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "address": "fa:16:3e:8e:27:47", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6148435c-1c", "ovs_interfaceid": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:59:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 02:59:45 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 02:59:45 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:59:45 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:59:45 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:59:45 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 02:59:45 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 02:59:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquiring lock "ddef86ef-9510-4010-b34b-68ac6d95652b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquiring lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:45 user nova-compute[73469]: INFO nova.compute.manager [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Terminating instance
Aug 22 02:59:45 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 02:59:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:46 user nova-compute[73469]: DEBUG nova.compute.manager [req-ee351471-ab6e-4ca3-b50f-1e8f7b7e3eba req-22f36d73-c92f-4f62-8195-bde6298f1e0b service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received event network-vif-unplugged-0427a59c-aa48-4b73-9579-e91d5e1830b0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ee351471-ab6e-4ca3-b50f-1e8f7b7e3eba req-22f36d73-c92f-4f62-8195-bde6298f1e0b service nova] Acquiring lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ee351471-ab6e-4ca3-b50f-1e8f7b7e3eba req-22f36d73-c92f-4f62-8195-bde6298f1e0b service nova] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ee351471-ab6e-4ca3-b50f-1e8f7b7e3eba req-22f36d73-c92f-4f62-8195-bde6298f1e0b service nova] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:46 user nova-compute[73469]: DEBUG nova.compute.manager [req-ee351471-ab6e-4ca3-b50f-1e8f7b7e3eba req-22f36d73-c92f-4f62-8195-bde6298f1e0b service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] No waiting events found dispatching network-vif-unplugged-0427a59c-aa48-4b73-9579-e91d5e1830b0 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:59:46 user nova-compute[73469]: DEBUG nova.compute.manager [req-ee351471-ab6e-4ca3-b50f-1e8f7b7e3eba req-22f36d73-c92f-4f62-8195-bde6298f1e0b service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received event network-vif-unplugged-0427a59c-aa48-4b73-9579-e91d5e1830b0 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 02:59:46 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Instance destroyed successfully.
Aug 22 02:59:46 user nova-compute[73469]: DEBUG nova.objects.instance [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lazy-loading 'resources' on Instance uuid ddef86ef-9510-4010-b34b-68ac6d95652b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 02:59:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T02:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258093798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1258093798',id=15,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQKuMRYunlJu8NopZqi0nqkba6dIOrT/1x7SWN1QBY4cmXStVS07i0EQBQsjpw0PFF97qA9J41BXlNPdvO8dtd6gzmgVzrLwxcMsATaGBS/meCQ+o0tinvjbTrFfRBF+A==',key_name='tempest-keypair-187903951',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:56:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4179baa30282429b8bfff7beafb95390',ramdisk_id='',reservation_id='r-jfk6r0p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-909833900',owner_user_name='tempest-TaggedAttachmentsTest-909833900-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95599bfe510e4edb80093a2a4365503e',uuid=ddef86ef-9510-4010-b34b-68ac6d95652b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "address": "fa:16:3e:7a:e5:d0", "network": {"id": "f787ebbc-4ddc-4671-8a1a-e15d3da6d019", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-677642733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0427a59c-aa", "ovs_interfaceid": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 02:59:46 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Converting VIF {"id": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "address": "fa:16:3e:7a:e5:d0", "network": {"id": "f787ebbc-4ddc-4671-8a1a-e15d3da6d019", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-677642733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4179baa30282429b8bfff7beafb95390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0427a59c-aa", "ovs_interfaceid": "0427a59c-aa48-4b73-9579-e91d5e1830b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 02:59:46 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:e5:d0,bridge_name='br-int',has_traffic_filtering=True,id=0427a59c-aa48-4b73-9579-e91d5e1830b0,network=Network(f787ebbc-4ddc-4671-8a1a-e15d3da6d019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0427a59c-aa') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 02:59:46 user nova-compute[73469]: DEBUG os_vif [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:e5:d0,bridge_name='br-int',has_traffic_filtering=True,id=0427a59c-aa48-4b73-9579-e91d5e1830b0,network=Network(f787ebbc-4ddc-4671-8a1a-e15d3da6d019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0427a59c-aa') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 02:59:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0427a59c-aa, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 02:59:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 02:59:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:46 user nova-compute[73469]: INFO os_vif [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:e5:d0,bridge_name='br-int',has_traffic_filtering=True,id=0427a59c-aa48-4b73-9579-e91d5e1830b0,network=Network(f787ebbc-4ddc-4671-8a1a-e15d3da6d019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0427a59c-aa')
Aug 22 02:59:46 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Deleting instance files /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b_del
Aug 22 02:59:46 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Deletion of /opt/stack/data/nova/instances/ddef86ef-9510-4010-b34b-68ac6d95652b_del complete
Aug 22 02:59:46 user nova-compute[73469]: INFO nova.compute.manager [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 22 02:59:46 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 02:59:46 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 02:59:46 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 02:59:47 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:59:47 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Took 0.98 seconds to deallocate network for instance.
Aug 22 02:59:47 user nova-compute[73469]: DEBUG nova.compute.manager [req-cf634905-137b-4842-8c2e-7791d831918f req-d64d07c6-e8f4-46b6-a42e-fc24881810c6 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received event network-vif-deleted-0427a59c-aa48-4b73-9579-e91d5e1830b0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:47 user nova-compute[73469]: INFO nova.compute.manager [req-cf634905-137b-4842-8c2e-7791d831918f req-d64d07c6-e8f4-46b6-a42e-fc24881810c6 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Neutron deleted interface 0427a59c-aa48-4b73-9579-e91d5e1830b0; detaching it from the instance and deleting it from the info cache
Aug 22 02:59:47 user nova-compute[73469]: DEBUG nova.network.neutron [req-cf634905-137b-4842-8c2e-7791d831918f req-d64d07c6-e8f4-46b6-a42e-fc24881810c6 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 02:59:47 user nova-compute[73469]: DEBUG nova.compute.manager [req-cf634905-137b-4842-8c2e-7791d831918f req-d64d07c6-e8f4-46b6-a42e-fc24881810c6 service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Detach interface failed, port_id=0427a59c-aa48-4b73-9579-e91d5e1830b0, reason: Instance ddef86ef-9510-4010-b34b-68ac6d95652b could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 02:59:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:48 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 02:59:48 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 02:59:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:48 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Deleted allocations for instance ddef86ef-9510-4010-b34b-68ac6d95652b
Aug 22 02:59:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6befc10a-7cbc-4216-9ae2-18ecf6fe02e6 tempest-TaggedAttachmentsTest-909833900 tempest-TaggedAttachmentsTest-909833900-project-member] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.584s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:48 user nova-compute[73469]: DEBUG nova.compute.manager [req-370df987-eb8c-43db-9db6-4a4e6d711ce6 req-99b97843-a47c-4307-9b47-07bbf691ea7b service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received event network-vif-plugged-0427a59c-aa48-4b73-9579-e91d5e1830b0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 02:59:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-370df987-eb8c-43db-9db6-4a4e6d711ce6 req-99b97843-a47c-4307-9b47-07bbf691ea7b service nova] Acquiring lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 02:59:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-370df987-eb8c-43db-9db6-4a4e6d711ce6 req-99b97843-a47c-4307-9b47-07bbf691ea7b service nova] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 02:59:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-370df987-eb8c-43db-9db6-4a4e6d711ce6 req-99b97843-a47c-4307-9b47-07bbf691ea7b service nova] Lock "ddef86ef-9510-4010-b34b-68ac6d95652b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 02:59:48 user nova-compute[73469]: DEBUG nova.compute.manager [req-370df987-eb8c-43db-9db6-4a4e6d711ce6 req-99b97843-a47c-4307-9b47-07bbf691ea7b service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] No waiting events found dispatching network-vif-plugged-0427a59c-aa48-4b73-9579-e91d5e1830b0 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 02:59:48 user nova-compute[73469]: WARNING nova.compute.manager [req-370df987-eb8c-43db-9db6-4a4e6d711ce6 req-99b97843-a47c-4307-9b47-07bbf691ea7b service nova] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Received unexpected event network-vif-plugged-0427a59c-aa48-4b73-9579-e91d5e1830b0 for instance with vm_state deleted and task_state None.
Aug 22 02:59:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 02:59:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:01 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673186.6504133, ddef86ef-9510-4010-b34b-68ac6d95652b => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:00:01 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] VM Stopped (Lifecycle Event)
Aug 22 03:00:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-5c2244db-966d-4422-9815-dc1e4322424e None None] [instance: ddef86ef-9510-4010-b34b-68ac6d95652b] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:00:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-753c0c88-1b37-4ebf-b61b-c1338abbb28f req-26bd8e8a-18e8-4732-a320-0c6031e815dc service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received event network-changed-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:00:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-753c0c88-1b37-4ebf-b61b-c1338abbb28f req-26bd8e8a-18e8-4732-a320-0c6031e815dc service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Refreshing instance network info cache due to event network-changed-4697b7dd-3290-45e0-baa6-01e13c682505. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:00:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-753c0c88-1b37-4ebf-b61b-c1338abbb28f req-26bd8e8a-18e8-4732-a320-0c6031e815dc service nova] Acquiring lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:00:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-753c0c88-1b37-4ebf-b61b-c1338abbb28f req-26bd8e8a-18e8-4732-a320-0c6031e815dc service nova] Acquired lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:00:23 user nova-compute[73469]: DEBUG nova.network.neutron [req-753c0c88-1b37-4ebf-b61b-c1338abbb28f req-26bd8e8a-18e8-4732-a320-0c6031e815dc service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Refreshing network info cache for port 4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:00:23 user nova-compute[73469]: DEBUG nova.network.neutron [req-753c0c88-1b37-4ebf-b61b-c1338abbb28f req-26bd8e8a-18e8-4732-a320-0c6031e815dc service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Updated VIF entry in instance network info cache for port 4697b7dd-3290-45e0-baa6-01e13c682505. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:00:24 user nova-compute[73469]: DEBUG nova.network.neutron [req-753c0c88-1b37-4ebf-b61b-c1338abbb28f req-26bd8e8a-18e8-4732-a320-0c6031e815dc service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Updating instance_info_cache with network_info: [{"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:00:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-753c0c88-1b37-4ebf-b61b-c1338abbb28f req-26bd8e8a-18e8-4732-a320-0c6031e815dc service nova] Releasing lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:00:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "20316a2a-2f1f-4008-ab14-551e627bf680" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:00:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "20316a2a-2f1f-4008-ab14-551e627bf680" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:00:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:00:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:00:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:00:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:00:24 user nova-compute[73469]: INFO nova.compute.claims [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Claim successful on node user
Aug 22 03:00:25 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:00:25 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:00:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG nova.policy [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab41a6128d3c49e89e5a2b3710eeea95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab77793ce9a4b85b90e3b7469daf58b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:00:25 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Creating image(s)
Aug 22 03:00:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "/opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "/opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "/opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.189s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.249s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:25 user nova-compute[73469]: INFO nova.compute.manager [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Terminating instance
Aug 22 03:00:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk 1073741824" returned: 0 in 0.050s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:00:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.227s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Successfully created port: 8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-42564074-6f83-440d-812e-a8f0719218ca req-cc31af6a-09c1-4f6c-afe4-b368824a7188 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received event network-vif-unplugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-42564074-6f83-440d-812e-a8f0719218ca req-cc31af6a-09c1-4f6c-afe4-b368824a7188 service nova] Acquiring lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-42564074-6f83-440d-812e-a8f0719218ca req-cc31af6a-09c1-4f6c-afe4-b368824a7188 service nova] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-42564074-6f83-440d-812e-a8f0719218ca req-cc31af6a-09c1-4f6c-afe4-b368824a7188 service nova] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-42564074-6f83-440d-812e-a8f0719218ca req-cc31af6a-09c1-4f6c-afe4-b368824a7188 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] No waiting events found dispatching network-vif-unplugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-42564074-6f83-440d-812e-a8f0719218ca req-cc31af6a-09c1-4f6c-afe4-b368824a7188 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received event network-vif-unplugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Cannot resize image /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG nova.objects.instance [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lazy-loading 'migration_context' on Instance uuid 20316a2a-2f1f-4008-ab14-551e627bf680 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Ensure instance console log exists: /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:26 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Instance destroyed successfully.
Aug 22 03:00:26 user nova-compute[73469]: DEBUG nova.objects.instance [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lazy-loading 'resources' on Instance uuid 3ade8cba-6c34-4457-9ad3-484a604dbdb6 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:54:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-494971023',display_name='tempest-TestMinimumBasicScenario-server-494971023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-494971023',id=12,image_ref='5ba380b7-0fb3-46e0-952a-fad052275037',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxDsMHfXNUJeghB3W0xA7prRk5BeY6oPMAoJykL4RIDk/xEWSZdAtjpo9CxUxeo233tXdy8WnJzPXcbeh3MhyjdPrmU9fA1+DWQ5M4dHqRiQKFKIkjSwtPUa1cuC/c6gw==',key_name='tempest-TestMinimumBasicScenario-286068567',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:55:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ec928b9a04840b18974870663be0d44',ramdisk_id='',reservation_id='r-obngx040',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ba380b7-0fb3-46e0-952a-fad052275037',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-619227623',owner_user_name='tempest-TestMinimumBasicScenario-619227623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:57:44Z,user_data=None,user_id='f03cf449ec504132b4ea50a033bdf2c0',uuid=3ade8cba-6c34-4457-9ad3-484a604dbdb6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Converting VIF {"id": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "address": "fa:16:3e:ef:c1:aa", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fedb7c-3d", "ovs_interfaceid": "18fedb7c-3d67-4417-b0a3-d98b54df5150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:c1:aa,bridge_name='br-int',has_traffic_filtering=True,id=18fedb7c-3d67-4417-b0a3-d98b54df5150,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fedb7c-3d') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG os_vif [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:c1:aa,bridge_name='br-int',has_traffic_filtering=True,id=18fedb7c-3d67-4417-b0a3-d98b54df5150,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fedb7c-3d') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18fedb7c-3d, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:26 user nova-compute[73469]: INFO os_vif [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:c1:aa,bridge_name='br-int',has_traffic_filtering=True,id=18fedb7c-3d67-4417-b0a3-d98b54df5150,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fedb7c-3d')
Aug 22 03:00:26 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Deleting instance files /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6_del
Aug 22 03:00:26 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Deletion of /opt/stack/data/nova/instances/3ade8cba-6c34-4457-9ad3-484a604dbdb6_del complete
Aug 22 03:00:26 user nova-compute[73469]: INFO nova.compute.manager [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 22 03:00:26 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:00:26 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Successfully updated port: 8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquired lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:00:27 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Took 0.50 seconds to deallocate network for instance.
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-983984a9-7f4c-4cb9-94c7-8a723e94020d req-b6575cfb-9f7f-49d6-82db-316a22e47ba0 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received event network-vif-deleted-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:00:27 user nova-compute[73469]: INFO nova.compute.manager [req-983984a9-7f4c-4cb9-94c7-8a723e94020d req-b6575cfb-9f7f-49d6-82db-316a22e47ba0 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Neutron deleted interface 18fedb7c-3d67-4417-b0a3-d98b54df5150; detaching it from the instance and deleting it from the info cache
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.network.neutron [req-983984a9-7f4c-4cb9-94c7-8a723e94020d req-b6575cfb-9f7f-49d6-82db-316a22e47ba0 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-983984a9-7f4c-4cb9-94c7-8a723e94020d req-b6575cfb-9f7f-49d6-82db-316a22e47ba0 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Detach interface failed, port_id=18fedb7c-3d67-4417-b0a3-d98b54df5150, reason: Instance 3ade8cba-6c34-4457-9ad3-484a604dbdb6 could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Updating instance_info_cache with network_info: [{"id": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "address": "fa:16:3e:cf:fb:77", "network": {"id": "48051bc9-cc7d-4248-8077-3bd59a1cb474", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab77793ce9a4b85b90e3b7469daf58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3d6f3d-12", "ovs_interfaceid": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Releasing lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Instance network_info: |[{"id": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "address": "fa:16:3e:cf:fb:77", "network": {"id": "48051bc9-cc7d-4248-8077-3bd59a1cb474", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab77793ce9a4b85b90e3b7469daf58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3d6f3d-12", "ovs_interfaceid": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Start _get_guest_xml network_info=[{"id": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "address": "fa:16:3e:cf:fb:77", "network": {"id": "48051bc9-cc7d-4248-8077-3bd59a1cb474", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab77793ce9a4b85b90e3b7469daf58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3d6f3d-12", "ovs_interfaceid": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:00:27 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:00:27 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1727070642',display_name='tempest-ServerStableDeviceRescueTest-server-1727070642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1727070642',id=21,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiFlw3K8uDuM14/olen5zZ3xxURmyCaloygS00hJxnTba04UwFxEPmyd3pqvFzE5IMeLVX+Gz0VhQsbsX4+RX+wUL04HnKgIab7U3aNj441PRpAzk5Ih/odplWzrEC+Lg==',key_name='tempest-keypair-1439006082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ab77793ce9a4b85b90e3b7469daf58b',ramdisk_id='',reservation_id='r-68qh01zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-71202601',owner_user_name='tempest-ServerStableDeviceRescueTest-71202601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:00:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab41a6128d3c49e89e5a2b3710eeea95',uuid=20316a2a-2f1f-4008-ab14-551e627bf680,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "address": "fa:16:3e:cf:fb:77", "network": {"id": "48051bc9-cc7d-4248-8077-3bd59a1cb474", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab77793ce9a4b85b90e3b7469daf58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3d6f3d-12", "ovs_interfaceid": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Converting VIF {"id": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "address": "fa:16:3e:cf:fb:77", "network": {"id": "48051bc9-cc7d-4248-8077-3bd59a1cb474", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab77793ce9a4b85b90e3b7469daf58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3d6f3d-12", "ovs_interfaceid": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:fb:77,bridge_name='br-int',has_traffic_filtering=True,id=8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8,network=Network(48051bc9-cc7d-4248-8077-3bd59a1cb474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a3d6f3d-12') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.objects.instance [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lazy-loading 'pci_devices' on Instance uuid 20316a2a-2f1f-4008-ab14-551e627bf680 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:00:27 user nova-compute[73469]:   <uuid>20316a2a-2f1f-4008-ab14-551e627bf680</uuid>
Aug 22 03:00:27 user nova-compute[73469]:   <name>instance-00000015</name>
Aug 22 03:00:27 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:00:27 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:00:27 user nova-compute[73469]:   <metadata>
Aug 22 03:00:27 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:00:27 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:00:27 user nova-compute[73469]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1727070642</nova:name>
Aug 22 03:00:27 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:00:27</nova:creationTime>
Aug 22 03:00:27 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:00:27 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:00:27 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:00:27 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:00:27 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:00:27 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:00:27 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:00:27 user nova-compute[73469]:       <nova:owner>
Aug 22 03:00:27 user nova-compute[73469]:         <nova:user uuid="ab41a6128d3c49e89e5a2b3710eeea95">tempest-ServerStableDeviceRescueTest-71202601-project-member</nova:user>
Aug 22 03:00:27 user nova-compute[73469]:         <nova:project uuid="4ab77793ce9a4b85b90e3b7469daf58b">tempest-ServerStableDeviceRescueTest-71202601</nova:project>
Aug 22 03:00:27 user nova-compute[73469]:       </nova:owner>
Aug 22 03:00:27 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:00:27 user nova-compute[73469]:       <nova:ports>
Aug 22 03:00:27 user nova-compute[73469]:         <nova:port uuid="8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8">
Aug 22 03:00:27 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 22 03:00:27 user nova-compute[73469]:         </nova:port>
Aug 22 03:00:27 user nova-compute[73469]:       </nova:ports>
Aug 22 03:00:27 user nova-compute[73469]:     </nova:instance>
Aug 22 03:00:27 user nova-compute[73469]:   </metadata>
Aug 22 03:00:27 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:00:27 user nova-compute[73469]:     <system>
Aug 22 03:00:27 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:00:27 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:00:27 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:00:27 user nova-compute[73469]:       <entry name="serial">20316a2a-2f1f-4008-ab14-551e627bf680</entry>
Aug 22 03:00:27 user nova-compute[73469]:       <entry name="uuid">20316a2a-2f1f-4008-ab14-551e627bf680</entry>
Aug 22 03:00:27 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:00:27 user nova-compute[73469]:     </system>
Aug 22 03:00:27 user nova-compute[73469]:   </sysinfo>
Aug 22 03:00:27 user nova-compute[73469]:   <os>
Aug 22 03:00:27 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:00:27 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:00:27 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:00:27 user nova-compute[73469]:   </os>
Aug 22 03:00:27 user nova-compute[73469]:   <features>
Aug 22 03:00:27 user nova-compute[73469]:     <acpi/>
Aug 22 03:00:27 user nova-compute[73469]:     <apic/>
Aug 22 03:00:27 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:00:27 user nova-compute[73469]:   </features>
Aug 22 03:00:27 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:00:27 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:00:27 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:00:27 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:00:27 user nova-compute[73469]:   </clock>
Aug 22 03:00:27 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:00:27 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:00:27 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:00:27 user nova-compute[73469]:   </cpu>
Aug 22 03:00:27 user nova-compute[73469]:   <devices>
Aug 22 03:00:27 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:00:27 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:00:27 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk"/>
Aug 22 03:00:27 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:00:27 user nova-compute[73469]:     </disk>
Aug 22 03:00:27 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:00:27 user nova-compute[73469]:       <mac address="fa:16:3e:cf:fb:77"/>
Aug 22 03:00:27 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:00:27 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:00:27 user nova-compute[73469]:       <target dev="tap8a3d6f3d-12"/>
Aug 22 03:00:27 user nova-compute[73469]:     </interface>
Aug 22 03:00:27 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:00:27 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/console.log" append="off"/>
Aug 22 03:00:27 user nova-compute[73469]:     </serial>
Aug 22 03:00:27 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:00:27 user nova-compute[73469]:     <video>
Aug 22 03:00:27 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:00:27 user nova-compute[73469]:     </video>
Aug 22 03:00:27 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:00:27 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:00:27 user nova-compute[73469]:     </rng>
Aug 22 03:00:27 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:00:27 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:00:27 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:00:27 user nova-compute[73469]:     </memballoon>
Aug 22 03:00:27 user nova-compute[73469]:   </devices>
Aug 22 03:00:27 user nova-compute[73469]: </domain>
Aug 22 03:00:27 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1727070642',display_name='tempest-ServerStableDeviceRescueTest-server-1727070642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1727070642',id=21,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiFlw3K8uDuM14/olen5zZ3xxURmyCaloygS00hJxnTba04UwFxEPmyd3pqvFzE5IMeLVX+Gz0VhQsbsX4+RX+wUL04HnKgIab7U3aNj441PRpAzk5Ih/odplWzrEC+Lg==',key_name='tempest-keypair-1439006082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ab77793ce9a4b85b90e3b7469daf58b',ramdisk_id='',reservation_id='r-68qh01zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-71202601',owner_user_name='tempest-ServerStableDeviceRescueTest-71202601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:00:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab41a6128d3c49e89e5a2b3710eeea95',uuid=20316a2a-2f1f-4008-ab14-551e627bf680,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "address": "fa:16:3e:cf:fb:77", "network": {"id": "48051bc9-cc7d-4248-8077-3bd59a1cb474", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab77793ce9a4b85b90e3b7469daf58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3d6f3d-12", "ovs_interfaceid": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Converting VIF {"id": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "address": "fa:16:3e:cf:fb:77", "network": {"id": "48051bc9-cc7d-4248-8077-3bd59a1cb474", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab77793ce9a4b85b90e3b7469daf58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3d6f3d-12", "ovs_interfaceid": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:fb:77,bridge_name='br-int',has_traffic_filtering=True,id=8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8,network=Network(48051bc9-cc7d-4248-8077-3bd59a1cb474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a3d6f3d-12') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG os_vif [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:fb:77,bridge_name='br-int',has_traffic_filtering=True,id=8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8,network=Network(48051bc9-cc7d-4248-8077-3bd59a1cb474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a3d6f3d-12') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a3d6f3d-12, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a3d6f3d-12, col_values=(('external_ids', {'iface-id': '8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:fb:77', 'vm-uuid': '20316a2a-2f1f-4008-ab14-551e627bf680'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:27 user nova-compute[73469]: INFO os_vif [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:fb:77,bridge_name='br-int',has_traffic_filtering=True,id=8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8,network=Network(48051bc9-cc7d-4248-8077-3bd59a1cb474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a3d6f3d-12')
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:00:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] No VIF found with MAC fa:16:3e:cf:fb:77, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:00:27 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Deleted allocations for instance 3ade8cba-6c34-4457-9ad3-484a604dbdb6
Aug 22 03:00:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-14d0c62e-dbd5-4784-a335-3dc1c60cf63f tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.208s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:00:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-f54b722b-6f29-4f4c-beaf-a65a83e1b0a4 req-20543e45-6df4-4474-8044-8ba0e7913aa3 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received event network-vif-plugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:00:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f54b722b-6f29-4f4c-beaf-a65a83e1b0a4 req-20543e45-6df4-4474-8044-8ba0e7913aa3 service nova] Acquiring lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:00:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f54b722b-6f29-4f4c-beaf-a65a83e1b0a4 req-20543e45-6df4-4474-8044-8ba0e7913aa3 service nova] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:00:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f54b722b-6f29-4f4c-beaf-a65a83e1b0a4 req-20543e45-6df4-4474-8044-8ba0e7913aa3 service nova] Lock "3ade8cba-6c34-4457-9ad3-484a604dbdb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:00:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-f54b722b-6f29-4f4c-beaf-a65a83e1b0a4 req-20543e45-6df4-4474-8044-8ba0e7913aa3 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] No waiting events found dispatching network-vif-plugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:00:28 user nova-compute[73469]: WARNING nova.compute.manager [req-f54b722b-6f29-4f4c-beaf-a65a83e1b0a4 req-20543e45-6df4-4474-8044-8ba0e7913aa3 service nova] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Received unexpected event network-vif-plugged-18fedb7c-3d67-4417-b0a3-d98b54df5150 for instance with vm_state deleted and task_state None.
Aug 22 03:00:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-f54b722b-6f29-4f4c-beaf-a65a83e1b0a4 req-20543e45-6df4-4474-8044-8ba0e7913aa3 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received event network-changed-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:00:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-f54b722b-6f29-4f4c-beaf-a65a83e1b0a4 req-20543e45-6df4-4474-8044-8ba0e7913aa3 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Refreshing instance network info cache due to event network-changed-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:00:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f54b722b-6f29-4f4c-beaf-a65a83e1b0a4 req-20543e45-6df4-4474-8044-8ba0e7913aa3 service nova] Acquiring lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:00:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f54b722b-6f29-4f4c-beaf-a65a83e1b0a4 req-20543e45-6df4-4474-8044-8ba0e7913aa3 service nova] Acquired lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:00:28 user nova-compute[73469]: DEBUG nova.network.neutron [req-f54b722b-6f29-4f4c-beaf-a65a83e1b0a4 req-20543e45-6df4-4474-8044-8ba0e7913aa3 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Refreshing network info cache for port 8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:00:28 user nova-compute[73469]: DEBUG nova.network.neutron [req-f54b722b-6f29-4f4c-beaf-a65a83e1b0a4 req-20543e45-6df4-4474-8044-8ba0e7913aa3 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Updated VIF entry in instance network info cache for port 8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:00:28 user nova-compute[73469]: DEBUG nova.network.neutron [req-f54b722b-6f29-4f4c-beaf-a65a83e1b0a4 req-20543e45-6df4-4474-8044-8ba0e7913aa3 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Updating instance_info_cache with network_info: [{"id": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "address": "fa:16:3e:cf:fb:77", "network": {"id": "48051bc9-cc7d-4248-8077-3bd59a1cb474", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab77793ce9a4b85b90e3b7469daf58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3d6f3d-12", "ovs_interfaceid": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:00:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f54b722b-6f29-4f4c-beaf-a65a83e1b0a4 req-20543e45-6df4-4474-8044-8ba0e7913aa3 service nova] Releasing lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:00:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "d8433c45-b889-4a7b-88c2-ba00679b1d26" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:00:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.008s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:00:29 user nova-compute[73469]: INFO nova.compute.manager [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Shelving
Aug 22 03:00:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:29 user nova-compute[73469]: DEBUG nova.compute.manager [req-b9bcafe8-1a7d-4924-9d46-9b17b7589b8a req-074f0a60-a683-4d2d-808a-3f851aade1d1 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received event network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:00:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b9bcafe8-1a7d-4924-9d46-9b17b7589b8a req-074f0a60-a683-4d2d-808a-3f851aade1d1 service nova] Acquiring lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:00:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b9bcafe8-1a7d-4924-9d46-9b17b7589b8a req-074f0a60-a683-4d2d-808a-3f851aade1d1 service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:00:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b9bcafe8-1a7d-4924-9d46-9b17b7589b8a req-074f0a60-a683-4d2d-808a-3f851aade1d1 service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:00:29 user nova-compute[73469]: DEBUG nova.compute.manager [req-b9bcafe8-1a7d-4924-9d46-9b17b7589b8a req-074f0a60-a683-4d2d-808a-3f851aade1d1 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] No waiting events found dispatching network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:00:29 user nova-compute[73469]: WARNING nova.compute.manager [req-b9bcafe8-1a7d-4924-9d46-9b17b7589b8a req-074f0a60-a683-4d2d-808a-3f851aade1d1 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received unexpected event network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 for instance with vm_state building and task_state spawning.
Aug 22 03:00:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:30 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Instance destroyed successfully.
Aug 22 03:00:30 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Beginning cold snapshot process
Aug 22 03:00:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-363642aa-57d5-4a2c-b98d-9138139c42af req-dce7e77b-7747-4056-9547-c7c7e719c69b service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received event network-vif-unplugged-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:00:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-363642aa-57d5-4a2c-b98d-9138139c42af req-dce7e77b-7747-4056-9547-c7c7e719c69b service nova] Acquiring lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:00:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-363642aa-57d5-4a2c-b98d-9138139c42af req-dce7e77b-7747-4056-9547-c7c7e719c69b service nova] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:00:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-363642aa-57d5-4a2c-b98d-9138139c42af req-dce7e77b-7747-4056-9547-c7c7e719c69b service nova] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:00:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-363642aa-57d5-4a2c-b98d-9138139c42af req-dce7e77b-7747-4056-9547-c7c7e719c69b service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] No waiting events found dispatching network-vif-unplugged-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:00:30 user nova-compute[73469]: WARNING nova.compute.manager [req-363642aa-57d5-4a2c-b98d-9138139c42af req-dce7e77b-7747-4056-9547-c7c7e719c69b service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received unexpected event network-vif-unplugged-4697b7dd-3290-45e0-baa6-01e13c682505 for instance with vm_state active and task_state shelving.
Aug 22 03:00:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-363642aa-57d5-4a2c-b98d-9138139c42af req-dce7e77b-7747-4056-9547-c7c7e719c69b service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received event network-vif-plugged-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:00:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-363642aa-57d5-4a2c-b98d-9138139c42af req-dce7e77b-7747-4056-9547-c7c7e719c69b service nova] Acquiring lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:00:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-363642aa-57d5-4a2c-b98d-9138139c42af req-dce7e77b-7747-4056-9547-c7c7e719c69b service nova] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:00:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-363642aa-57d5-4a2c-b98d-9138139c42af req-dce7e77b-7747-4056-9547-c7c7e719c69b service nova] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:00:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-363642aa-57d5-4a2c-b98d-9138139c42af req-dce7e77b-7747-4056-9547-c7c7e719c69b service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] No waiting events found dispatching network-vif-plugged-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:00:30 user nova-compute[73469]: WARNING nova.compute.manager [req-363642aa-57d5-4a2c-b98d-9138139c42af req-dce7e77b-7747-4056-9547-c7c7e719c69b service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received unexpected event network-vif-plugged-4697b7dd-3290-45e0-baa6-01e13c682505 for instance with vm_state active and task_state shelving.
Aug 22 03:00:30 user nova-compute[73469]: DEBUG nova.privsep.utils [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 22 03:00:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk /opt/stack/data/nova/instances/snapshots/tmpuzzu2n5j/fb1703959d644d0b8bf849db28ca164d {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk /opt/stack/data/nova/instances/snapshots/tmpuzzu2n5j/fb1703959d644d0b8bf849db28ca164d" returned: 0 in 0.872s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Snapshot extracted, beginning image upload
Aug 22 03:00:31 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673231.7881122, 20316a2a-2f1f-4008-ab14-551e627bf680 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:00:31 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] VM Resumed (Lifecycle Event)
Aug 22 03:00:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:00:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:00:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Instance spawned successfully.
Aug 22 03:00:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:00:31 user nova-compute[73469]: DEBUG nova.compute.manager [req-e9be4b93-2984-4ad0-9ebe-376ccde31ca1 req-bfcf35e7-2fec-4aaa-89e3-fd7ed7483ad4 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received event network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:00:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e9be4b93-2984-4ad0-9ebe-376ccde31ca1 req-bfcf35e7-2fec-4aaa-89e3-fd7ed7483ad4 service nova] Acquiring lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:00:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e9be4b93-2984-4ad0-9ebe-376ccde31ca1 req-bfcf35e7-2fec-4aaa-89e3-fd7ed7483ad4 service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:00:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e9be4b93-2984-4ad0-9ebe-376ccde31ca1 req-bfcf35e7-2fec-4aaa-89e3-fd7ed7483ad4 service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:00:31 user nova-compute[73469]: DEBUG nova.compute.manager [req-e9be4b93-2984-4ad0-9ebe-376ccde31ca1 req-bfcf35e7-2fec-4aaa-89e3-fd7ed7483ad4 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] No waiting events found dispatching network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:00:31 user nova-compute[73469]: WARNING nova.compute.manager [req-e9be4b93-2984-4ad0-9ebe-376ccde31ca1 req-bfcf35e7-2fec-4aaa-89e3-fd7ed7483ad4 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received unexpected event network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 for instance with vm_state building and task_state spawning.
Aug 22 03:00:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:00:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:00:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:00:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:00:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:00:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:00:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:00:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:00:31 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:00:31 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673231.7885685, 20316a2a-2f1f-4008-ab14-551e627bf680 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:00:31 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] VM Started (Lifecycle Event)
Aug 22 03:00:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:00:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:00:31 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:00:31 user nova-compute[73469]: INFO nova.compute.manager [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Took 6.59 seconds to spawn the instance on the hypervisor.
Aug 22 03:00:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:00:32 user nova-compute[73469]: INFO nova.compute.manager [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Took 7.44 seconds to build instance.
Aug 22 03:00:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9adbac75-2705-4210-adee-3dc22e6cc69a tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "20316a2a-2f1f-4008-ab14-551e627bf680" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.541s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:00:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:33 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Snapshot image upload complete
Aug 22 03:00:33 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:00:33 user nova-compute[73469]: INFO nova.compute.manager [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Shelve offloading
Aug 22 03:00:33 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Instance destroyed successfully.
Aug 22 03:00:33 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:00:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:00:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquired lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:00:33 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:00:34 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Updating instance_info_cache with network_info: [{"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:00:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Releasing lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:00:35 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Instance destroyed successfully.
Aug 22 03:00:35 user nova-compute[73469]: DEBUG nova.objects.instance [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'resources' on Instance uuid d8433c45-b889-4a7b-88c2-ba00679b1d26 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:58:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-557066596',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-557066596',id=19,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMTW/Tu7Qz4gAEdctdCddqJYGhHttiA4fs+mQuki8sncrz2C58Mwmx016ibO7bJAestH4l3mZDH5pSwtYnqkhyYMBuOsLjWnHvwC5ttu6BXaJxmcDyZpua6cpuuHaMcLA==',key_name='tempest-keypair-510663035',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:58:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ca3e1f2f72c7497ca3ad923a4b9459dc',ramdisk_id='',reservation_id='r-y4g07ft5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-774227889',owner_user_name='tempest-AttachVolumeShelveTestJSON-774227889-project-member',shelved_at='2023-08-22T03:00:33.725300',shelved_host='user',shelved_image_id='5f04b41f-bf9d-46a1-a910-3aa6cd00626d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:00:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41e697cd5e5f422f8ac90f7496f60936',uuid=d8433c45-b889-4a7b-88c2-ba00679b1d26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converting VIF {"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=4697b7dd-3290-45e0-baa6-01e13c682505,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4697b7dd-32') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG os_vif [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=4697b7dd-3290-45e0-baa6-01e13c682505,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4697b7dd-32') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4697b7dd-32, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-4b12f2cb-dcb7-4a3f-ad0f-c9d71af217db req-e4b97ccd-f928-4cc5-92e6-478f91e3eaf1 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received event network-changed-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-4b12f2cb-dcb7-4a3f-ad0f-c9d71af217db req-e4b97ccd-f928-4cc5-92e6-478f91e3eaf1 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Refreshing instance network info cache due to event network-changed-4697b7dd-3290-45e0-baa6-01e13c682505. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4b12f2cb-dcb7-4a3f-ad0f-c9d71af217db req-e4b97ccd-f928-4cc5-92e6-478f91e3eaf1 service nova] Acquiring lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4b12f2cb-dcb7-4a3f-ad0f-c9d71af217db req-e4b97ccd-f928-4cc5-92e6-478f91e3eaf1 service nova] Acquired lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG nova.network.neutron [req-4b12f2cb-dcb7-4a3f-ad0f-c9d71af217db req-e4b97ccd-f928-4cc5-92e6-478f91e3eaf1 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Refreshing network info cache for port 4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:35 user nova-compute[73469]: INFO os_vif [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=4697b7dd-3290-45e0-baa6-01e13c682505,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4697b7dd-32')
Aug 22 03:00:35 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Deleting instance files /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26_del
Aug 22 03:00:35 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Deletion of /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26_del complete
Aug 22 03:00:35 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Deleted allocations for instance d8433c45-b889-4a7b-88c2-ba00679b1d26
Aug 22 03:00:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG nova.objects.instance [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'numa_topology' on Instance uuid d8433c45-b889-4a7b-88c2-ba00679b1d26 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG nova.network.neutron [req-4b12f2cb-dcb7-4a3f-ad0f-c9d71af217db req-e4b97ccd-f928-4cc5-92e6-478f91e3eaf1 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Updated VIF entry in instance network info cache for port 4697b7dd-3290-45e0-baa6-01e13c682505. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG nova.network.neutron [req-4b12f2cb-dcb7-4a3f-ad0f-c9d71af217db req-e4b97ccd-f928-4cc5-92e6-478f91e3eaf1 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Updating instance_info_cache with network_info: [{"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4697b7dd-32", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4b12f2cb-dcb7-4a3f-ad0f-c9d71af217db req-e4b97ccd-f928-4cc5-92e6-478f91e3eaf1 service nova] Releasing lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:00:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9dc8281c-0edc-475b-8281-a69257d90240 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.299s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:00:36 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:00:37 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:00:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:38 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:00:39 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:00:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:00:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:00:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:00:39 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:00:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:00:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:41 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673226.784732, 3ade8cba-6c34-4457-9ad3-484a604dbdb6 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:00:41 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] VM Stopped (Lifecycle Event)
Aug 22 03:00:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-644bf6bb-216c-4732-abc9-335d069b5d15 None None] [instance: 3ade8cba-6c34-4457-9ad3-484a604dbdb6] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:00:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:00:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:00:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:00:43 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:00:43 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:00:43 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=7756MB free_disk=25.330345153808594GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:00:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:00:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:00:43 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:00:43 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d0668c0-7a49-4857-9b69-541021f18ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:00:43 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance dc3f5545-8ebb-4947-97d0-98a91f67e421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:00:43 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8242cec1-3b35-4d14-9e0b-db8a7e75697d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:00:43 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 2e621408-a0af-460b-80a2-3446b5f1aadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:00:43 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 5984759d-28f1-45e8-bb4c-27bd8df426f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:00:43 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82e872a7-70b0-4290-9a11-5316765aed01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:00:43 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 20316a2a-2f1f-4008-ab14-551e627bf680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:00:43 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:00:43 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:00:43 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:00:43 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:00:43 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:00:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:00:44 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:00:44 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:00:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:00:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-dc3f5545-8ebb-4947-97d0-98a91f67e421" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:00:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-dc3f5545-8ebb-4947-97d0-98a91f67e421" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:00:45 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:00:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-884a1cc6-ce19-42f0-b854-1a0f2b113ac5 req-77c06c18-1841-48c2-84ed-10376d7d75c7 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Received event network-changed-78ca747b-f8a3-4bde-8c6d-bfd860eca41b {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:00:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-884a1cc6-ce19-42f0-b854-1a0f2b113ac5 req-77c06c18-1841-48c2-84ed-10376d7d75c7 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Refreshing instance network info cache due to event network-changed-78ca747b-f8a3-4bde-8c6d-bfd860eca41b. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:00:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-884a1cc6-ce19-42f0-b854-1a0f2b113ac5 req-77c06c18-1841-48c2-84ed-10376d7d75c7 service nova] Acquiring lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:00:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-884a1cc6-ce19-42f0-b854-1a0f2b113ac5 req-77c06c18-1841-48c2-84ed-10376d7d75c7 service nova] Acquired lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:00:45 user nova-compute[73469]: DEBUG nova.network.neutron [req-884a1cc6-ce19-42f0-b854-1a0f2b113ac5 req-77c06c18-1841-48c2-84ed-10376d7d75c7 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Refreshing network info cache for port 78ca747b-f8a3-4bde-8c6d-bfd860eca41b {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:00:45 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673230.3332646, d8433c45-b889-4a7b-88c2-ba00679b1d26 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:00:45 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] VM Stopped (Lifecycle Event)
Aug 22 03:00:45 user nova-compute[73469]: DEBUG nova.compute.manager [None req-adbc4645-36ba-43ed-8db0-73cddfc28df8 None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:00:45 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Updating instance_info_cache with network_info: [{"id": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "address": "fa:16:3e:89:d7:b7", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ef805d-a4", "ovs_interfaceid": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:00:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-dc3f5545-8ebb-4947-97d0-98a91f67e421" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:00:45 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:00:45 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:00:45 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:00:45 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:00:46 user nova-compute[73469]: DEBUG nova.network.neutron [req-884a1cc6-ce19-42f0-b854-1a0f2b113ac5 req-77c06c18-1841-48c2-84ed-10376d7d75c7 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Updated VIF entry in instance network info cache for port 78ca747b-f8a3-4bde-8c6d-bfd860eca41b. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:00:46 user nova-compute[73469]: DEBUG nova.network.neutron [req-884a1cc6-ce19-42f0-b854-1a0f2b113ac5 req-77c06c18-1841-48c2-84ed-10376d7d75c7 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Updating instance_info_cache with network_info: [{"id": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "address": "fa:16:3e:0d:d7:78", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ca747b-f8", "ovs_interfaceid": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:00:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-884a1cc6-ce19-42f0-b854-1a0f2b113ac5 req-77c06c18-1841-48c2-84ed-10376d7d75c7 service nova] Releasing lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:00:46 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:00:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:00:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG nova.objects.instance [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'flavor' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "refresh_cache-2e621408-a0af-460b-80a2-3446b5f1aadb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquired lock "refresh_cache-2e621408-a0af-460b-80a2-3446b5f1aadb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG nova.network.neutron [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG nova.objects.instance [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'info_cache' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG nova.network.neutron [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Updating instance_info_cache with network_info: [{"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Releasing lock "refresh_cache-2e621408-a0af-460b-80a2-3446b5f1aadb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:01:00 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Instance destroyed successfully.
Aug 22 03:01:00 user nova-compute[73469]: DEBUG nova.objects.instance [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'resources' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1789351683',display_name='tempest-AttachVolumeTestJSON-server-1789351683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1789351683',id=17,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg3FO8Q1Fyh7Eb17I96O7txjPwDiFqMIfNq8/4/TcYPo08QnJwR73w8ZzPDWLE/eydf8rsuj4/QsACeGK9yAdP5tx7NSUxI3GV9dfyUcRbWNJiAjAgSe8h9Vrksa3qrNg==',key_name='tempest-keypair-647650365',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:57:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e49e405f5aca432097b7ba854fd3055b',ramdisk_id='',reservation_id='r-xv1z21bt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-356928747',owner_user_name='tempest-AttachVolumeTestJSON-356928747-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:59:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e62d25dff554a629a7e0af1406d97a9',uuid=2e621408-a0af-460b-80a2-3446b5f1aadb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converting VIF {"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG os_vif [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b3de561-7d, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:01:00 user nova-compute[73469]: INFO os_vif [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d')
Aug 22 03:01:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjUoOpBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:01:00 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:01:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[44aba49c-8e2c-4479-b9b7-c7f24c3ff571]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e196aff-af9f-4b0e-89b6-3a5557f9af23]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:01:00 user nova-compute[73469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:01:00 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:01:00 user nova-compute[73469]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:01:00 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4139cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6d9678-4a2d-404c-a08b-0e9da47a281e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[202e7cbf-b729-437c-ac33-9467fd3b5d30]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bac0e3a-c53b-4f1d-8038-4ff872080140]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7c102b-e52a-4101-9801-b1d5ef3ad8a1]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[645677db-cb92-402b-91a3-fd590f8ee636]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d46ce10-a91a-45f5-b4e7-05b6e427cfea]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3, portal: 172.16.0.220,3260]
Aug 22 03:01:00 user nova-compute[73469]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3, portal: 172.16.0.220,3260] successful.
Aug 22 03:01:00 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a894a4b-3dbd-494b-a9d3-baf79f5f6952]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] <== disconnect_volume: return (272ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Start _get_guest_xml network_info=[{"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': '502da398-e338-4d94-bd96-9714803c355f', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjUoOpBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '2e621408-a0af-460b-80a2-3446b5f1aadb', 'attached_at': '', 'detached_at': '', 'volume_id': '27716b1b-781f-47e7-992b-7521fda49ee3', 'serial': '27716b1b-781f-47e7-992b-7521fda49ee3'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.objects.instance [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'numa_topology' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:01:01 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:01:01 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.objects.instance [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjUoOpBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:01:01 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:01:01 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:01:01 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9606b57e-fba6-4ad9-8b80-23acc95ceb6b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:01:01 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bcdfd0-b1bb-4be5-b04b-e6ec930d9a72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3] added
Aug 22 03:01:01 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[115aeadf-1a91-4b6b-bfae-524c2f8936df]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[74464213-65a6-458f-ab3c-1d9e7a833107]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjUoOpBX {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjUoOpBX" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff4e942-2f45-41d7-9641-2d5ff389d319]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wjUoOpBX'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8b0324-2f75-42df-99d4-d20b1e8f8904]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bc577a-8800-4920-8a6c-741e4b00225a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:01:01 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:01:01 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ad07e8-1668-4aa3-8bb5-cbcf9c6decfb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3, portal: 172.16.0.220,3260]
Aug 22 03:01:01 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3, portal: 172.16.0.220,3260] successful.
Aug 22 03:01:01 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f028d781-64cc-4f26-a531-af9d9cc4e0a2]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd65868c-c664-4c72-acf0-2e848f12f526]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:01:01 user nova-compute[73469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:01:01 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:01:01 user nova-compute[73469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:01:01 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71fa3b6-3346-4221-81d9-7d7f30da6870]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:01 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjUoOpBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26366663964396237', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366663964396237', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1789351683',display_name='tempest-AttachVolumeTestJSON-server-1789351683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1789351683',id=17,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg3FO8Q1Fyh7Eb17I96O7txjPwDiFqMIfNq8/4/TcYPo08QnJwR73w8ZzPDWLE/eydf8rsuj4/QsACeGK9yAdP5tx7NSUxI3GV9dfyUcRbWNJiAjAgSe8h9Vrksa3qrNg==',key_name='tempest-keypair-647650365',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:57:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e49e405f5aca432097b7ba854fd3055b',ramdisk_id='',reservation_id='r-xv1z21bt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-356928747',owner_user_name='tempest-AttachVolumeTestJSON-356928747-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:59:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e62d25dff554a629a7e0af1406d97a9',uuid=2e621408-a0af-460b-80a2-3446b5f1aadb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converting VIF {"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG nova.objects.instance [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:01:02 user nova-compute[73469]:   <uuid>2e621408-a0af-460b-80a2-3446b5f1aadb</uuid>
Aug 22 03:01:02 user nova-compute[73469]:   <name>instance-00000011</name>
Aug 22 03:01:02 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:01:02 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:01:02 user nova-compute[73469]:   <metadata>
Aug 22 03:01:02 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:01:02 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:01:02 user nova-compute[73469]:       <nova:name>tempest-AttachVolumeTestJSON-server-1789351683</nova:name>
Aug 22 03:01:02 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:01:01</nova:creationTime>
Aug 22 03:01:02 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:01:02 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:01:02 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:01:02 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:01:02 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:01:02 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:01:02 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:01:02 user nova-compute[73469]:       <nova:owner>
Aug 22 03:01:02 user nova-compute[73469]:         <nova:user uuid="0e62d25dff554a629a7e0af1406d97a9">tempest-AttachVolumeTestJSON-356928747-project-member</nova:user>
Aug 22 03:01:02 user nova-compute[73469]:         <nova:project uuid="e49e405f5aca432097b7ba854fd3055b">tempest-AttachVolumeTestJSON-356928747</nova:project>
Aug 22 03:01:02 user nova-compute[73469]:       </nova:owner>
Aug 22 03:01:02 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:01:02 user nova-compute[73469]:       <nova:ports>
Aug 22 03:01:02 user nova-compute[73469]:         <nova:port uuid="1b3de561-7dd1-4d48-8932-05c4e4770538">
Aug 22 03:01:02 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 22 03:01:02 user nova-compute[73469]:         </nova:port>
Aug 22 03:01:02 user nova-compute[73469]:       </nova:ports>
Aug 22 03:01:02 user nova-compute[73469]:     </nova:instance>
Aug 22 03:01:02 user nova-compute[73469]:   </metadata>
Aug 22 03:01:02 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:01:02 user nova-compute[73469]:     <system>
Aug 22 03:01:02 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:01:02 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:01:02 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:01:02 user nova-compute[73469]:       <entry name="serial">2e621408-a0af-460b-80a2-3446b5f1aadb</entry>
Aug 22 03:01:02 user nova-compute[73469]:       <entry name="uuid">2e621408-a0af-460b-80a2-3446b5f1aadb</entry>
Aug 22 03:01:02 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:01:02 user nova-compute[73469]:     </system>
Aug 22 03:01:02 user nova-compute[73469]:   </sysinfo>
Aug 22 03:01:02 user nova-compute[73469]:   <os>
Aug 22 03:01:02 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:01:02 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:01:02 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:01:02 user nova-compute[73469]:   </os>
Aug 22 03:01:02 user nova-compute[73469]:   <features>
Aug 22 03:01:02 user nova-compute[73469]:     <acpi/>
Aug 22 03:01:02 user nova-compute[73469]:     <apic/>
Aug 22 03:01:02 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:01:02 user nova-compute[73469]:   </features>
Aug 22 03:01:02 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:01:02 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:01:02 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:01:02 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:01:02 user nova-compute[73469]:   </clock>
Aug 22 03:01:02 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:01:02 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:01:02 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:01:02 user nova-compute[73469]:   </cpu>
Aug 22 03:01:02 user nova-compute[73469]:   <devices>
Aug 22 03:01:02 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:01:02 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:01:02 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk"/>
Aug 22 03:01:02 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:01:02 user nova-compute[73469]:     </disk>
Aug 22 03:01:02 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:01:02 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:01:02 user nova-compute[73469]:       <source dev="/dev/sdb"/>
Aug 22 03:01:02 user nova-compute[73469]:       <target dev="vdb" bus="virtio"/>
Aug 22 03:01:02 user nova-compute[73469]:       <serial>27716b1b-781f-47e7-992b-7521fda49ee3</serial>
Aug 22 03:01:02 user nova-compute[73469]:     </disk>
Aug 22 03:01:02 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:01:02 user nova-compute[73469]:       <mac address="fa:16:3e:d7:a2:07"/>
Aug 22 03:01:02 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:01:02 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:01:02 user nova-compute[73469]:       <target dev="tap1b3de561-7d"/>
Aug 22 03:01:02 user nova-compute[73469]:     </interface>
Aug 22 03:01:02 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:01:02 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/console.log" append="off"/>
Aug 22 03:01:02 user nova-compute[73469]:     </serial>
Aug 22 03:01:02 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:01:02 user nova-compute[73469]:     <video>
Aug 22 03:01:02 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:01:02 user nova-compute[73469]:     </video>
Aug 22 03:01:02 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:01:02 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:01:02 user nova-compute[73469]:     </rng>
Aug 22 03:01:02 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:01:02 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:01:02 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:01:02 user nova-compute[73469]:     </memballoon>
Aug 22 03:01:02 user nova-compute[73469]:   </devices>
Aug 22 03:01:02 user nova-compute[73469]: </domain>
Aug 22 03:01:02 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG nova.objects.instance [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.173s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:01:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:03 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Cannot resize image /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:01:03 user nova-compute[73469]: DEBUG nova.objects.instance [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'migration_context' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:01:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1789351683',display_name='tempest-AttachVolumeTestJSON-server-1789351683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1789351683',id=17,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg3FO8Q1Fyh7Eb17I96O7txjPwDiFqMIfNq8/4/TcYPo08QnJwR73w8ZzPDWLE/eydf8rsuj4/QsACeGK9yAdP5tx7NSUxI3GV9dfyUcRbWNJiAjAgSe8h9Vrksa3qrNg==',key_name='tempest-keypair-647650365',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:57:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e49e405f5aca432097b7ba854fd3055b',ramdisk_id='',reservation_id='r-xv1z21bt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-356928747',owner_user_name='tempest-AttachVolumeTestJSON-356928747-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T02:59:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e62d25dff554a629a7e0af1406d97a9',uuid=2e621408-a0af-460b-80a2-3446b5f1aadb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:01:03 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converting VIF {"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:01:03 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:01:03 user nova-compute[73469]: DEBUG os_vif [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:01:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:01:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:01:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b3de561-7d, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:01:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1b3de561-7d, col_values=(('external_ids', {'iface-id': '1b3de561-7dd1-4d48-8932-05c4e4770538', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:a2:07', 'vm-uuid': '2e621408-a0af-460b-80a2-3446b5f1aadb'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:01:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:01:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:03 user nova-compute[73469]: INFO os_vif [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d')
Aug 22 03:01:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:04 user nova-compute[73469]: DEBUG nova.compute.manager [req-f7ab7c2c-3f7d-461f-9a43-d70d03cf6744 req-454d6ac6-6c69-4736-b565-0a5e651d6e5a service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received event network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:01:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f7ab7c2c-3f7d-461f-9a43-d70d03cf6744 req-454d6ac6-6c69-4736-b565-0a5e651d6e5a service nova] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f7ab7c2c-3f7d-461f-9a43-d70d03cf6744 req-454d6ac6-6c69-4736-b565-0a5e651d6e5a service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f7ab7c2c-3f7d-461f-9a43-d70d03cf6744 req-454d6ac6-6c69-4736-b565-0a5e651d6e5a service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:04 user nova-compute[73469]: DEBUG nova.compute.manager [req-f7ab7c2c-3f7d-461f-9a43-d70d03cf6744 req-454d6ac6-6c69-4736-b565-0a5e651d6e5a service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] No waiting events found dispatching network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:01:04 user nova-compute[73469]: WARNING nova.compute.manager [req-f7ab7c2c-3f7d-461f-9a43-d70d03cf6744 req-454d6ac6-6c69-4736-b565-0a5e651d6e5a service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received unexpected event network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 for instance with vm_state stopped and task_state powering-on.
Aug 22 03:01:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:06 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673266.8293216, 2e621408-a0af-460b-80a2-3446b5f1aadb => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:01:06 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] VM Resumed (Lifecycle Event)
Aug 22 03:01:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:01:06 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Instance rebooted successfully.
Aug 22 03:01:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-73eeb399-7ffd-4675-8d29-2ad9c7d0e9be tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:01:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:01:06 user nova-compute[73469]: DEBUG nova.compute.manager [req-9edf197f-49d7-4b8a-854c-fb131f589e2e req-ab25e7e4-88bd-4c2a-af00-92295e6c6de6 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received event network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:01:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9edf197f-49d7-4b8a-854c-fb131f589e2e req-ab25e7e4-88bd-4c2a-af00-92295e6c6de6 service nova] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9edf197f-49d7-4b8a-854c-fb131f589e2e req-ab25e7e4-88bd-4c2a-af00-92295e6c6de6 service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9edf197f-49d7-4b8a-854c-fb131f589e2e req-ab25e7e4-88bd-4c2a-af00-92295e6c6de6 service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:06 user nova-compute[73469]: DEBUG nova.compute.manager [req-9edf197f-49d7-4b8a-854c-fb131f589e2e req-ab25e7e4-88bd-4c2a-af00-92295e6c6de6 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] No waiting events found dispatching network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:01:06 user nova-compute[73469]: WARNING nova.compute.manager [req-9edf197f-49d7-4b8a-854c-fb131f589e2e req-ab25e7e4-88bd-4c2a-af00-92295e6c6de6 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received unexpected event network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 for instance with vm_state stopped and task_state powering-on.
Aug 22 03:01:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:01:06 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 22 03:01:06 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673266.832242, 2e621408-a0af-460b-80a2-3446b5f1aadb => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:01:06 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] VM Started (Lifecycle Event)
Aug 22 03:01:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:01:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:01:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "980e57bf-dec9-46f3-8d69-e20a17603af8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "980e57bf-dec9-46f3-8d69-e20a17603af8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:01:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:13 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:01:13 user nova-compute[73469]: INFO nova.compute.claims [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Claim successful on node user
Aug 22 03:01:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:13 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:01:13 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:01:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:01:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:01:13 user nova-compute[73469]: DEBUG nova.network.neutron [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:01:13 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:01:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:01:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:01:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:01:13 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Creating image(s)
Aug 22 03:01:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "/opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "/opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "/opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:13 user nova-compute[73469]: DEBUG nova.policy [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7b228f99c9e4d058e128a5a99636b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9131cb883044191931dc31e51e94766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:01:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.190s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.200s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk 1073741824" returned: 0 in 0.061s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.193s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Checking if we can resize image /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Cannot resize image /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG nova.objects.instance [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'migration_context' on Instance uuid 980e57bf-dec9-46f3-8d69-e20a17603af8 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Ensure instance console log exists: /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:15 user nova-compute[73469]: DEBUG nova.compute.manager [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:01:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:16 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:01:16 user nova-compute[73469]: INFO nova.compute.claims [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Claim successful on node user
Aug 22 03:01:16 user nova-compute[73469]: DEBUG nova.network.neutron [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Successfully created port: 0746c7bf-34e4-4be1-84ba-c0cf192111dd {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:01:16 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:01:16 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:01:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.756s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:16 user nova-compute[73469]: DEBUG nova.compute.manager [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:01:16 user nova-compute[73469]: DEBUG nova.compute.manager [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:01:16 user nova-compute[73469]: DEBUG nova.network.neutron [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:01:16 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:01:17 user nova-compute[73469]: DEBUG nova.compute.manager [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG nova.policy [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64b023ffba814ac5b6a3bc4666107767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cd52eb0f2642bc95dbf216ae280e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG nova.compute.manager [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:01:17 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Creating image(s)
Aug 22 03:01:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "/opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "/opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.244s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.241s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG nova.network.neutron [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Successfully updated port: 0746c7bf-34e4-4be1-84ba-c0cf192111dd {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk 1073741824" returned: 0 in 0.085s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG nova.compute.manager [req-5b300df8-809e-4b1b-81ab-412a87720508 req-26498d3c-0e3f-40f5-b4e0-a26ebe221439 service nova] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Received event network-changed-0746c7bf-34e4-4be1-84ba-c0cf192111dd {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG nova.compute.manager [req-5b300df8-809e-4b1b-81ab-412a87720508 req-26498d3c-0e3f-40f5-b4e0-a26ebe221439 service nova] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Refreshing instance network info cache due to event network-changed-0746c7bf-34e4-4be1-84ba-c0cf192111dd. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5b300df8-809e-4b1b-81ab-412a87720508 req-26498d3c-0e3f-40f5-b4e0-a26ebe221439 service nova] Acquiring lock "refresh_cache-980e57bf-dec9-46f3-8d69-e20a17603af8" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5b300df8-809e-4b1b-81ab-412a87720508 req-26498d3c-0e3f-40f5-b4e0-a26ebe221439 service nova] Acquired lock "refresh_cache-980e57bf-dec9-46f3-8d69-e20a17603af8" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG nova.network.neutron [req-5b300df8-809e-4b1b-81ab-412a87720508 req-26498d3c-0e3f-40f5-b4e0-a26ebe221439 service nova] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Refreshing network info cache for port 0746c7bf-34e4-4be1-84ba-c0cf192111dd {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "refresh_cache-980e57bf-dec9-46f3-8d69-e20a17603af8" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:17 user nova-compute[73469]: DEBUG nova.network.neutron [req-5b300df8-809e-4b1b-81ab-412a87720508 req-26498d3c-0e3f-40f5-b4e0-a26ebe221439 service nova] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.241s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.network.neutron [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Successfully created port: a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.network.neutron [req-5b300df8-809e-4b1b-81ab-412a87720508 req-26498d3c-0e3f-40f5-b4e0-a26ebe221439 service nova] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5b300df8-809e-4b1b-81ab-412a87720508 req-26498d3c-0e3f-40f5-b4e0-a26ebe221439 service nova] Releasing lock "refresh_cache-980e57bf-dec9-46f3-8d69-e20a17603af8" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquired lock "refresh_cache-980e57bf-dec9-46f3-8d69-e20a17603af8" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.network.neutron [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Cannot resize image /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.objects.instance [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'migration_context' on Instance uuid f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Ensure instance console log exists: /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.network.neutron [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.network.neutron [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Updating instance_info_cache with network_info: [{"id": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "address": "fa:16:3e:48:68:85", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0746c7bf-34", "ovs_interfaceid": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Releasing lock "refresh_cache-980e57bf-dec9-46f3-8d69-e20a17603af8" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.compute.manager [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Instance network_info: |[{"id": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "address": "fa:16:3e:48:68:85", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0746c7bf-34", "ovs_interfaceid": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Start _get_guest_xml network_info=[{"id": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "address": "fa:16:3e:48:68:85", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0746c7bf-34", "ovs_interfaceid": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:01:18 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:01:18 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-788981196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-788981196',id=22,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9131cb883044191931dc31e51e94766',ramdisk_id='',reservation_id='r-s291shuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568629509',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:01:14Z,user_data=None,user_id='a7b228f99c9e4d058e128a5a99636b7b',uuid=980e57bf-dec9-46f3-8d69-e20a17603af8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "address": "fa:16:3e:48:68:85", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0746c7bf-34", "ovs_interfaceid": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converting VIF {"id": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "address": "fa:16:3e:48:68:85", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0746c7bf-34", "ovs_interfaceid": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:68:85,bridge_name='br-int',has_traffic_filtering=True,id=0746c7bf-34e4-4be1-84ba-c0cf192111dd,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0746c7bf-34') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.objects.instance [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'pci_devices' on Instance uuid 980e57bf-dec9-46f3-8d69-e20a17603af8 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:01:18 user nova-compute[73469]:   <uuid>980e57bf-dec9-46f3-8d69-e20a17603af8</uuid>
Aug 22 03:01:18 user nova-compute[73469]:   <name>instance-00000016</name>
Aug 22 03:01:18 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:01:18 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:01:18 user nova-compute[73469]:   <metadata>
Aug 22 03:01:18 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:01:18 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:01:18 user nova-compute[73469]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-788981196</nova:name>
Aug 22 03:01:18 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:01:18</nova:creationTime>
Aug 22 03:01:18 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:01:18 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:01:18 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:01:18 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:01:18 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:01:18 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:01:18 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:01:18 user nova-compute[73469]:       <nova:owner>
Aug 22 03:01:18 user nova-compute[73469]:         <nova:user uuid="a7b228f99c9e4d058e128a5a99636b7b">tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member</nova:user>
Aug 22 03:01:18 user nova-compute[73469]:         <nova:project uuid="c9131cb883044191931dc31e51e94766">tempest-ServerBootFromVolumeStableRescueTest-568629509</nova:project>
Aug 22 03:01:18 user nova-compute[73469]:       </nova:owner>
Aug 22 03:01:18 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:01:18 user nova-compute[73469]:       <nova:ports>
Aug 22 03:01:18 user nova-compute[73469]:         <nova:port uuid="0746c7bf-34e4-4be1-84ba-c0cf192111dd">
Aug 22 03:01:18 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 22 03:01:18 user nova-compute[73469]:         </nova:port>
Aug 22 03:01:18 user nova-compute[73469]:       </nova:ports>
Aug 22 03:01:18 user nova-compute[73469]:     </nova:instance>
Aug 22 03:01:18 user nova-compute[73469]:   </metadata>
Aug 22 03:01:18 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:01:18 user nova-compute[73469]:     <system>
Aug 22 03:01:18 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:01:18 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:01:18 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:01:18 user nova-compute[73469]:       <entry name="serial">980e57bf-dec9-46f3-8d69-e20a17603af8</entry>
Aug 22 03:01:18 user nova-compute[73469]:       <entry name="uuid">980e57bf-dec9-46f3-8d69-e20a17603af8</entry>
Aug 22 03:01:18 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:01:18 user nova-compute[73469]:     </system>
Aug 22 03:01:18 user nova-compute[73469]:   </sysinfo>
Aug 22 03:01:18 user nova-compute[73469]:   <os>
Aug 22 03:01:18 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:01:18 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:01:18 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:01:18 user nova-compute[73469]:   </os>
Aug 22 03:01:18 user nova-compute[73469]:   <features>
Aug 22 03:01:18 user nova-compute[73469]:     <acpi/>
Aug 22 03:01:18 user nova-compute[73469]:     <apic/>
Aug 22 03:01:18 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:01:18 user nova-compute[73469]:   </features>
Aug 22 03:01:18 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:01:18 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:01:18 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:01:18 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:01:18 user nova-compute[73469]:   </clock>
Aug 22 03:01:18 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:01:18 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:01:18 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:01:18 user nova-compute[73469]:   </cpu>
Aug 22 03:01:18 user nova-compute[73469]:   <devices>
Aug 22 03:01:18 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:01:18 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:01:18 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk"/>
Aug 22 03:01:18 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:01:18 user nova-compute[73469]:     </disk>
Aug 22 03:01:18 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:01:18 user nova-compute[73469]:       <mac address="fa:16:3e:48:68:85"/>
Aug 22 03:01:18 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:01:18 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:01:18 user nova-compute[73469]:       <target dev="tap0746c7bf-34"/>
Aug 22 03:01:18 user nova-compute[73469]:     </interface>
Aug 22 03:01:18 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:01:18 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/console.log" append="off"/>
Aug 22 03:01:18 user nova-compute[73469]:     </serial>
Aug 22 03:01:18 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:01:18 user nova-compute[73469]:     <video>
Aug 22 03:01:18 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:01:18 user nova-compute[73469]:     </video>
Aug 22 03:01:18 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:01:18 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:01:18 user nova-compute[73469]:     </rng>
Aug 22 03:01:18 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:01:18 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:01:18 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:01:18 user nova-compute[73469]:     </memballoon>
Aug 22 03:01:18 user nova-compute[73469]:   </devices>
Aug 22 03:01:18 user nova-compute[73469]: </domain>
Aug 22 03:01:18 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-788981196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-788981196',id=22,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9131cb883044191931dc31e51e94766',ramdisk_id='',reservation_id='r-s291shuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568629509',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:01:14Z,user_data=None,user_id='a7b228f99c9e4d058e128a5a99636b7b',uuid=980e57bf-dec9-46f3-8d69-e20a17603af8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "address": "fa:16:3e:48:68:85", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0746c7bf-34", "ovs_interfaceid": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converting VIF {"id": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "address": "fa:16:3e:48:68:85", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0746c7bf-34", "ovs_interfaceid": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:68:85,bridge_name='br-int',has_traffic_filtering=True,id=0746c7bf-34e4-4be1-84ba-c0cf192111dd,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0746c7bf-34') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG os_vif [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:68:85,bridge_name='br-int',has_traffic_filtering=True,id=0746c7bf-34e4-4be1-84ba-c0cf192111dd,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0746c7bf-34') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0746c7bf-34, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0746c7bf-34, col_values=(('external_ids', {'iface-id': '0746c7bf-34e4-4be1-84ba-c0cf192111dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:68:85', 'vm-uuid': '980e57bf-dec9-46f3-8d69-e20a17603af8'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:18 user nova-compute[73469]: INFO os_vif [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:68:85,bridge_name='br-int',has_traffic_filtering=True,id=0746c7bf-34e4-4be1-84ba-c0cf192111dd,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0746c7bf-34')
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:01:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] No VIF found with MAC fa:16:3e:48:68:85, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.network.neutron [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Successfully updated port: a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquired lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.network.neutron [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.compute.manager [req-e461364a-1070-439a-ad50-e8fef2fd02fd req-f6f90305-c272-4a7b-8920-4cecbb8db9fd service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received event network-changed-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.compute.manager [req-e461364a-1070-439a-ad50-e8fef2fd02fd req-f6f90305-c272-4a7b-8920-4cecbb8db9fd service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Refreshing instance network info cache due to event network-changed-a64e4e29-61af-465a-8dc2-b8851274e0d9. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e461364a-1070-439a-ad50-e8fef2fd02fd req-f6f90305-c272-4a7b-8920-4cecbb8db9fd service nova] Acquiring lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.network.neutron [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.network.neutron [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Updating instance_info_cache with network_info: [{"id": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "address": "fa:16:3e:63:38:91", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e4e29-61", "ovs_interfaceid": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Releasing lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.compute.manager [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Instance network_info: |[{"id": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "address": "fa:16:3e:63:38:91", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e4e29-61", "ovs_interfaceid": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e461364a-1070-439a-ad50-e8fef2fd02fd req-f6f90305-c272-4a7b-8920-4cecbb8db9fd service nova] Acquired lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.network.neutron [req-e461364a-1070-439a-ad50-e8fef2fd02fd req-f6f90305-c272-4a7b-8920-4cecbb8db9fd service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Refreshing network info cache for port a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Start _get_guest_xml network_info=[{"id": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "address": "fa:16:3e:63:38:91", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e4e29-61", "ovs_interfaceid": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:01:19 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:01:19 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1462217807',display_name='tempest-ServerRescueNegativeTestJSON-server-1462217807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1462217807',id=23,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXw+HABhLBLO82NaXM+wYITZ8kjjO4fDBfHrNaHircMbmq0ESPsalj62yNCub693ZB2AUl++bx/zlIxp/KOGwsJTgZa2DcddLoD4LicVmrTqVCS4jc8imCsGBLvay+cPA==',key_name='tempest-keypair-188206931',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46cd52eb0f2642bc95dbf216ae280e12',ramdisk_id='',reservation_id='r-3dwgg99t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2020570120',owner_user_name='tempest-ServerRescueNegativeTestJSON-2020570120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:01:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64b023ffba814ac5b6a3bc4666107767',uuid=f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "address": "fa:16:3e:63:38:91", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e4e29-61", "ovs_interfaceid": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converting VIF {"id": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "address": "fa:16:3e:63:38:91", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e4e29-61", "ovs_interfaceid": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:38:91,bridge_name='br-int',has_traffic_filtering=True,id=a64e4e29-61af-465a-8dc2-b8851274e0d9,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64e4e29-61') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.objects.instance [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'pci_devices' on Instance uuid f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:01:19 user nova-compute[73469]:   <uuid>f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76</uuid>
Aug 22 03:01:19 user nova-compute[73469]:   <name>instance-00000017</name>
Aug 22 03:01:19 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:01:19 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:01:19 user nova-compute[73469]:   <metadata>
Aug 22 03:01:19 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:01:19 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:01:19 user nova-compute[73469]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1462217807</nova:name>
Aug 22 03:01:19 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:01:19</nova:creationTime>
Aug 22 03:01:19 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:01:19 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:01:19 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:01:19 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:01:19 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:01:19 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:01:19 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:01:19 user nova-compute[73469]:       <nova:owner>
Aug 22 03:01:19 user nova-compute[73469]:         <nova:user uuid="64b023ffba814ac5b6a3bc4666107767">tempest-ServerRescueNegativeTestJSON-2020570120-project-member</nova:user>
Aug 22 03:01:19 user nova-compute[73469]:         <nova:project uuid="46cd52eb0f2642bc95dbf216ae280e12">tempest-ServerRescueNegativeTestJSON-2020570120</nova:project>
Aug 22 03:01:19 user nova-compute[73469]:       </nova:owner>
Aug 22 03:01:19 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:01:19 user nova-compute[73469]:       <nova:ports>
Aug 22 03:01:19 user nova-compute[73469]:         <nova:port uuid="a64e4e29-61af-465a-8dc2-b8851274e0d9">
Aug 22 03:01:19 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 22 03:01:19 user nova-compute[73469]:         </nova:port>
Aug 22 03:01:19 user nova-compute[73469]:       </nova:ports>
Aug 22 03:01:19 user nova-compute[73469]:     </nova:instance>
Aug 22 03:01:19 user nova-compute[73469]:   </metadata>
Aug 22 03:01:19 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:01:19 user nova-compute[73469]:     <system>
Aug 22 03:01:19 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:01:19 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:01:19 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:01:19 user nova-compute[73469]:       <entry name="serial">f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76</entry>
Aug 22 03:01:19 user nova-compute[73469]:       <entry name="uuid">f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76</entry>
Aug 22 03:01:19 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:01:19 user nova-compute[73469]:     </system>
Aug 22 03:01:19 user nova-compute[73469]:   </sysinfo>
Aug 22 03:01:19 user nova-compute[73469]:   <os>
Aug 22 03:01:19 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:01:19 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:01:19 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:01:19 user nova-compute[73469]:   </os>
Aug 22 03:01:19 user nova-compute[73469]:   <features>
Aug 22 03:01:19 user nova-compute[73469]:     <acpi/>
Aug 22 03:01:19 user nova-compute[73469]:     <apic/>
Aug 22 03:01:19 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:01:19 user nova-compute[73469]:   </features>
Aug 22 03:01:19 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:01:19 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:01:19 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:01:19 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:01:19 user nova-compute[73469]:   </clock>
Aug 22 03:01:19 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:01:19 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:01:19 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:01:19 user nova-compute[73469]:   </cpu>
Aug 22 03:01:19 user nova-compute[73469]:   <devices>
Aug 22 03:01:19 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:01:19 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:01:19 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk"/>
Aug 22 03:01:19 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:01:19 user nova-compute[73469]:     </disk>
Aug 22 03:01:19 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:01:19 user nova-compute[73469]:       <mac address="fa:16:3e:63:38:91"/>
Aug 22 03:01:19 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:01:19 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:01:19 user nova-compute[73469]:       <target dev="tapa64e4e29-61"/>
Aug 22 03:01:19 user nova-compute[73469]:     </interface>
Aug 22 03:01:19 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:01:19 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/console.log" append="off"/>
Aug 22 03:01:19 user nova-compute[73469]:     </serial>
Aug 22 03:01:19 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:01:19 user nova-compute[73469]:     <video>
Aug 22 03:01:19 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:01:19 user nova-compute[73469]:     </video>
Aug 22 03:01:19 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:01:19 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:01:19 user nova-compute[73469]:     </rng>
Aug 22 03:01:19 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:01:19 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:01:19 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:01:19 user nova-compute[73469]:     </memballoon>
Aug 22 03:01:19 user nova-compute[73469]:   </devices>
Aug 22 03:01:19 user nova-compute[73469]: </domain>
Aug 22 03:01:19 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1462217807',display_name='tempest-ServerRescueNegativeTestJSON-server-1462217807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1462217807',id=23,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXw+HABhLBLO82NaXM+wYITZ8kjjO4fDBfHrNaHircMbmq0ESPsalj62yNCub693ZB2AUl++bx/zlIxp/KOGwsJTgZa2DcddLoD4LicVmrTqVCS4jc8imCsGBLvay+cPA==',key_name='tempest-keypair-188206931',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46cd52eb0f2642bc95dbf216ae280e12',ramdisk_id='',reservation_id='r-3dwgg99t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2020570120',owner_user_name='tempest-ServerRescueNegativeTestJSON-2020570120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:01:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64b023ffba814ac5b6a3bc4666107767',uuid=f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "address": "fa:16:3e:63:38:91", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e4e29-61", "ovs_interfaceid": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converting VIF {"id": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "address": "fa:16:3e:63:38:91", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e4e29-61", "ovs_interfaceid": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:38:91,bridge_name='br-int',has_traffic_filtering=True,id=a64e4e29-61af-465a-8dc2-b8851274e0d9,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64e4e29-61') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG os_vif [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:38:91,bridge_name='br-int',has_traffic_filtering=True,id=a64e4e29-61af-465a-8dc2-b8851274e0d9,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64e4e29-61') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa64e4e29-61, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa64e4e29-61, col_values=(('external_ids', {'iface-id': 'a64e4e29-61af-465a-8dc2-b8851274e0d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:38:91', 'vm-uuid': 'f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:19 user nova-compute[73469]: INFO os_vif [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:38:91,bridge_name='br-int',has_traffic_filtering=True,id=a64e4e29-61af-465a-8dc2-b8851274e0d9,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64e4e29-61')
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:01:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] No VIF found with MAC fa:16:3e:63:38:91, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:01:20 user nova-compute[73469]: DEBUG nova.network.neutron [req-e461364a-1070-439a-ad50-e8fef2fd02fd req-f6f90305-c272-4a7b-8920-4cecbb8db9fd service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Updated VIF entry in instance network info cache for port a64e4e29-61af-465a-8dc2-b8851274e0d9. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:01:20 user nova-compute[73469]: DEBUG nova.network.neutron [req-e461364a-1070-439a-ad50-e8fef2fd02fd req-f6f90305-c272-4a7b-8920-4cecbb8db9fd service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Updating instance_info_cache with network_info: [{"id": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "address": "fa:16:3e:63:38:91", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e4e29-61", "ovs_interfaceid": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:01:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e461364a-1070-439a-ad50-e8fef2fd02fd req-f6f90305-c272-4a7b-8920-4cecbb8db9fd service nova] Releasing lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:01:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "0d5a30d1-565c-47c9-8caa-84dab130e117" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:01:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:21 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:01:21 user nova-compute[73469]: INFO nova.compute.claims [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Claim successful on node user
Aug 22 03:01:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-88697ad5-4bb3-4cc7-9b0a-615b7c9c5a1e req-2b1266f0-6482-4ba2-9665-8ecd8ebf3dee service nova] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Received event network-vif-plugged-0746c7bf-34e4-4be1-84ba-c0cf192111dd {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:01:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-88697ad5-4bb3-4cc7-9b0a-615b7c9c5a1e req-2b1266f0-6482-4ba2-9665-8ecd8ebf3dee service nova] Acquiring lock "980e57bf-dec9-46f3-8d69-e20a17603af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-88697ad5-4bb3-4cc7-9b0a-615b7c9c5a1e req-2b1266f0-6482-4ba2-9665-8ecd8ebf3dee service nova] Lock "980e57bf-dec9-46f3-8d69-e20a17603af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-88697ad5-4bb3-4cc7-9b0a-615b7c9c5a1e req-2b1266f0-6482-4ba2-9665-8ecd8ebf3dee service nova] Lock "980e57bf-dec9-46f3-8d69-e20a17603af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-88697ad5-4bb3-4cc7-9b0a-615b7c9c5a1e req-2b1266f0-6482-4ba2-9665-8ecd8ebf3dee service nova] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] No waiting events found dispatching network-vif-plugged-0746c7bf-34e4-4be1-84ba-c0cf192111dd {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:01:21 user nova-compute[73469]: WARNING nova.compute.manager [req-88697ad5-4bb3-4cc7-9b0a-615b7c9c5a1e req-2b1266f0-6482-4ba2-9665-8ecd8ebf3dee service nova] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Received unexpected event network-vif-plugged-0746c7bf-34e4-4be1-84ba-c0cf192111dd for instance with vm_state building and task_state spawning.
Aug 22 03:01:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:21 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:01:21 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:01:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:01:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:01:21 user nova-compute[73469]: DEBUG nova.network.neutron [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:01:21 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:01:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:01:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:01:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:01:22 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Creating image(s)
Aug 22 03:01:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "/opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "/opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "dc4152c281a7f32648acccda271cabd3ab60b30f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "dc4152c281a7f32648acccda271cabd3ab60b30f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:22 user nova-compute[73469]: DEBUG nova.policy [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f03cf449ec504132b4ea50a033bdf2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec928b9a04840b18974870663be0d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:01:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc4152c281a7f32648acccda271cabd3ab60b30f.part --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc4152c281a7f32648acccda271cabd3ab60b30f.part --force-share --output=json" returned: 0 in 0.195s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:22 user nova-compute[73469]: DEBUG nova.virt.images [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] 908238d7-6d39-4946-b525-79eca001fd9b was qcow2, converting to raw {{(pid=73469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 22 03:01:22 user nova-compute[73469]: DEBUG nova.privsep.utils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 22 03:01:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dc4152c281a7f32648acccda271cabd3ab60b30f.part /opt/stack/data/nova/instances/_base/dc4152c281a7f32648acccda271cabd3ab60b30f.converted {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG nova.objects.instance [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lazy-loading 'flavor' on Instance uuid 5984759d-28f1-45e8-bb4c-27bd8df426f4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dc4152c281a7f32648acccda271cabd3ab60b30f.part /opt/stack/data/nova/instances/_base/dc4152c281a7f32648acccda271cabd3ab60b30f.converted" returned: 0 in 0.315s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc4152c281a7f32648acccda271cabd3ab60b30f.converted --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG nova.network.neutron [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Successfully created port: 147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.187s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-6058cb99-feb7-44aa-99fc-55a06d593477 req-a817f4a3-a46b-4e1c-b0c5-12befae835a3 service nova] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Received event network-vif-plugged-0746c7bf-34e4-4be1-84ba-c0cf192111dd {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6058cb99-feb7-44aa-99fc-55a06d593477 req-a817f4a3-a46b-4e1c-b0c5-12befae835a3 service nova] Acquiring lock "980e57bf-dec9-46f3-8d69-e20a17603af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6058cb99-feb7-44aa-99fc-55a06d593477 req-a817f4a3-a46b-4e1c-b0c5-12befae835a3 service nova] Lock "980e57bf-dec9-46f3-8d69-e20a17603af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6058cb99-feb7-44aa-99fc-55a06d593477 req-a817f4a3-a46b-4e1c-b0c5-12befae835a3 service nova] Lock "980e57bf-dec9-46f3-8d69-e20a17603af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-6058cb99-feb7-44aa-99fc-55a06d593477 req-a817f4a3-a46b-4e1c-b0c5-12befae835a3 service nova] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] No waiting events found dispatching network-vif-plugged-0746c7bf-34e4-4be1-84ba-c0cf192111dd {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:01:23 user nova-compute[73469]: WARNING nova.compute.manager [req-6058cb99-feb7-44aa-99fc-55a06d593477 req-a817f4a3-a46b-4e1c-b0c5-12befae835a3 service nova] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Received unexpected event network-vif-plugged-0746c7bf-34e4-4be1-84ba-c0cf192111dd for instance with vm_state building and task_state spawning.
Aug 22 03:01:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-6058cb99-feb7-44aa-99fc-55a06d593477 req-a817f4a3-a46b-4e1c-b0c5-12befae835a3 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received event network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6058cb99-feb7-44aa-99fc-55a06d593477 req-a817f4a3-a46b-4e1c-b0c5-12befae835a3 service nova] Acquiring lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6058cb99-feb7-44aa-99fc-55a06d593477 req-a817f4a3-a46b-4e1c-b0c5-12befae835a3 service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6058cb99-feb7-44aa-99fc-55a06d593477 req-a817f4a3-a46b-4e1c-b0c5-12befae835a3 service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-6058cb99-feb7-44aa-99fc-55a06d593477 req-a817f4a3-a46b-4e1c-b0c5-12befae835a3 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] No waiting events found dispatching network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:01:23 user nova-compute[73469]: WARNING nova.compute.manager [req-6058cb99-feb7-44aa-99fc-55a06d593477 req-a817f4a3-a46b-4e1c-b0c5-12befae835a3 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received unexpected event network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 for instance with vm_state building and task_state spawning.
Aug 22 03:01:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-6058cb99-feb7-44aa-99fc-55a06d593477 req-a817f4a3-a46b-4e1c-b0c5-12befae835a3 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received event network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6058cb99-feb7-44aa-99fc-55a06d593477 req-a817f4a3-a46b-4e1c-b0c5-12befae835a3 service nova] Acquiring lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6058cb99-feb7-44aa-99fc-55a06d593477 req-a817f4a3-a46b-4e1c-b0c5-12befae835a3 service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6058cb99-feb7-44aa-99fc-55a06d593477 req-a817f4a3-a46b-4e1c-b0c5-12befae835a3 service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-6058cb99-feb7-44aa-99fc-55a06d593477 req-a817f4a3-a46b-4e1c-b0c5-12befae835a3 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] No waiting events found dispatching network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:01:23 user nova-compute[73469]: WARNING nova.compute.manager [req-6058cb99-feb7-44aa-99fc-55a06d593477 req-a817f4a3-a46b-4e1c-b0c5-12befae835a3 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received unexpected event network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 for instance with vm_state building and task_state spawning.
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc4152c281a7f32648acccda271cabd3ab60b30f.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "dc4152c281a7f32648acccda271cabd3ab60b30f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.302s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc4152c281a7f32648acccda271cabd3ab60b30f --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:23 user nova-compute[73469]: INFO nova.compute.manager [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Attaching volume ab9a6baf-31df-4c2e-a390-daa9a68e83fc to /dev/vdb
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc4152c281a7f32648acccda271cabd3ab60b30f --force-share --output=json" returned: 0 in 0.192s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "dc4152c281a7f32648acccda271cabd3ab60b30f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "dc4152c281a7f32648acccda271cabd3ab60b30f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc4152c281a7f32648acccda271cabd3ab60b30f --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG os_brick.utils [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[317734a3-47f5-447e-b9ad-1e47fa574fc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1fbddb-0f62-4108-a36e-a6797fee1d02]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[052f52e5-c229-42f9-844c-ab4e31a73f33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a140d528-8717-4a71-8c45-0cb0bdb2b0f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:01:23 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12df219-47c6-4c9d-aa45-c064d1306979]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG os_brick.utils [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Updating existing volume attachment record: ddc98a5e-9619-4482-a4aa-76e373ea7e84 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc4152c281a7f32648acccda271cabd3ab60b30f --force-share --output=json" returned: 0 in 0.231s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dc4152c281a7f32648acccda271cabd3ab60b30f,backing_fmt=raw /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dc4152c281a7f32648acccda271cabd3ab60b30f,backing_fmt=raw /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk 1073741824" returned: 0 in 0.054s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "dc4152c281a7f32648acccda271cabd3ab60b30f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc4152c281a7f32648acccda271cabd3ab60b30f --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc4152c281a7f32648acccda271cabd3ab60b30f --force-share --output=json" returned: 0 in 0.207s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.network.neutron [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Successfully updated port: 147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquired lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.network.neutron [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-9d375376-d209-484b-ad77-cd488cc532cd req-2f025c88-4425-424c-8384-9e6b778e019d service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Received event network-changed-147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-9d375376-d209-484b-ad77-cd488cc532cd req-2f025c88-4425-424c-8384-9e6b778e019d service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Refreshing instance network info cache due to event network-changed-147479ad-a9fc-4ccf-a900-95e347d1a79e. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9d375376-d209-484b-ad77-cd488cc532cd req-2f025c88-4425-424c-8384-9e6b778e019d service nova] Acquiring lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Cannot resize image /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.objects.instance [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lazy-loading 'migration_context' on Instance uuid 0d5a30d1-565c-47c9-8caa-84dab130e117 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.network.neutron [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Ensure instance console log exists: /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.network.neutron [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Updating instance_info_cache with network_info: [{"id": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "address": "fa:16:3e:1e:69:04", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap147479ad-a9", "ovs_interfaceid": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Releasing lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Instance network_info: |[{"id": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "address": "fa:16:3e:1e:69:04", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap147479ad-a9", "ovs_interfaceid": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9d375376-d209-484b-ad77-cd488cc532cd req-2f025c88-4425-424c-8384-9e6b778e019d service nova] Acquired lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.network.neutron [req-9d375376-d209-484b-ad77-cd488cc532cd req-2f025c88-4425-424c-8384-9e6b778e019d service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Refreshing network info cache for port 147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Start _get_guest_xml network_info=[{"id": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "address": "fa:16:3e:1e:69:04", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap147479ad-a9", "ovs_interfaceid": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T03:01:18Z,direct_url=<?>,disk_format='qcow2',id=908238d7-6d39-4946-b525-79eca001fd9b,min_disk=0,min_ram=0,name='tempest-scenario-img--1712244495',owner='1ec928b9a04840b18974870663be0d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T03:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '908238d7-6d39-4946-b525-79eca001fd9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673284.704277, 980e57bf-dec9-46f3-8d69-e20a17603af8 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:01:24 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] VM Resumed (Lifecycle Event)
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:01:24 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Instance spawned successfully.
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:01:24 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:01:24 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:01:24 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Instance spawned successfully.
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T03:01:18Z,direct_url=<?>,disk_format='qcow2',id=908238d7-6d39-4946-b525-79eca001fd9b,min_disk=0,min_ram=0,name='tempest-scenario-img--1712244495',owner='1ec928b9a04840b18974870663be0d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T03:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:01:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1024498594',display_name='tempest-TestMinimumBasicScenario-server-1024498594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1024498594',id=24,image_ref='908238d7-6d39-4946-b525-79eca001fd9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLeMAhkMiCTlVeNiSKGnMeiGZF7DtDCtveCGKGThb1ILWF+T8zrVS40XXpop4STHl0EaAhKP1lNnjfoN/gqw55hS2X3kwo7ONAtFJOj8siGZDOH71ltEqKnqYUy4TFFcg==',key_name='tempest-TestMinimumBasicScenario-1567802170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ec928b9a04840b18974870663be0d44',ramdisk_id='',reservation_id='r-671bs364',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='908238d7-6d39-4946-b525-79eca001fd9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-619227623',owner_user_name='tempest-TestMinimumBasicScenario-619227623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:01:22Z,user_data=None,user_id='f03cf449ec504132b4ea50a033bdf2c0',uuid=0d5a30d1-565c-47c9-8caa-84dab130e117,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "address": "fa:16:3e:1e:69:04", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap147479ad-a9", "ovs_interfaceid": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Converting VIF {"id": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "address": "fa:16:3e:1e:69:04", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap147479ad-a9", "ovs_interfaceid": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:69:04,bridge_name='br-int',has_traffic_filtering=True,id=147479ad-a9fc-4ccf-a900-95e347d1a79e,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap147479ad-a9') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.objects.instance [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d5a30d1-565c-47c9-8caa-84dab130e117 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:01:24 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673284.7053344, 980e57bf-dec9-46f3-8d69-e20a17603af8 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:01:24 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] VM Started (Lifecycle Event)
Aug 22 03:01:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:01:24 user nova-compute[73469]:   <uuid>0d5a30d1-565c-47c9-8caa-84dab130e117</uuid>
Aug 22 03:01:24 user nova-compute[73469]:   <name>instance-00000018</name>
Aug 22 03:01:24 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:01:24 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:01:24 user nova-compute[73469]:   <metadata>
Aug 22 03:01:24 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:01:24 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:01:24 user nova-compute[73469]:       <nova:name>tempest-TestMinimumBasicScenario-server-1024498594</nova:name>
Aug 22 03:01:24 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:01:24</nova:creationTime>
Aug 22 03:01:24 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:01:24 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:01:24 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:01:24 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:01:24 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:01:24 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:01:24 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:01:24 user nova-compute[73469]:       <nova:owner>
Aug 22 03:01:24 user nova-compute[73469]:         <nova:user uuid="f03cf449ec504132b4ea50a033bdf2c0">tempest-TestMinimumBasicScenario-619227623-project-member</nova:user>
Aug 22 03:01:24 user nova-compute[73469]:         <nova:project uuid="1ec928b9a04840b18974870663be0d44">tempest-TestMinimumBasicScenario-619227623</nova:project>
Aug 22 03:01:24 user nova-compute[73469]:       </nova:owner>
Aug 22 03:01:24 user nova-compute[73469]:       <nova:root type="image" uuid="908238d7-6d39-4946-b525-79eca001fd9b"/>
Aug 22 03:01:24 user nova-compute[73469]:       <nova:ports>
Aug 22 03:01:24 user nova-compute[73469]:         <nova:port uuid="147479ad-a9fc-4ccf-a900-95e347d1a79e">
Aug 22 03:01:24 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 22 03:01:24 user nova-compute[73469]:         </nova:port>
Aug 22 03:01:24 user nova-compute[73469]:       </nova:ports>
Aug 22 03:01:24 user nova-compute[73469]:     </nova:instance>
Aug 22 03:01:24 user nova-compute[73469]:   </metadata>
Aug 22 03:01:24 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:01:24 user nova-compute[73469]:     <system>
Aug 22 03:01:24 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:01:24 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:01:24 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:01:24 user nova-compute[73469]:       <entry name="serial">0d5a30d1-565c-47c9-8caa-84dab130e117</entry>
Aug 22 03:01:24 user nova-compute[73469]:       <entry name="uuid">0d5a30d1-565c-47c9-8caa-84dab130e117</entry>
Aug 22 03:01:24 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:01:24 user nova-compute[73469]:     </system>
Aug 22 03:01:24 user nova-compute[73469]:   </sysinfo>
Aug 22 03:01:24 user nova-compute[73469]:   <os>
Aug 22 03:01:24 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:01:24 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:01:24 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:01:24 user nova-compute[73469]:   </os>
Aug 22 03:01:24 user nova-compute[73469]:   <features>
Aug 22 03:01:24 user nova-compute[73469]:     <acpi/>
Aug 22 03:01:24 user nova-compute[73469]:     <apic/>
Aug 22 03:01:24 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:01:24 user nova-compute[73469]:   </features>
Aug 22 03:01:24 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:01:24 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:01:24 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:01:24 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:01:24 user nova-compute[73469]:   </clock>
Aug 22 03:01:24 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:01:24 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:01:24 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:01:24 user nova-compute[73469]:   </cpu>
Aug 22 03:01:24 user nova-compute[73469]:   <devices>
Aug 22 03:01:24 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:01:24 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:01:24 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk"/>
Aug 22 03:01:24 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:01:24 user nova-compute[73469]:     </disk>
Aug 22 03:01:24 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:01:24 user nova-compute[73469]:       <mac address="fa:16:3e:1e:69:04"/>
Aug 22 03:01:24 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:01:24 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:01:24 user nova-compute[73469]:       <target dev="tap147479ad-a9"/>
Aug 22 03:01:24 user nova-compute[73469]:     </interface>
Aug 22 03:01:24 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:01:24 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/console.log" append="off"/>
Aug 22 03:01:24 user nova-compute[73469]:     </serial>
Aug 22 03:01:24 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:01:24 user nova-compute[73469]:     <video>
Aug 22 03:01:24 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:01:24 user nova-compute[73469]:     </video>
Aug 22 03:01:24 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:01:24 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:01:24 user nova-compute[73469]:     </rng>
Aug 22 03:01:24 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:01:24 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:01:24 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:01:24 user nova-compute[73469]:     </memballoon>
Aug 22 03:01:24 user nova-compute[73469]:   </devices>
Aug 22 03:01:24 user nova-compute[73469]: </domain>
Aug 22 03:01:24 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:01:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1024498594',display_name='tempest-TestMinimumBasicScenario-server-1024498594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1024498594',id=24,image_ref='908238d7-6d39-4946-b525-79eca001fd9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLeMAhkMiCTlVeNiSKGnMeiGZF7DtDCtveCGKGThb1ILWF+T8zrVS40XXpop4STHl0EaAhKP1lNnjfoN/gqw55hS2X3kwo7ONAtFJOj8siGZDOH71ltEqKnqYUy4TFFcg==',key_name='tempest-TestMinimumBasicScenario-1567802170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ec928b9a04840b18974870663be0d44',ramdisk_id='',reservation_id='r-671bs364',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='908238d7-6d39-4946-b525-79eca001fd9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-619227623',owner_user_name='tempest-TestMinimumBasicScenario-619227623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:01:22Z,user_data=None,user_id='f03cf449ec504132b4ea50a033bdf2c0',uuid=0d5a30d1-565c-47c9-8caa-84dab130e117,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "address": "fa:16:3e:1e:69:04", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap147479ad-a9", "ovs_interfaceid": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Converting VIF {"id": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "address": "fa:16:3e:1e:69:04", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap147479ad-a9", "ovs_interfaceid": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:69:04,bridge_name='br-int',has_traffic_filtering=True,id=147479ad-a9fc-4ccf-a900-95e347d1a79e,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap147479ad-a9') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG os_vif [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:69:04,bridge_name='br-int',has_traffic_filtering=True,id=147479ad-a9fc-4ccf-a900-95e347d1a79e,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap147479ad-a9') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap147479ad-a9, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap147479ad-a9, col_values=(('external_ids', {'iface-id': '147479ad-a9fc-4ccf-a900-95e347d1a79e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:69:04', 'vm-uuid': '0d5a30d1-565c-47c9-8caa-84dab130e117'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:24 user nova-compute[73469]: INFO os_vif [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:69:04,bridge_name='br-int',has_traffic_filtering=True,id=147479ad-a9fc-4ccf-a900-95e347d1a79e,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap147479ad-a9')
Aug 22 03:01:24 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673284.7177737, f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:01:24 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] VM Resumed (Lifecycle Event)
Aug 22 03:01:24 user nova-compute[73469]: INFO nova.compute.manager [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Took 11.05 seconds to spawn the instance on the hypervisor.
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:01:24 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673284.7203178, f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:01:24 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] VM Started (Lifecycle Event)
Aug 22 03:01:24 user nova-compute[73469]: INFO nova.compute.manager [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Took 7.75 seconds to spawn the instance on the hypervisor.
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] No VIF found with MAC fa:16:3e:1e:69:04, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:01:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:01:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:01:25 user nova-compute[73469]: INFO nova.compute.manager [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Took 11.92 seconds to build instance.
Aug 22 03:01:25 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:01:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-99da8590-b537-41d4-9086-d11a400ef054 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "980e57bf-dec9-46f3-8d69-e20a17603af8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.016s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:25 user nova-compute[73469]: INFO nova.compute.manager [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Took 9.06 seconds to build instance.
Aug 22 03:01:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7945751f-457f-43dd-a13f-c443f9c83a84 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.172s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:25 user nova-compute[73469]: DEBUG nova.network.neutron [req-9d375376-d209-484b-ad77-cd488cc532cd req-2f025c88-4425-424c-8384-9e6b778e019d service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Updated VIF entry in instance network info cache for port 147479ad-a9fc-4ccf-a900-95e347d1a79e. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:01:25 user nova-compute[73469]: DEBUG nova.network.neutron [req-9d375376-d209-484b-ad77-cd488cc532cd req-2f025c88-4425-424c-8384-9e6b778e019d service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Updating instance_info_cache with network_info: [{"id": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "address": "fa:16:3e:1e:69:04", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap147479ad-a9", "ovs_interfaceid": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:01:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9d375376-d209-484b-ad77-cd488cc532cd req-2f025c88-4425-424c-8384-9e6b778e019d service nova] Releasing lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:01:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-40f0ec01-6488-4fa9-9797-5019adaad043 req-f0fec555-9b86-4401-8c19-5936fcc98dda service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Received event network-vif-plugged-147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:01:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-40f0ec01-6488-4fa9-9797-5019adaad043 req-f0fec555-9b86-4401-8c19-5936fcc98dda service nova] Acquiring lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-40f0ec01-6488-4fa9-9797-5019adaad043 req-f0fec555-9b86-4401-8c19-5936fcc98dda service nova] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-40f0ec01-6488-4fa9-9797-5019adaad043 req-f0fec555-9b86-4401-8c19-5936fcc98dda service nova] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-40f0ec01-6488-4fa9-9797-5019adaad043 req-f0fec555-9b86-4401-8c19-5936fcc98dda service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] No waiting events found dispatching network-vif-plugged-147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:01:26 user nova-compute[73469]: WARNING nova.compute.manager [req-40f0ec01-6488-4fa9-9797-5019adaad043 req-f0fec555-9b86-4401-8c19-5936fcc98dda service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Received unexpected event network-vif-plugged-147479ad-a9fc-4ccf-a900-95e347d1a79e for instance with vm_state building and task_state spawning.
Aug 22 03:01:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-e31ee395-b3a9-41cc-9df9-5b560c4f9718 req-4ef36902-7087-4734-968e-36cc3dfcaf31 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Received event network-vif-plugged-147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:01:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e31ee395-b3a9-41cc-9df9-5b560c4f9718 req-4ef36902-7087-4734-968e-36cc3dfcaf31 service nova] Acquiring lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e31ee395-b3a9-41cc-9df9-5b560c4f9718 req-4ef36902-7087-4734-968e-36cc3dfcaf31 service nova] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e31ee395-b3a9-41cc-9df9-5b560c4f9718 req-4ef36902-7087-4734-968e-36cc3dfcaf31 service nova] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-e31ee395-b3a9-41cc-9df9-5b560c4f9718 req-4ef36902-7087-4734-968e-36cc3dfcaf31 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] No waiting events found dispatching network-vif-plugged-147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:01:28 user nova-compute[73469]: WARNING nova.compute.manager [req-e31ee395-b3a9-41cc-9df9-5b560c4f9718 req-4ef36902-7087-4734-968e-36cc3dfcaf31 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Received unexpected event network-vif-plugged-147479ad-a9fc-4ccf-a900-95e347d1a79e for instance with vm_state building and task_state spawning.
Aug 22 03:01:29 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673289.138447, 0d5a30d1-565c-47c9-8caa-84dab130e117 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:01:29 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] VM Resumed (Lifecycle Event)
Aug 22 03:01:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:01:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:01:29 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Instance spawned successfully.
Aug 22 03:01:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:01:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:01:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:01:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:01:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:01:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:01:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:01:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:01:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:01:29 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:01:29 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673289.1600695, 0d5a30d1-565c-47c9-8caa-84dab130e117 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:01:29 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] VM Started (Lifecycle Event)
Aug 22 03:01:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:01:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:01:29 user nova-compute[73469]: INFO nova.compute.manager [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Took 7.17 seconds to spawn the instance on the hypervisor.
Aug 22 03:01:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:01:29 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:01:29 user nova-compute[73469]: INFO nova.compute.manager [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Took 8.22 seconds to build instance.
Aug 22 03:01:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-927b3338-11d0-44aa-a33d-9d145c5da32a tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.385s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:37 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:01:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:38 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:01:38 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:01:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:41 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:01:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:01:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-8242cec1-3b35-4d14-9e0b-db8a7e75697d" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:01:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-8242cec1-3b35-4d14-9e0b-db8a7e75697d" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:01:41 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Updating instance_info_cache with network_info: [{"id": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "address": "fa:16:3e:4f:6e:44", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec640a77-a1", "ovs_interfaceid": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-8242cec1-3b35-4d14-9e0b-db8a7e75697d" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvGlDOhP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:01:42 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:01:42 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:01:42 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c14d7c5-845b-477a-a854-bf5d7cea83ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:01:42 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[011540fc-b975-4f72-b9e8-3c6681f725a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc] added
Aug 22 03:01:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[02810cc0-279b-49fc-8aa6-28fa79a681b1]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac5f08a-1e35-4a8c-bff9-0b96a730aacc]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvGlDOhP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvGlDOhP" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[30777904-c95e-4d72-9fff-889c045813ee]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tvGlDOhP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bba98e8-9938-43b2-bc2a-7aeb7a6a7947]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[db491425-bd14-46b4-bcbd-f99a2650b518]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:01:42 user nova-compute[73469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:01:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:01:42 user nova-compute[73469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:01:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[016bf1dc-c8d9-46cb-abaa-65af892cb51a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260]
Aug 22 03:01:42 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260] successful.
Aug 22 03:01:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0127a9f5-1e23-4282-949c-b3736a69d95a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[303a5592-adec-4ab0-af02-a9f89591a6c9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:01:42 user nova-compute[73469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:01:42 user nova-compute[73469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:01:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:01:42 user nova-compute[73469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:01:42 user nova-compute[73469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:01:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87d5a86-7310-4050-ab0d-2ff3a8a76ad9]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvGlDOhP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:43 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:01:43 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '26266363361643366', 'path': '/dev/sdd'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:01:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266363361643366', 'path': '/dev/sdd'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:01:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:43 user nova-compute[73469]: DEBUG nova.objects.instance [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lazy-loading 'flavor' on Instance uuid 5984759d-28f1-45e8-bb4c-27bd8df426f4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:01:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:01:43 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:01:43 user nova-compute[73469]:   <source dev="/dev/sdd"/>
Aug 22 03:01:43 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:01:43 user nova-compute[73469]:   <serial>ab9a6baf-31df-4c2e-a390-daa9a68e83fc</serial>
Aug 22 03:01:43 user nova-compute[73469]: </disk>
Aug 22 03:01:43 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:01:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:01:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:01:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] No VIF found with MAC fa:16:3e:f8:e1:3e, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:01:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-555d5665-a28b-4b71-8a66-96382a7e7ca2 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.084s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:01:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:01:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:47 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:01:47 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:01:47 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=7163MB free_disk=25.21338653564453GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:01:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Stashing vm_state: active {{(pid=73469) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 22 03:01:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:48 user nova-compute[73469]: INFO nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Updating resource usage from migration ab7a6a11-e343-4905-bf2e-fd016f6a6cf7
Aug 22 03:01:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d0668c0-7a49-4857-9b69-541021f18ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance dc3f5545-8ebb-4947-97d0-98a91f67e421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8242cec1-3b35-4d14-9e0b-db8a7e75697d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 2e621408-a0af-460b-80a2-3446b5f1aadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82e872a7-70b0-4290-9a11-5316765aed01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 20316a2a-2f1f-4008-ab14-551e627bf680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 980e57bf-dec9-46f3-8d69-e20a17603af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 0d5a30d1-565c-47c9-8caa-84dab130e117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Migration ab7a6a11-e343-4905-bf2e-fd016f6a6cf7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 5984759d-28f1-45e8-bb4c-27bd8df426f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.547s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.398s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.objects.instance [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lazy-loading 'pci_requests' on Instance uuid 5984759d-28f1-45e8-bb4c-27bd8df426f4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:01:48 user nova-compute[73469]: INFO nova.compute.claims [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Claim successful on node user
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.objects.instance [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lazy-loading 'resources' on Instance uuid 5984759d-28f1-45e8-bb4c-27bd8df426f4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.objects.instance [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lazy-loading 'pci_devices' on Instance uuid 5984759d-28f1-45e8-bb4c-27bd8df426f4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:01:48 user nova-compute[73469]: INFO nova.compute.resource_tracker [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Updating resource usage from migration ab7a6a11-e343-4905-bf2e-fd016f6a6cf7
Aug 22 03:01:48 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.514s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:48 user nova-compute[73469]: INFO nova.compute.manager [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Migrating
Aug 22 03:01:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:01:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:01:48 user nova-compute[73469]: INFO nova.compute.rpcapi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 22 03:01:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:01:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:01:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquired lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:01:49 user nova-compute[73469]: DEBUG nova.network.neutron [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:01:49 user nova-compute[73469]: DEBUG nova.network.neutron [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Updating instance_info_cache with network_info: [{"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:01:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Releasing lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:01:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Starting migrate_disk_and_power_off {{(pid=73469) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 22 03:01:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-a1e8724b-526f-45a0-8761-af2a328a711c req-1f0ca2f3-da50-489a-b9fa-b3d187aa0186 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-vif-unplugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:01:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a1e8724b-526f-45a0-8761-af2a328a711c req-1f0ca2f3-da50-489a-b9fa-b3d187aa0186 service nova] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a1e8724b-526f-45a0-8761-af2a328a711c req-1f0ca2f3-da50-489a-b9fa-b3d187aa0186 service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a1e8724b-526f-45a0-8761-af2a328a711c req-1f0ca2f3-da50-489a-b9fa-b3d187aa0186 service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-a1e8724b-526f-45a0-8761-af2a328a711c req-1f0ca2f3-da50-489a-b9fa-b3d187aa0186 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] No waiting events found dispatching network-vif-unplugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:01:49 user nova-compute[73469]: WARNING nova.compute.manager [req-a1e8724b-526f-45a0-8761-af2a328a711c req-1f0ca2f3-da50-489a-b9fa-b3d187aa0186 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received unexpected event network-vif-unplugged-f38d1396-0fe4-4107-8815-7420deceedab for instance with vm_state active and task_state resize_migrating.
Aug 22 03:01:50 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Instance destroyed successfully.
Aug 22 03:01:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1537383573',display_name='tempest-ServerActionsTestOtherB-server-1537383573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1537383573',id=18,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbR7/rnM2AeZHN+BHEO9wy6tT5C/8gqpz2OLyZ0PrOkSO9sSAq61LBq8B59x8O0SJWkSJu3MS+tJxcGT/zQuOBrkxHQmB8JC+FatiKrmiFApJOgsuSU1qC5st2CAxnTvw==',key_name='tempest-keypair-568897893',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:57:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d9d41329e1ad49bc94369a54d2798ac6',ramdisk_id='',reservation_id='r-6rax0pzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1653559752',owner_user_name='tempest-ServerActionsTestOtherB-1653559752-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d3f2f35df22412cac98e90f1bb80b08',uuid=5984759d-28f1-45e8-bb4c-27bd8df426f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-579513350-network", "vif_mac": "fa:16:3e:f8:e1:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Converting VIF {"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-579513350-network", "vif_mac": "fa:16:3e:f8:e1:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG os_vif [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf38d1396-0f, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:50 user nova-compute[73469]: INFO os_vif [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f')
Aug 22 03:01:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvGlDOhP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:01:50 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:01:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebc5d5b-3aa6-4294-810c-4819febe83f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0a55fa-26c0-4422-b718-150566c08ea7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:01:50 user nova-compute[73469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:01:50 user nova-compute[73469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:01:50 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:01:50 user nova-compute[73469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:01:50 user nova-compute[73469]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:01:50 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a413d240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc'): ({'sdd'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Removing single pathed devices sdd {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f53a670-683d-45e7-ae78-6235b7f6b365]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e50eddf-2a69-43d8-bea1-dfc185a88efb]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Flushing IO for device /dev/sdd {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9655ce8e-6fe2-4514-a21d-f3d9751cb7e1]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b294c7c-51b6-4188-b209-253566ecc659]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf4f2d2-c5c2-4529-9849-5ef8f3b2028b]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[677f3a90-fcca-4d5a-a7e6-4d34fd850092]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260]
Aug 22 03:01:50 user nova-compute[73469]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260] successful.
Aug 22 03:01:50 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d8b16b-844e-4934-a71f-6c4124f33384]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] <== disconnect_volume: return (307ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:01:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4_resize/disk /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CMD "cp -r /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4_resize/disk /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk" returned: 0 in 0.474s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4_resize/disk.info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk.info {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:01:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CMD "cp -r /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4_resize/disk.info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk.info" returned: 0 in 0.042s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:01:52 user nova-compute[73469]: DEBUG nova.compute.manager [req-ad2a0d72-61bb-4dff-a7b5-d90bcae0f387 req-17533438-7021-4c76-ad20-5d5d9afc2652 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:01:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ad2a0d72-61bb-4dff-a7b5-d90bcae0f387 req-17533438-7021-4c76-ad20-5d5d9afc2652 service nova] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:01:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ad2a0d72-61bb-4dff-a7b5-d90bcae0f387 req-17533438-7021-4c76-ad20-5d5d9afc2652 service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:01:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ad2a0d72-61bb-4dff-a7b5-d90bcae0f387 req-17533438-7021-4c76-ad20-5d5d9afc2652 service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:01:52 user nova-compute[73469]: DEBUG nova.compute.manager [req-ad2a0d72-61bb-4dff-a7b5-d90bcae0f387 req-17533438-7021-4c76-ad20-5d5d9afc2652 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] No waiting events found dispatching network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:01:52 user nova-compute[73469]: WARNING nova.compute.manager [req-ad2a0d72-61bb-4dff-a7b5-d90bcae0f387 req-17533438-7021-4c76-ad20-5d5d9afc2652 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received unexpected event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab for instance with vm_state active and task_state resize_migrating.
Aug 22 03:01:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:01:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG nova.network.neutron [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Port f38d1396-0fe4-4107-8815-7420deceedab binding to destination host user is already ACTIVE {{(pid=73469) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquired lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG nova.network.neutron [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG nova.network.neutron [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Updating instance_info_cache with network_info: [{"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Releasing lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG os_brick.utils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ae6a17-736b-4ecd-a31d-1d28d3b0d6b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43dc1fa-a92d-469a-b7e6-d8592f1803a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[292fb68b-cf76-4d58-bafa-6bc5fee2e40e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d885fa5c-e2c1-4015-8f5d-fb2cd429fe15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:02:04 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:02:04 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb5d564-6a23-4d6c-8dd5-d3f42aa92387]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:02:04 user nova-compute[73469]: DEBUG os_brick.utils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:02:05 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673310.44176, 5984759d-28f1-45e8-bb4c-27bd8df426f4 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:02:05 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] VM Stopped (Lifecycle Event)
Aug 22 03:02:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:05 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9c8ef462-7695-41d5-aeb8-95189f1e4002 None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:02:05 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9c8ef462-7695-41d5-aeb8-95189f1e4002 None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:02:05 user nova-compute[73469]: INFO nova.compute.manager [None req-9c8ef462-7695-41d5-aeb8-95189f1e4002 None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 22 03:02:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-12075e99-42e5-4baf-817e-c2ddb6f2e4e8 req-2a094d33-d686-4111-9db7-533f3d7fe2ea service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received event network-changed-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:02:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-12075e99-42e5-4baf-817e-c2ddb6f2e4e8 req-2a094d33-d686-4111-9db7-533f3d7fe2ea service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Refreshing instance network info cache due to event network-changed-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:02:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-12075e99-42e5-4baf-817e-c2ddb6f2e4e8 req-2a094d33-d686-4111-9db7-533f3d7fe2ea service nova] Acquiring lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:02:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-12075e99-42e5-4baf-817e-c2ddb6f2e4e8 req-2a094d33-d686-4111-9db7-533f3d7fe2ea service nova] Acquired lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:02:16 user nova-compute[73469]: DEBUG nova.network.neutron [req-12075e99-42e5-4baf-817e-c2ddb6f2e4e8 req-2a094d33-d686-4111-9db7-533f3d7fe2ea service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Refreshing network info cache for port 8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:02:17 user nova-compute[73469]: DEBUG nova.network.neutron [req-12075e99-42e5-4baf-817e-c2ddb6f2e4e8 req-2a094d33-d686-4111-9db7-533f3d7fe2ea service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Updated VIF entry in instance network info cache for port 8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:02:17 user nova-compute[73469]: DEBUG nova.network.neutron [req-12075e99-42e5-4baf-817e-c2ddb6f2e4e8 req-2a094d33-d686-4111-9db7-533f3d7fe2ea service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Updating instance_info_cache with network_info: [{"id": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "address": "fa:16:3e:cf:fb:77", "network": {"id": "48051bc9-cc7d-4248-8077-3bd59a1cb474", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab77793ce9a4b85b90e3b7469daf58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3d6f3d-12", "ovs_interfaceid": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:02:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-12075e99-42e5-4baf-817e-c2ddb6f2e4e8 req-2a094d33-d686-4111-9db7-533f3d7fe2ea service nova] Releasing lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:02:17 user nova-compute[73469]: DEBUG nova.compute.manager [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:02:17 user nova-compute[73469]: INFO nova.compute.manager [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] instance snapshotting
Aug 22 03:02:17 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Beginning live snapshot process
Aug 22 03:02:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json -f qcow2 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json -f qcow2" returned: 0 in 0.230s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json -f qcow2 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.192s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpm6b9w6p3/9a562e286b904975b1ca37388ed64116.delta 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:18 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpm6b9w6p3/9a562e286b904975b1ca37388ed64116.delta 1073741824" returned: 0 in 0.165s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:18 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 22 03:02:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 03:02:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 03:02:19 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 22 03:02:19 user nova-compute[73469]: DEBUG nova.privsep.utils [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 22 03:02:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpm6b9w6p3/9a562e286b904975b1ca37388ed64116.delta /opt/stack/data/nova/instances/snapshots/tmpm6b9w6p3/9a562e286b904975b1ca37388ed64116 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpm6b9w6p3/9a562e286b904975b1ca37388ed64116.delta /opt/stack/data/nova/instances/snapshots/tmpm6b9w6p3/9a562e286b904975b1ca37388ed64116" returned: 0 in 0.300s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:20 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Snapshot extracted, beginning image upload
Aug 22 03:02:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "4765dbfc-4219-4797-b40f-24698fa033bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:02:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:21 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:02:21 user nova-compute[73469]: INFO nova.compute.claims [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Claim successful on node user
Aug 22 03:02:21 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:02:21 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:02:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:02:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:02:21 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:02:21 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:02:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:02:22 user nova-compute[73469]: INFO nova.virt.block_device [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Booting with volume 9aad3172-3eb9-46ea-bab5-b3eed2744c22 at /dev/vda
Aug 22 03:02:22 user nova-compute[73469]: DEBUG nova.policy [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a8977f5d3814762aae632398cc36913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ba7249950f4f20a16ccdee64ee9b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG os_brick.utils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84311ff-7135-4737-b8bf-38a856d4aa0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[778579b2-0fc0-4a79-908d-423207d624eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40b2478-c39f-4e27-98cb-a5a4f36689ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96f37cc-6570-45c3-92a8-96defcf8a72d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:02:22 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc2c52b-c2b2-4720-ae17-b0d4e2326145]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG os_brick.utils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updating existing volume attachment record: d4bec1a5-a482-4e9c-9fe7-d80e0778d678 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "d8433c45-b889-4a7b-88c2-ba00679b1d26" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:22 user nova-compute[73469]: INFO nova.compute.manager [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Unshelving
Aug 22 03:02:22 user nova-compute[73469]: INFO nova.virt.block_device [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Booting with volume 04ccfa44-b35b-49f2-9c95-5ae2d56e4932 at /dev/vdc
Aug 22 03:02:22 user nova-compute[73469]: DEBUG os_brick.utils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb0ad03-b5fa-4bcc-bbb4-f886f251a987]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4b9962-ee5d-44e9-a61f-43284f7548e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Successfully created port: d5ac4586-bd1a-488b-8c9e-ee23a27e57eb {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37abed8-6f77-42bc-8a8b-8c96355178f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[257af574-a406-4815-9d34-8f513601cb4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:02:22 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:02:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3f0084-880f-4243-af21-ae9ebe3e5eb7]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG os_brick.utils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:02:22 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Updating existing volume attachment record: 05bc94f7-2c76-4cbd-91ca-3462adee6840 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:02:22 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Snapshot image upload complete
Aug 22 03:02:22 user nova-compute[73469]: INFO nova.compute.manager [None req-51a52d58-a63d-4620-9234-d85a71e22307 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Took 5.49 seconds to snapshot the instance on the hypervisor.
Aug 22 03:02:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:23 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Successfully created port: eac8e395-8b46-4d73-a0b8-495ee2530d6c {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:02:23 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Successfully created port: 42e5267b-949c-44dd-9b96-975b4534aaa3 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:02:24 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Successfully created port: bc85b38c-492a-46f6-8d44-67882abf29fb {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:02:25 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Successfully created port: f948c8ed-80d5-411d-95bb-d12e136727e6 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:02:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:26 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Successfully updated port: d5ac4586-bd1a-488b-8c9e-ee23a27e57eb {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:02:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-0d1bee86-0c89-48ee-8745-9c5fc8678f29 req-1f4a6e25-888a-4b4c-9415-7020f71680c0 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-changed-d5ac4586-bd1a-488b-8c9e-ee23a27e57eb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:02:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-0d1bee86-0c89-48ee-8745-9c5fc8678f29 req-1f4a6e25-888a-4b4c-9415-7020f71680c0 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Refreshing instance network info cache due to event network-changed-d5ac4586-bd1a-488b-8c9e-ee23a27e57eb. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:02:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0d1bee86-0c89-48ee-8745-9c5fc8678f29 req-1f4a6e25-888a-4b4c-9415-7020f71680c0 service nova] Acquiring lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:02:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0d1bee86-0c89-48ee-8745-9c5fc8678f29 req-1f4a6e25-888a-4b4c-9415-7020f71680c0 service nova] Acquired lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:02:26 user nova-compute[73469]: DEBUG nova.network.neutron [req-0d1bee86-0c89-48ee-8745-9c5fc8678f29 req-1f4a6e25-888a-4b4c-9415-7020f71680c0 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Refreshing network info cache for port d5ac4586-bd1a-488b-8c9e-ee23a27e57eb {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:02:26 user nova-compute[73469]: DEBUG nova.network.neutron [req-0d1bee86-0c89-48ee-8745-9c5fc8678f29 req-1f4a6e25-888a-4b4c-9415-7020f71680c0 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:02:26 user nova-compute[73469]: DEBUG nova.network.neutron [req-0d1bee86-0c89-48ee-8745-9c5fc8678f29 req-1f4a6e25-888a-4b4c-9415-7020f71680c0 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:02:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0d1bee86-0c89-48ee-8745-9c5fc8678f29 req-1f4a6e25-888a-4b4c-9415-7020f71680c0 service nova] Releasing lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:02:26 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Successfully updated port: 3d0a8d68-796c-4c40-a6df-17d44e3ba385 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:02:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Starting finish_migration {{(pid=73469) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 22 03:02:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Instance directory exists: not creating {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 22 03:02:27 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Creating image(s)
Aug 22 03:02:27 user nova-compute[73469]: DEBUG nova.objects.instance [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5984759d-28f1-45e8-bb4c-27bd8df426f4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:02:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.183s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:27 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk. size=21474836480 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:02:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk 21474836480 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Successfully updated port: 029910e1-c407-4728-a2a3-4daf09db5632 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk 21474836480" returned: 0 in 0.058s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Did not create local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Ensure instance console log exists: /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Start _get_guest_xml network_info=[{"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-579513350-network", "vif_mac": "fa:16:3e:f8:e1:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': '11d5fd2d-132d-4dbf-9f39-94f888a9ff49', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvGlDOhP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5984759d-28f1-45e8-bb4c-27bd8df426f4', 'attached_at': '2023-08-22T03:02:27.000000', 'detached_at': '', 'volume_id': 'ab9a6baf-31df-4c2e-a390-daa9a68e83fc', 'serial': 'ab9a6baf-31df-4c2e-a390-daa9a68e83fc'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:02:28 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:02:28 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.objects.instance [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5984759d-28f1-45e8-bb4c-27bd8df426f4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvGlDOhP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:02:28 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:02:28 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:02:28 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ec94ec-bc4f-4c59-8b84-b1f3cbafb3a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:02:28 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[76315f89-7442-4670-99a8-eb93f9c84f55]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc] added
Aug 22 03:02:28 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[155d7498-449f-4d39-bebe-5460d14ded82]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f573d822-d2bf-4cba-8731-79a68464d9a8]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvGlDOhP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvGlDOhP" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f149124-9be5-4b47-94e7-db984e23d1d7]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tvGlDOhP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5dc01e-ba95-4c24-ad31-97244bca2686]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-96a1d566-da7f-4924-9d5e-681126a49eb5 req-08fafac0-f192-41ce-a4c2-5ca16e55b186 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-changed-3d0a8d68-796c-4c40-a6df-17d44e3ba385 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-96a1d566-da7f-4924-9d5e-681126a49eb5 req-08fafac0-f192-41ce-a4c2-5ca16e55b186 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Refreshing instance network info cache due to event network-changed-3d0a8d68-796c-4c40-a6df-17d44e3ba385. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-96a1d566-da7f-4924-9d5e-681126a49eb5 req-08fafac0-f192-41ce-a4c2-5ca16e55b186 service nova] Acquiring lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-96a1d566-da7f-4924-9d5e-681126a49eb5 req-08fafac0-f192-41ce-a4c2-5ca16e55b186 service nova] Acquired lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.network.neutron [req-96a1d566-da7f-4924-9d5e-681126a49eb5 req-08fafac0-f192-41ce-a4c2-5ca16e55b186 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Refreshing network info cache for port 3d0a8d68-796c-4c40-a6df-17d44e3ba385 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4711d1f1-0f63-4e24-9d91-49e4005c41cc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:02:28 user nova-compute[73469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:02:28 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:02:28 user nova-compute[73469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:02:28 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb21556-c1f8-4c1d-9556-b1e93d7c4c33]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260]
Aug 22 03:02:28 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260] successful.
Aug 22 03:02:28 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d17d2f-dd45-46d6-8ce3-fbc179dd297b]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.network.neutron [req-96a1d566-da7f-4924-9d5e-681126a49eb5 req-08fafac0-f192-41ce-a4c2-5ca16e55b186 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e7edda-df89-41c8-adc2-c0e0cd818784]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:02:28 user nova-compute[73469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:02:28 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:02:28 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:02:28 user nova-compute[73469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:02:28 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:02:28 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb08297-1a50-4ee2-81ce-c8a0119524fa]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvGlDOhP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.network.neutron [req-96a1d566-da7f-4924-9d5e-681126a49eb5 req-08fafac0-f192-41ce-a4c2-5ca16e55b186 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-96a1d566-da7f-4924-9d5e-681126a49eb5 req-08fafac0-f192-41ce-a4c2-5ca16e55b186 service nova] Releasing lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-96a1d566-da7f-4924-9d5e-681126a49eb5 req-08fafac0-f192-41ce-a4c2-5ca16e55b186 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-changed-029910e1-c407-4728-a2a3-4daf09db5632 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-96a1d566-da7f-4924-9d5e-681126a49eb5 req-08fafac0-f192-41ce-a4c2-5ca16e55b186 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Refreshing instance network info cache due to event network-changed-029910e1-c407-4728-a2a3-4daf09db5632. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-96a1d566-da7f-4924-9d5e-681126a49eb5 req-08fafac0-f192-41ce-a4c2-5ca16e55b186 service nova] Acquiring lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-96a1d566-da7f-4924-9d5e-681126a49eb5 req-08fafac0-f192-41ce-a4c2-5ca16e55b186 service nova] Acquired lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.network.neutron [req-96a1d566-da7f-4924-9d5e-681126a49eb5 req-08fafac0-f192-41ce-a4c2-5ca16e55b186 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Refreshing network info cache for port 029910e1-c407-4728-a2a3-4daf09db5632 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.network.neutron [req-96a1d566-da7f-4924-9d5e-681126a49eb5 req-08fafac0-f192-41ce-a4c2-5ca16e55b186 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Successfully updated port: eac8e395-8b46-4d73-a0b8-495ee2530d6c {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG nova.network.neutron [req-96a1d566-da7f-4924-9d5e-681126a49eb5 req-08fafac0-f192-41ce-a4c2-5ca16e55b186 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:02:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-96a1d566-da7f-4924-9d5e-681126a49eb5 req-08fafac0-f192-41ce-a4c2-5ca16e55b186 service nova] Releasing lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26266363361643366', 'path': '/dev/sdd'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266363361643366', 'path': '/dev/sdd'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1537383573',display_name='tempest-ServerActionsTestOtherB-server-1537383573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1537383573',id=18,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbR7/rnM2AeZHN+BHEO9wy6tT5C/8gqpz2OLyZ0PrOkSO9sSAq61LBq8B59x8O0SJWkSJu3MS+tJxcGT/zQuOBrkxHQmB8JC+FatiKrmiFApJOgsuSU1qC5st2CAxnTvw==',key_name='tempest-keypair-568897893',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:57:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d9d41329e1ad49bc94369a54d2798ac6',ramdisk_id='',reservation_id='r-6rax0pzg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1653559752',owner_user_name='tempest-ServerActionsTestOtherB-1653559752-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d3f2f35df22412cac98e90f1bb80b08',uuid=5984759d-28f1-45e8-bb4c-27bd8df426f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-579513350-network", "vif_mac": "fa:16:3e:f8:e1:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Converting VIF {"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-579513350-network", "vif_mac": "fa:16:3e:f8:e1:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:02:29 user nova-compute[73469]:   <uuid>5984759d-28f1-45e8-bb4c-27bd8df426f4</uuid>
Aug 22 03:02:29 user nova-compute[73469]:   <name>instance-00000012</name>
Aug 22 03:02:29 user nova-compute[73469]:   <memory>2097152</memory>
Aug 22 03:02:29 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:02:29 user nova-compute[73469]:   <metadata>
Aug 22 03:02:29 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:02:29 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:02:29 user nova-compute[73469]:       <nova:name>tempest-ServerActionsTestOtherB-server-1537383573</nova:name>
Aug 22 03:02:29 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:02:28</nova:creationTime>
Aug 22 03:02:29 user nova-compute[73469]:       <nova:flavor name="m1.small">
Aug 22 03:02:29 user nova-compute[73469]:         <nova:memory>2048</nova:memory>
Aug 22 03:02:29 user nova-compute[73469]:         <nova:disk>20</nova:disk>
Aug 22 03:02:29 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:02:29 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:02:29 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:02:29 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:02:29 user nova-compute[73469]:       <nova:owner>
Aug 22 03:02:29 user nova-compute[73469]:         <nova:user uuid="6d3f2f35df22412cac98e90f1bb80b08">tempest-ServerActionsTestOtherB-1653559752-project-member</nova:user>
Aug 22 03:02:29 user nova-compute[73469]:         <nova:project uuid="d9d41329e1ad49bc94369a54d2798ac6">tempest-ServerActionsTestOtherB-1653559752</nova:project>
Aug 22 03:02:29 user nova-compute[73469]:       </nova:owner>
Aug 22 03:02:29 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:02:29 user nova-compute[73469]:       <nova:ports>
Aug 22 03:02:29 user nova-compute[73469]:         <nova:port uuid="f38d1396-0fe4-4107-8815-7420deceedab">
Aug 22 03:02:29 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 22 03:02:29 user nova-compute[73469]:         </nova:port>
Aug 22 03:02:29 user nova-compute[73469]:       </nova:ports>
Aug 22 03:02:29 user nova-compute[73469]:     </nova:instance>
Aug 22 03:02:29 user nova-compute[73469]:   </metadata>
Aug 22 03:02:29 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:02:29 user nova-compute[73469]:     <system>
Aug 22 03:02:29 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:02:29 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:02:29 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:02:29 user nova-compute[73469]:       <entry name="serial">5984759d-28f1-45e8-bb4c-27bd8df426f4</entry>
Aug 22 03:02:29 user nova-compute[73469]:       <entry name="uuid">5984759d-28f1-45e8-bb4c-27bd8df426f4</entry>
Aug 22 03:02:29 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:02:29 user nova-compute[73469]:     </system>
Aug 22 03:02:29 user nova-compute[73469]:   </sysinfo>
Aug 22 03:02:29 user nova-compute[73469]:   <os>
Aug 22 03:02:29 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:02:29 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:02:29 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:02:29 user nova-compute[73469]:   </os>
Aug 22 03:02:29 user nova-compute[73469]:   <features>
Aug 22 03:02:29 user nova-compute[73469]:     <acpi/>
Aug 22 03:02:29 user nova-compute[73469]:     <apic/>
Aug 22 03:02:29 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:02:29 user nova-compute[73469]:   </features>
Aug 22 03:02:29 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:02:29 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:02:29 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:02:29 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:02:29 user nova-compute[73469]:   </clock>
Aug 22 03:02:29 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:02:29 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:02:29 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:02:29 user nova-compute[73469]:   </cpu>
Aug 22 03:02:29 user nova-compute[73469]:   <devices>
Aug 22 03:02:29 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:02:29 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:02:29 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk"/>
Aug 22 03:02:29 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:02:29 user nova-compute[73469]:     </disk>
Aug 22 03:02:29 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:02:29 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:02:29 user nova-compute[73469]:       <source dev="/dev/sdd"/>
Aug 22 03:02:29 user nova-compute[73469]:       <target dev="vdb" bus="virtio"/>
Aug 22 03:02:29 user nova-compute[73469]:       <serial>ab9a6baf-31df-4c2e-a390-daa9a68e83fc</serial>
Aug 22 03:02:29 user nova-compute[73469]:     </disk>
Aug 22 03:02:29 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:02:29 user nova-compute[73469]:       <mac address="fa:16:3e:f8:e1:3e"/>
Aug 22 03:02:29 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:02:29 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:02:29 user nova-compute[73469]:       <target dev="tapf38d1396-0f"/>
Aug 22 03:02:29 user nova-compute[73469]:     </interface>
Aug 22 03:02:29 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:02:29 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/console.log" append="off"/>
Aug 22 03:02:29 user nova-compute[73469]:     </serial>
Aug 22 03:02:29 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:02:29 user nova-compute[73469]:     <video>
Aug 22 03:02:29 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:02:29 user nova-compute[73469]:     </video>
Aug 22 03:02:29 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:02:29 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:02:29 user nova-compute[73469]:     </rng>
Aug 22 03:02:29 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:02:29 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:02:29 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:02:29 user nova-compute[73469]:     </memballoon>
Aug 22 03:02:29 user nova-compute[73469]:   </devices>
Aug 22 03:02:29 user nova-compute[73469]: </domain>
Aug 22 03:02:29 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1537383573',display_name='tempest-ServerActionsTestOtherB-server-1537383573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1537383573',id=18,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbR7/rnM2AeZHN+BHEO9wy6tT5C/8gqpz2OLyZ0PrOkSO9sSAq61LBq8B59x8O0SJWkSJu3MS+tJxcGT/zQuOBrkxHQmB8JC+FatiKrmiFApJOgsuSU1qC5st2CAxnTvw==',key_name='tempest-keypair-568897893',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:57:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d9d41329e1ad49bc94369a54d2798ac6',ramdisk_id='',reservation_id='r-6rax0pzg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1653559752',owner_user_name='tempest-ServerActionsTestOtherB-1653559752-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d3f2f35df22412cac98e90f1bb80b08',uuid=5984759d-28f1-45e8-bb4c-27bd8df426f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-579513350-network", "vif_mac": "fa:16:3e:f8:e1:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Converting VIF {"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-579513350-network", "vif_mac": "fa:16:3e:f8:e1:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG os_vif [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf38d1396-0f, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf38d1396-0f, col_values=(('external_ids', {'iface-id': 'f38d1396-0fe4-4107-8815-7420deceedab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:e1:3e', 'vm-uuid': '5984759d-28f1-45e8-bb4c-27bd8df426f4'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:29 user nova-compute[73469]: INFO os_vif [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f')
Aug 22 03:02:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] No VIF found with MAC fa:16:3e:f8:e1:3e, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:02:29 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Successfully updated port: 42e5267b-949c-44dd-9b96-975b4534aaa3 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-7bb1fd44-e265-4885-832f-507980cac1c2 req-6edae337-163c-476d-80b1-62a14998f193 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-changed-eac8e395-8b46-4d73-a0b8-495ee2530d6c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-7bb1fd44-e265-4885-832f-507980cac1c2 req-6edae337-163c-476d-80b1-62a14998f193 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Refreshing instance network info cache due to event network-changed-eac8e395-8b46-4d73-a0b8-495ee2530d6c. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7bb1fd44-e265-4885-832f-507980cac1c2 req-6edae337-163c-476d-80b1-62a14998f193 service nova] Acquiring lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7bb1fd44-e265-4885-832f-507980cac1c2 req-6edae337-163c-476d-80b1-62a14998f193 service nova] Acquired lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG nova.network.neutron [req-7bb1fd44-e265-4885-832f-507980cac1c2 req-6edae337-163c-476d-80b1-62a14998f193 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Refreshing network info cache for port eac8e395-8b46-4d73-a0b8-495ee2530d6c {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG nova.network.neutron [req-7bb1fd44-e265-4885-832f-507980cac1c2 req-6edae337-163c-476d-80b1-62a14998f193 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Successfully updated port: bc85b38c-492a-46f6-8d44-67882abf29fb {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG nova.network.neutron [req-7bb1fd44-e265-4885-832f-507980cac1c2 req-6edae337-163c-476d-80b1-62a14998f193 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7bb1fd44-e265-4885-832f-507980cac1c2 req-6edae337-163c-476d-80b1-62a14998f193 service nova] Releasing lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-7bb1fd44-e265-4885-832f-507980cac1c2 req-6edae337-163c-476d-80b1-62a14998f193 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-changed-42e5267b-949c-44dd-9b96-975b4534aaa3 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-7bb1fd44-e265-4885-832f-507980cac1c2 req-6edae337-163c-476d-80b1-62a14998f193 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Refreshing instance network info cache due to event network-changed-42e5267b-949c-44dd-9b96-975b4534aaa3. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7bb1fd44-e265-4885-832f-507980cac1c2 req-6edae337-163c-476d-80b1-62a14998f193 service nova] Acquiring lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7bb1fd44-e265-4885-832f-507980cac1c2 req-6edae337-163c-476d-80b1-62a14998f193 service nova] Acquired lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG nova.network.neutron [req-7bb1fd44-e265-4885-832f-507980cac1c2 req-6edae337-163c-476d-80b1-62a14998f193 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Refreshing network info cache for port 42e5267b-949c-44dd-9b96-975b4534aaa3 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG nova.network.neutron [req-7bb1fd44-e265-4885-832f-507980cac1c2 req-6edae337-163c-476d-80b1-62a14998f193 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG nova.network.neutron [req-7bb1fd44-e265-4885-832f-507980cac1c2 req-6edae337-163c-476d-80b1-62a14998f193 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7bb1fd44-e265-4885-832f-507980cac1c2 req-6edae337-163c-476d-80b1-62a14998f193 service nova] Releasing lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:31 user nova-compute[73469]: DEBUG nova.compute.manager [req-7b0ce328-5a20-40e3-95ed-759848cb6b6f req-d5450993-1719-432d-9ee5-754eedaca9b9 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:02:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7b0ce328-5a20-40e3-95ed-759848cb6b6f req-d5450993-1719-432d-9ee5-754eedaca9b9 service nova] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7b0ce328-5a20-40e3-95ed-759848cb6b6f req-d5450993-1719-432d-9ee5-754eedaca9b9 service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7b0ce328-5a20-40e3-95ed-759848cb6b6f req-d5450993-1719-432d-9ee5-754eedaca9b9 service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:31 user nova-compute[73469]: DEBUG nova.compute.manager [req-7b0ce328-5a20-40e3-95ed-759848cb6b6f req-d5450993-1719-432d-9ee5-754eedaca9b9 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] No waiting events found dispatching network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:02:31 user nova-compute[73469]: WARNING nova.compute.manager [req-7b0ce328-5a20-40e3-95ed-759848cb6b6f req-d5450993-1719-432d-9ee5-754eedaca9b9 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received unexpected event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab for instance with vm_state active and task_state resize_finish.
Aug 22 03:02:31 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Successfully updated port: f948c8ed-80d5-411d-95bb-d12e136727e6 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:02:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Acquiring lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:02:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Acquired lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:02:31 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:02:31 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:02:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-a266bc78-1b1d-40ec-b1fb-a70965b35927 req-3b4c0806-f3b4-4d6c-9e09-d2204f5dbef5 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-changed-bc85b38c-492a-46f6-8d44-67882abf29fb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:02:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-a266bc78-1b1d-40ec-b1fb-a70965b35927 req-3b4c0806-f3b4-4d6c-9e09-d2204f5dbef5 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Refreshing instance network info cache due to event network-changed-bc85b38c-492a-46f6-8d44-67882abf29fb. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:02:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a266bc78-1b1d-40ec-b1fb-a70965b35927 req-3b4c0806-f3b4-4d6c-9e09-d2204f5dbef5 service nova] Acquiring lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:02:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:33 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673353.1723692, 5984759d-28f1-45e8-bb4c-27bd8df426f4 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:02:33 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] VM Resumed (Lifecycle Event)
Aug 22 03:02:33 user nova-compute[73469]: DEBUG nova.compute.manager [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:02:33 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Instance running successfully.
Aug 22 03:02:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Failed to set time: agent not configured {{(pid=73469) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 22 03:02:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-10a762d8-2396-4867-a385-bbea3b24b523 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] finish_migration finished successfully. {{(pid=73469) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 22 03:02:33 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:02:33 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:02:33 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 22 03:02:33 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673353.1746309, 5984759d-28f1-45e8-bb4c-27bd8df426f4 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:02:33 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] VM Started (Lifecycle Event)
Aug 22 03:02:33 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:02:33 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:02:33 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 22 03:02:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-093b1bbd-74b8-4c1e-9f6f-a2866aed0ed7 req-9083bd9c-9790-4c53-a640-59dcd5de0836 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:02:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-093b1bbd-74b8-4c1e-9f6f-a2866aed0ed7 req-9083bd9c-9790-4c53-a640-59dcd5de0836 service nova] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-093b1bbd-74b8-4c1e-9f6f-a2866aed0ed7 req-9083bd9c-9790-4c53-a640-59dcd5de0836 service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-093b1bbd-74b8-4c1e-9f6f-a2866aed0ed7 req-9083bd9c-9790-4c53-a640-59dcd5de0836 service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-093b1bbd-74b8-4c1e-9f6f-a2866aed0ed7 req-9083bd9c-9790-4c53-a640-59dcd5de0836 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] No waiting events found dispatching network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:02:33 user nova-compute[73469]: WARNING nova.compute.manager [req-093b1bbd-74b8-4c1e-9f6f-a2866aed0ed7 req-9083bd9c-9790-4c53-a640-59dcd5de0836 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received unexpected event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab for instance with vm_state active and task_state resize_finish.
Aug 22 03:02:34 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updating instance_info_cache with network_info: [{"id": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "address": "fa:16:3e:24:2f:4c", "network": {"id": "08f11990-95e2-453a-a05b-2526367ec3fd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-130047836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5ac4586-bd", "ovs_interfaceid": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "address": "fa:16:3e:e4:03:95", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d0a8d68-79", "ovs_interfaceid": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "029910e1-c407-4728-a2a3-4daf09db5632", "address": "fa:16:3e:58:a3:0d", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029910e1-c4", "ovs_interfaceid": "029910e1-c407-4728-a2a3-4daf09db5632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "address": "fa:16:3e:c2:21:f8", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac8e395-8b", "ovs_interfaceid": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "42e5267b-949c-44dd-9b96-975b4534aaa3", "address": "fa:16:3e:00:55:c5", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5267b-94", "ovs_interfaceid": "42e5267b-949c-44dd-9b96-975b4534aaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc85b38c-492a-46f6-8d44-67882abf29fb", "address": "fa:16:3e:a9:ae:10", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc85b38c-49", "ovs_interfaceid": "bc85b38c-492a-46f6-8d44-67882abf29fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f948c8ed-80d5-411d-95bb-d12e136727e6", "address": "fa:16:3e:e9:38:9c", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948c8ed-80", "ovs_interfaceid": "f948c8ed-80d5-411d-95bb-d12e136727e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:02:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Releasing lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:02:34 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Instance network_info: |[{"id": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "address": "fa:16:3e:24:2f:4c", "network": {"id": "08f11990-95e2-453a-a05b-2526367ec3fd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-130047836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5ac4586-bd", "ovs_interfaceid": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "address": "fa:16:3e:e4:03:95", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d0a8d68-79", "ovs_interfaceid": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "029910e1-c407-4728-a2a3-4daf09db5632", "address": "fa:16:3e:58:a3:0d", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029910e1-c4", "ovs_interfaceid": "029910e1-c407-4728-a2a3-4daf09db5632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "address": "fa:16:3e:c2:21:f8", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac8e395-8b", "ovs_interfaceid": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "42e5267b-949c-44dd-9b96-975b4534aaa3", "address": "fa:16:3e:00:55:c5", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5267b-94", "ovs_interfaceid": "42e5267b-949c-44dd-9b96-975b4534aaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc85b38c-492a-46f6-8d44-67882abf29fb", "address": "fa:16:3e:a9:ae:10", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc85b38c-49", "ovs_interfaceid": "bc85b38c-492a-46f6-8d44-67882abf29fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f948c8ed-80d5-411d-95bb-d12e136727e6", "address": "fa:16:3e:e9:38:9c", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948c8ed-80", "ovs_interfaceid": "f948c8ed-80d5-411d-95bb-d12e136727e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:02:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a266bc78-1b1d-40ec-b1fb-a70965b35927 req-3b4c0806-f3b4-4d6c-9e09-d2204f5dbef5 service nova] Acquired lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:02:34 user nova-compute[73469]: DEBUG nova.network.neutron [req-a266bc78-1b1d-40ec-b1fb-a70965b35927 req-3b4c0806-f3b4-4d6c-9e09-d2204f5dbef5 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Refreshing network info cache for port bc85b38c-492a-46f6-8d44-67882abf29fb {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:02:34 user nova-compute[73469]: DEBUG nova.network.neutron [req-a266bc78-1b1d-40ec-b1fb-a70965b35927 req-3b4c0806-f3b4-4d6c-9e09-d2204f5dbef5 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updated VIF entry in instance network info cache for port bc85b38c-492a-46f6-8d44-67882abf29fb. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:02:34 user nova-compute[73469]: DEBUG nova.network.neutron [req-a266bc78-1b1d-40ec-b1fb-a70965b35927 req-3b4c0806-f3b4-4d6c-9e09-d2204f5dbef5 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updating instance_info_cache with network_info: [{"id": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "address": "fa:16:3e:24:2f:4c", "network": {"id": "08f11990-95e2-453a-a05b-2526367ec3fd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-130047836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5ac4586-bd", "ovs_interfaceid": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "address": "fa:16:3e:e4:03:95", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d0a8d68-79", "ovs_interfaceid": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "029910e1-c407-4728-a2a3-4daf09db5632", "address": "fa:16:3e:58:a3:0d", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029910e1-c4", "ovs_interfaceid": "029910e1-c407-4728-a2a3-4daf09db5632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "address": "fa:16:3e:c2:21:f8", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac8e395-8b", "ovs_interfaceid": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "42e5267b-949c-44dd-9b96-975b4534aaa3", "address": "fa:16:3e:00:55:c5", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5267b-94", "ovs_interfaceid": "42e5267b-949c-44dd-9b96-975b4534aaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc85b38c-492a-46f6-8d44-67882abf29fb", "address": "fa:16:3e:a9:ae:10", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc85b38c-49", "ovs_interfaceid": "bc85b38c-492a-46f6-8d44-67882abf29fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f948c8ed-80d5-411d-95bb-d12e136727e6", "address": "fa:16:3e:e9:38:9c", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948c8ed-80", "ovs_interfaceid": "f948c8ed-80d5-411d-95bb-d12e136727e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:02:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a266bc78-1b1d-40ec-b1fb-a70965b35927 req-3b4c0806-f3b4-4d6c-9e09-d2204f5dbef5 service nova] Releasing lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:02:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-a266bc78-1b1d-40ec-b1fb-a70965b35927 req-3b4c0806-f3b4-4d6c-9e09-d2204f5dbef5 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-changed-f948c8ed-80d5-411d-95bb-d12e136727e6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:02:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-a266bc78-1b1d-40ec-b1fb-a70965b35927 req-3b4c0806-f3b4-4d6c-9e09-d2204f5dbef5 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Refreshing instance network info cache due to event network-changed-f948c8ed-80d5-411d-95bb-d12e136727e6. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:02:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a266bc78-1b1d-40ec-b1fb-a70965b35927 req-3b4c0806-f3b4-4d6c-9e09-d2204f5dbef5 service nova] Acquiring lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:02:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a266bc78-1b1d-40ec-b1fb-a70965b35927 req-3b4c0806-f3b4-4d6c-9e09-d2204f5dbef5 service nova] Acquired lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:02:34 user nova-compute[73469]: DEBUG nova.network.neutron [req-a266bc78-1b1d-40ec-b1fb-a70965b35927 req-3b4c0806-f3b4-4d6c-9e09-d2204f5dbef5 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Refreshing network info cache for port f948c8ed-80d5-411d-95bb-d12e136727e6 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:02:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:34 user nova-compute[73469]: DEBUG nova.objects.instance [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'pci_requests' on Instance uuid d8433c45-b889-4a7b-88c2-ba00679b1d26 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:02:34 user nova-compute[73469]: DEBUG nova.objects.instance [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'numa_topology' on Instance uuid d8433c45-b889-4a7b-88c2-ba00679b1d26 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:02:34 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:02:34 user nova-compute[73469]: INFO nova.compute.claims [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Claim successful on node user
Aug 22 03:02:34 user nova-compute[73469]: DEBUG nova.network.neutron [req-a266bc78-1b1d-40ec-b1fb-a70965b35927 req-3b4c0806-f3b4-4d6c-9e09-d2204f5dbef5 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updated VIF entry in instance network info cache for port f948c8ed-80d5-411d-95bb-d12e136727e6. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:02:34 user nova-compute[73469]: DEBUG nova.network.neutron [req-a266bc78-1b1d-40ec-b1fb-a70965b35927 req-3b4c0806-f3b4-4d6c-9e09-d2204f5dbef5 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updating instance_info_cache with network_info: [{"id": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "address": "fa:16:3e:24:2f:4c", "network": {"id": "08f11990-95e2-453a-a05b-2526367ec3fd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-130047836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5ac4586-bd", "ovs_interfaceid": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "address": "fa:16:3e:e4:03:95", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d0a8d68-79", "ovs_interfaceid": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "029910e1-c407-4728-a2a3-4daf09db5632", "address": "fa:16:3e:58:a3:0d", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029910e1-c4", "ovs_interfaceid": "029910e1-c407-4728-a2a3-4daf09db5632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "address": "fa:16:3e:c2:21:f8", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac8e395-8b", "ovs_interfaceid": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "42e5267b-949c-44dd-9b96-975b4534aaa3", "address": "fa:16:3e:00:55:c5", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5267b-94", "ovs_interfaceid": "42e5267b-949c-44dd-9b96-975b4534aaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc85b38c-492a-46f6-8d44-67882abf29fb", "address": "fa:16:3e:a9:ae:10", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc85b38c-49", "ovs_interfaceid": "bc85b38c-492a-46f6-8d44-67882abf29fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f948c8ed-80d5-411d-95bb-d12e136727e6", "address": "fa:16:3e:e9:38:9c", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948c8ed-80", "ovs_interfaceid": "f948c8ed-80d5-411d-95bb-d12e136727e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:02:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a266bc78-1b1d-40ec-b1fb-a70965b35927 req-3b4c0806-f3b4-4d6c-9e09-d2204f5dbef5 service nova] Releasing lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:02:35 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:02:35 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:02:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.608s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:35 user nova-compute[73469]: INFO nova.network.neutron [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Updating port 4697b7dd-3290-45e0-baa6-01e13c682505 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 22 03:02:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:02:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquired lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:02:36 user nova-compute[73469]: DEBUG nova.network.neutron [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:02:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-7d302584-7dfc-44a2-8eba-078f71057909 req-be2556d1-ca2f-4e55-a47d-861087d25782 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received event network-changed-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:02:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-7d302584-7dfc-44a2-8eba-078f71057909 req-be2556d1-ca2f-4e55-a47d-861087d25782 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Refreshing instance network info cache due to event network-changed-4697b7dd-3290-45e0-baa6-01e13c682505. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:02:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7d302584-7dfc-44a2-8eba-078f71057909 req-be2556d1-ca2f-4e55-a47d-861087d25782 service nova] Acquiring lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:02:36 user nova-compute[73469]: DEBUG nova.network.neutron [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Updating instance_info_cache with network_info: [{"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:02:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Releasing lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:02:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:02:36 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Creating image(s)
Aug 22 03:02:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "/opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "/opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:36 user nova-compute[73469]: DEBUG nova.objects.instance [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'trusted_certs' on Instance uuid d8433c45-b889-4a7b-88c2-ba00679b1d26 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:02:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7d302584-7dfc-44a2-8eba-078f71057909 req-be2556d1-ca2f-4e55-a47d-861087d25782 service nova] Acquired lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:02:36 user nova-compute[73469]: DEBUG nova.network.neutron [req-7d302584-7dfc-44a2-8eba-078f71057909 req-be2556d1-ca2f-4e55-a47d-861087d25782 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Refreshing network info cache for port 4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:02:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "59718c6b0b9635a96b3e42d4e4978356d15a2687" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "59718c6b0b9635a96b3e42d4e4978356d15a2687" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59718c6b0b9635a96b3e42d4e4978356d15a2687.part --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59718c6b0b9635a96b3e42d4e4978356d15a2687.part --force-share --output=json" returned: 0 in 0.218s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:37 user nova-compute[73469]: DEBUG nova.virt.images [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] 5f04b41f-bf9d-46a1-a910-3aa6cd00626d was qcow2, converting to raw {{(pid=73469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 22 03:02:37 user nova-compute[73469]: DEBUG nova.privsep.utils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 22 03:02:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59718c6b0b9635a96b3e42d4e4978356d15a2687.part /opt/stack/data/nova/instances/_base/59718c6b0b9635a96b3e42d4e4978356d15a2687.converted {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59718c6b0b9635a96b3e42d4e4978356d15a2687.part /opt/stack/data/nova/instances/_base/59718c6b0b9635a96b3e42d4e4978356d15a2687.converted" returned: 0 in 0.386s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59718c6b0b9635a96b3e42d4e4978356d15a2687.converted --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:38 user nova-compute[73469]: DEBUG nova.network.neutron [req-7d302584-7dfc-44a2-8eba-078f71057909 req-be2556d1-ca2f-4e55-a47d-861087d25782 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Updated VIF entry in instance network info cache for port 4697b7dd-3290-45e0-baa6-01e13c682505. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:02:38 user nova-compute[73469]: DEBUG nova.network.neutron [req-7d302584-7dfc-44a2-8eba-078f71057909 req-be2556d1-ca2f-4e55-a47d-861087d25782 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Updating instance_info_cache with network_info: [{"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:02:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7d302584-7dfc-44a2-8eba-078f71057909 req-be2556d1-ca2f-4e55-a47d-861087d25782 service nova] Releasing lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:02:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59718c6b0b9635a96b3e42d4e4978356d15a2687.converted --force-share --output=json" returned: 0 in 0.233s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "59718c6b0b9635a96b3e42d4e4978356d15a2687" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.730s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59718c6b0b9635a96b3e42d4e4978356d15a2687 --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:38 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:02:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59718c6b0b9635a96b3e42d4e4978356d15a2687 --force-share --output=json" returned: 0 in 0.247s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "59718c6b0b9635a96b3e42d4e4978356d15a2687" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "59718c6b0b9635a96b3e42d4e4978356d15a2687" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59718c6b0b9635a96b3e42d4e4978356d15a2687 --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59718c6b0b9635a96b3e42d4e4978356d15a2687 --force-share --output=json" returned: 0 in 0.181s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59718c6b0b9635a96b3e42d4e4978356d15a2687,backing_fmt=raw /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59718c6b0b9635a96b3e42d4e4978356d15a2687,backing_fmt=raw /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk 1073741824" returned: 0 in 0.057s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "59718c6b0b9635a96b3e42d4e4978356d15a2687" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59718c6b0b9635a96b3e42d4e4978356d15a2687 --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59718c6b0b9635a96b3e42d4e4978356d15a2687 --force-share --output=json" returned: 0 in 0.244s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:39 user nova-compute[73469]: DEBUG nova.objects.instance [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'migration_context' on Instance uuid d8433c45-b889-4a7b-88c2-ba00679b1d26 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:02:39 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Rebasing disk image.
Aug 22 03:02:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.208s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc -F raw /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:39 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:02:39 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:02:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:02:40 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:02:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:40 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:02:40 user nova-compute[73469]: INFO nova.compute.claims [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Claim successful on node user
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.939s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.network.neutron [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:02:41 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc -F raw /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk" returned: 0 in 2.328s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Ensure instance console log exists: /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Start _get_guest_xml network_info=[{"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='594f61213e1ae7f4d8f3c52aba43f3e8',container_format='bare',created_at=2023-08-22T03:00:29Z,direct_url=<?>,disk_format='qcow2',id=5f04b41f-bf9d-46a1-a910-3aa6cd00626d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-557066596-shelved',owner='ca3e1f2f72c7497ca3ad923a4b9459dc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-22T03:00:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': '05bc94f7-2c76-4cbd-91ca-3462adee6840', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcgtOVho', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'd8433c45-b889-4a7b-88c2-ba00679b1d26', 'attached_at': '', 'detached_at': '', 'volume_id': '04ccfa44-b35b-49f2-9c95-5ae2d56e4932', 'serial': '04ccfa44-b35b-49f2-9c95-5ae2d56e4932'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:02:41 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:02:41 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='594f61213e1ae7f4d8f3c52aba43f3e8',container_format='bare',created_at=2023-08-22T03:00:29Z,direct_url=<?>,disk_format='qcow2',id=5f04b41f-bf9d-46a1-a910-3aa6cd00626d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-557066596-shelved',owner='ca3e1f2f72c7497ca3ad923a4b9459dc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-22T03:00:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.objects.instance [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'vcpu_model' on Instance uuid d8433c45-b889-4a7b-88c2-ba00679b1d26 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcgtOVho', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:02:41 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:02:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:02:41 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:02:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:02:41 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[160d1bf6-edaa-4d1f-b038-d3d4f46cda5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:02:41 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:02:41 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Creating image(s)
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "/opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "/opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeca243-9b07-4953-9260-42a5f9212552]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG nova.policy [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b47d6cefd0d4949bf4c3c0fc72a9cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1c312e979e47558b06d4fa70bc103a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932] added
Aug 22 03:02:41 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[12028ed0-354a-4f99-9a79-5ed258d97811]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fff5968-7464-4d39-b9e4-ced4dc5b37a2]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:02:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xcgtOVho {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xcgtOVho" returned: 0 in 0.029s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52a320f-0661-42e6-9729-d0dbf8ede7d9]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xcgtOVho'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.040s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[94675845-9541-4df1-87de-f5884103b953]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4debac2f-5d4c-41dc-89b6-c155d011473e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:02:42 user nova-compute[73469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:02:42 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:02:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:02:42 user nova-compute[73469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:02:42 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:02:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.283s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[93121c7a-1015-44a0-a9a2-f20cb2808aa0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932, portal: 172.16.0.220,3260]
Aug 22 03:02:42 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932, portal: 172.16.0.220,3260] successful.
Aug 22 03:02:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.117s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b1441e-793c-42cf-9192-bfd188cd1e07]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.213s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.083s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e3abfa-3e3d-46c9-836a-6e021c8d3aa0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:02:42 user nova-compute[73469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:02:42 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:02:42 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:02:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:02:42 user nova-compute[73469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:02:42 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:02:42 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:02:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.762s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk 1073741824" returned: 0 in 0.232s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.031s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.451s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0119cd8d-ff12-49c6-9629-e4a9d55f421c]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcgtOVho', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-2e621408-a0af-460b-80a2-3446b5f1aadb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-2e621408-a0af-460b-80a2-3446b5f1aadb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.185s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Cannot resize image /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG nova.objects.instance [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'migration_context' on Instance uuid 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Ensure instance console log exists: /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG nova.network.neutron [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Successfully created port: 1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Updating instance_info_cache with network_info: [{"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-2e621408-a0af-460b-80a2-3446b5f1aadb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.871s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] <== connect_volume: return (1876ms) {'type': 'block', 'scsi_wwn': '26134336435396134', 'path': '/dev/sde'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134336435396134', 'path': '/dev/sde'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-22T02:58:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-557066596',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-557066596',id=19,image_ref='5f04b41f-bf9d-46a1-a910-3aa6cd00626d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-510663035',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:58:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ca3e1f2f72c7497ca3ad923a4b9459dc',ramdisk_id='',reservation_id='r-y4g07ft5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-774227889',owner_user_name='tempest-AttachVolumeShelveTestJSON-774227889-project-member',shelved_at='2023-08-22T03:00:33.725300',shelved_host='user',shelved_image_id='5f04b41f-bf9d-46a1-a910-3aa6cd00626d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41e697cd5e5f422f8ac90f7496f60936',uuid=d8433c45-b889-4a7b-88c2-ba00679b1d26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converting VIF {"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=4697b7dd-3290-45e0-baa6-01e13c682505,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4697b7dd-32') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG nova.objects.instance [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'pci_devices' on Instance uuid d8433c45-b889-4a7b-88c2-ba00679b1d26 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:02:43 user nova-compute[73469]:   <uuid>d8433c45-b889-4a7b-88c2-ba00679b1d26</uuid>
Aug 22 03:02:43 user nova-compute[73469]:   <name>instance-00000013</name>
Aug 22 03:02:43 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:02:43 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:02:43 user nova-compute[73469]:   <metadata>
Aug 22 03:02:43 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:02:43 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:02:43 user nova-compute[73469]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-557066596</nova:name>
Aug 22 03:02:43 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:02:41</nova:creationTime>
Aug 22 03:02:43 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:02:43 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:02:43 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:02:43 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:02:43 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:02:43 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:02:43 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:02:43 user nova-compute[73469]:       <nova:owner>
Aug 22 03:02:43 user nova-compute[73469]:         <nova:user uuid="41e697cd5e5f422f8ac90f7496f60936">tempest-AttachVolumeShelveTestJSON-774227889-project-member</nova:user>
Aug 22 03:02:43 user nova-compute[73469]:         <nova:project uuid="ca3e1f2f72c7497ca3ad923a4b9459dc">tempest-AttachVolumeShelveTestJSON-774227889</nova:project>
Aug 22 03:02:43 user nova-compute[73469]:       </nova:owner>
Aug 22 03:02:43 user nova-compute[73469]:       <nova:root type="image" uuid="5f04b41f-bf9d-46a1-a910-3aa6cd00626d"/>
Aug 22 03:02:43 user nova-compute[73469]:       <nova:ports>
Aug 22 03:02:43 user nova-compute[73469]:         <nova:port uuid="4697b7dd-3290-45e0-baa6-01e13c682505">
Aug 22 03:02:43 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 22 03:02:43 user nova-compute[73469]:         </nova:port>
Aug 22 03:02:43 user nova-compute[73469]:       </nova:ports>
Aug 22 03:02:43 user nova-compute[73469]:     </nova:instance>
Aug 22 03:02:43 user nova-compute[73469]:   </metadata>
Aug 22 03:02:43 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:02:43 user nova-compute[73469]:     <system>
Aug 22 03:02:43 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:02:43 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:02:43 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:02:43 user nova-compute[73469]:       <entry name="serial">d8433c45-b889-4a7b-88c2-ba00679b1d26</entry>
Aug 22 03:02:43 user nova-compute[73469]:       <entry name="uuid">d8433c45-b889-4a7b-88c2-ba00679b1d26</entry>
Aug 22 03:02:43 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:02:43 user nova-compute[73469]:     </system>
Aug 22 03:02:43 user nova-compute[73469]:   </sysinfo>
Aug 22 03:02:43 user nova-compute[73469]:   <os>
Aug 22 03:02:43 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:02:43 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:02:43 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:02:43 user nova-compute[73469]:   </os>
Aug 22 03:02:43 user nova-compute[73469]:   <features>
Aug 22 03:02:43 user nova-compute[73469]:     <acpi/>
Aug 22 03:02:43 user nova-compute[73469]:     <apic/>
Aug 22 03:02:43 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:02:43 user nova-compute[73469]:   </features>
Aug 22 03:02:43 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:02:43 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:02:43 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:02:43 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:02:43 user nova-compute[73469]:   </clock>
Aug 22 03:02:43 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:02:43 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:02:43 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:02:43 user nova-compute[73469]:   </cpu>
Aug 22 03:02:43 user nova-compute[73469]:   <devices>
Aug 22 03:02:43 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:02:43 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:02:43 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk"/>
Aug 22 03:02:43 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:02:43 user nova-compute[73469]:     </disk>
Aug 22 03:02:43 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:02:43 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:02:43 user nova-compute[73469]:       <source dev="/dev/sde"/>
Aug 22 03:02:43 user nova-compute[73469]:       <target dev="vdc" bus="virtio"/>
Aug 22 03:02:43 user nova-compute[73469]:       <serial>04ccfa44-b35b-49f2-9c95-5ae2d56e4932</serial>
Aug 22 03:02:43 user nova-compute[73469]:     </disk>
Aug 22 03:02:43 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:02:43 user nova-compute[73469]:       <mac address="fa:16:3e:fd:a3:4c"/>
Aug 22 03:02:43 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:02:43 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:02:43 user nova-compute[73469]:       <target dev="tap4697b7dd-32"/>
Aug 22 03:02:43 user nova-compute[73469]:     </interface>
Aug 22 03:02:43 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:02:43 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/console.log" append="off"/>
Aug 22 03:02:43 user nova-compute[73469]:     </serial>
Aug 22 03:02:43 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:02:43 user nova-compute[73469]:     <video>
Aug 22 03:02:43 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:02:43 user nova-compute[73469]:     </video>
Aug 22 03:02:43 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:02:43 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:02:43 user nova-compute[73469]:     </rng>
Aug 22 03:02:43 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:02:43 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:02:43 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:02:43 user nova-compute[73469]:     </memballoon>
Aug 22 03:02:43 user nova-compute[73469]:   </devices>
Aug 22 03:02:43 user nova-compute[73469]: </domain>
Aug 22 03:02:43 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-22T02:58:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-557066596',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-557066596',id=19,image_ref='5f04b41f-bf9d-46a1-a910-3aa6cd00626d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-510663035',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:58:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ca3e1f2f72c7497ca3ad923a4b9459dc',ramdisk_id='',reservation_id='r-y4g07ft5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-774227889',owner_user_name='tempest-AttachVolumeShelveTestJSON-774227889-project-member',shelved_at='2023-08-22T03:00:33.725300',shelved_host='user',shelved_image_id='5f04b41f-bf9d-46a1-a910-3aa6cd00626d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41e697cd5e5f422f8ac90f7496f60936',uuid=d8433c45-b889-4a7b-88c2-ba00679b1d26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converting VIF {"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=4697b7dd-3290-45e0-baa6-01e13c682505,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4697b7dd-32') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG os_vif [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=4697b7dd-3290-45e0-baa6-01e13c682505,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4697b7dd-32') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4697b7dd-32, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4697b7dd-32, col_values=(('external_ids', {'iface-id': '4697b7dd-3290-45e0-baa6-01e13c682505', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:a3:4c', 'vm-uuid': 'd8433c45-b889-4a7b-88c2-ba00679b1d26'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:43 user nova-compute[73469]: INFO os_vif [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=4697b7dd-3290-45e0-baa6-01e13c682505,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4697b7dd-32')
Aug 22 03:02:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] No VIF found with MAC fa:16:3e:fd:a3:4c, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:02:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.network.neutron [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Successfully updated port: 1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "refresh_cache-8a34f0c2-c0b0-4ba7-b9e4-673350a81646" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquired lock "refresh_cache-8a34f0c2-c0b0-4ba7-b9e4-673350a81646" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.network.neutron [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.compute.manager [req-850e7781-6fe2-4949-a0ab-f8231325f9cb req-51a60faf-ea02-4834-8e64-ec0b5723f82b service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Received event network-changed-1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.compute.manager [req-850e7781-6fe2-4949-a0ab-f8231325f9cb req-51a60faf-ea02-4834-8e64-ec0b5723f82b service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Refreshing instance network info cache due to event network-changed-1f995853-c3f9-41c7-a27b-bf970a21b2b1. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-850e7781-6fe2-4949-a0ab-f8231325f9cb req-51a60faf-ea02-4834-8e64-ec0b5723f82b service nova] Acquiring lock "refresh_cache-8a34f0c2-c0b0-4ba7-b9e4-673350a81646" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.network.neutron [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.network.neutron [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Updating instance_info_cache with network_info: [{"id": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "address": "fa:16:3e:ea:7d:48", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f995853-c3", "ovs_interfaceid": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Releasing lock "refresh_cache-8a34f0c2-c0b0-4ba7-b9e4-673350a81646" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Instance network_info: |[{"id": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "address": "fa:16:3e:ea:7d:48", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f995853-c3", "ovs_interfaceid": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-850e7781-6fe2-4949-a0ab-f8231325f9cb req-51a60faf-ea02-4834-8e64-ec0b5723f82b service nova] Acquired lock "refresh_cache-8a34f0c2-c0b0-4ba7-b9e4-673350a81646" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.network.neutron [req-850e7781-6fe2-4949-a0ab-f8231325f9cb req-51a60faf-ea02-4834-8e64-ec0b5723f82b service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Refreshing network info cache for port 1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Start _get_guest_xml network_info=[{"id": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "address": "fa:16:3e:ea:7d:48", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f995853-c3", "ovs_interfaceid": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:02:44 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:02:44 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-390626074',display_name='tempest-tempest.common.compute-instance-390626074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-390626074',id=26,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzECYecqxKAclQ13djaYo4aP+GCuiMQsT7a2vxvloQrNEucWhpndrbmJM02phQQyzEVLxT8xdS0cQ40404Hf+pU7LkGlE/TIncY5ZMIWkzlf47Mxz0eWcSZbF35ZQNuTQ==',key_name='tempest-keypair-1030511610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d1c312e979e47558b06d4fa70bc103a',ramdisk_id='',reservation_id='r-iptnxvlr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1751677379',owner_user_name='tempest-ServerActionsTestOtherA-1751677379-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b47d6cefd0d4949bf4c3c0fc72a9cd5',uuid=8a34f0c2-c0b0-4ba7-b9e4-673350a81646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "address": "fa:16:3e:ea:7d:48", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f995853-c3", "ovs_interfaceid": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converting VIF {"id": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "address": "fa:16:3e:ea:7d:48", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f995853-c3", "ovs_interfaceid": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=1f995853-c3f9-41c7-a27b-bf970a21b2b1,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f995853-c3') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.objects.instance [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:02:44 user nova-compute[73469]:   <uuid>8a34f0c2-c0b0-4ba7-b9e4-673350a81646</uuid>
Aug 22 03:02:44 user nova-compute[73469]:   <name>instance-0000001a</name>
Aug 22 03:02:44 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:02:44 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:02:44 user nova-compute[73469]:   <metadata>
Aug 22 03:02:44 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:02:44 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:02:44 user nova-compute[73469]:       <nova:name>tempest-tempest.common.compute-instance-390626074</nova:name>
Aug 22 03:02:44 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:02:44</nova:creationTime>
Aug 22 03:02:44 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:02:44 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:02:44 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:02:44 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:02:44 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:02:44 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:02:44 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:02:44 user nova-compute[73469]:       <nova:owner>
Aug 22 03:02:44 user nova-compute[73469]:         <nova:user uuid="8b47d6cefd0d4949bf4c3c0fc72a9cd5">tempest-ServerActionsTestOtherA-1751677379-project-member</nova:user>
Aug 22 03:02:44 user nova-compute[73469]:         <nova:project uuid="2d1c312e979e47558b06d4fa70bc103a">tempest-ServerActionsTestOtherA-1751677379</nova:project>
Aug 22 03:02:44 user nova-compute[73469]:       </nova:owner>
Aug 22 03:02:44 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:02:44 user nova-compute[73469]:       <nova:ports>
Aug 22 03:02:44 user nova-compute[73469]:         <nova:port uuid="1f995853-c3f9-41c7-a27b-bf970a21b2b1">
Aug 22 03:02:44 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 22 03:02:44 user nova-compute[73469]:         </nova:port>
Aug 22 03:02:44 user nova-compute[73469]:       </nova:ports>
Aug 22 03:02:44 user nova-compute[73469]:     </nova:instance>
Aug 22 03:02:44 user nova-compute[73469]:   </metadata>
Aug 22 03:02:44 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:02:44 user nova-compute[73469]:     <system>
Aug 22 03:02:44 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:02:44 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:02:44 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:02:44 user nova-compute[73469]:       <entry name="serial">8a34f0c2-c0b0-4ba7-b9e4-673350a81646</entry>
Aug 22 03:02:44 user nova-compute[73469]:       <entry name="uuid">8a34f0c2-c0b0-4ba7-b9e4-673350a81646</entry>
Aug 22 03:02:44 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:02:44 user nova-compute[73469]:     </system>
Aug 22 03:02:44 user nova-compute[73469]:   </sysinfo>
Aug 22 03:02:44 user nova-compute[73469]:   <os>
Aug 22 03:02:44 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:02:44 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:02:44 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:02:44 user nova-compute[73469]:   </os>
Aug 22 03:02:44 user nova-compute[73469]:   <features>
Aug 22 03:02:44 user nova-compute[73469]:     <acpi/>
Aug 22 03:02:44 user nova-compute[73469]:     <apic/>
Aug 22 03:02:44 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:02:44 user nova-compute[73469]:   </features>
Aug 22 03:02:44 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:02:44 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:02:44 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:02:44 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:02:44 user nova-compute[73469]:   </clock>
Aug 22 03:02:44 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:02:44 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:02:44 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:02:44 user nova-compute[73469]:   </cpu>
Aug 22 03:02:44 user nova-compute[73469]:   <devices>
Aug 22 03:02:44 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:02:44 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:02:44 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk"/>
Aug 22 03:02:44 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:02:44 user nova-compute[73469]:     </disk>
Aug 22 03:02:44 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:02:44 user nova-compute[73469]:       <mac address="fa:16:3e:ea:7d:48"/>
Aug 22 03:02:44 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:02:44 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:02:44 user nova-compute[73469]:       <target dev="tap1f995853-c3"/>
Aug 22 03:02:44 user nova-compute[73469]:     </interface>
Aug 22 03:02:44 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:02:44 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/console.log" append="off"/>
Aug 22 03:02:44 user nova-compute[73469]:     </serial>
Aug 22 03:02:44 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:02:44 user nova-compute[73469]:     <video>
Aug 22 03:02:44 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:02:44 user nova-compute[73469]:     </video>
Aug 22 03:02:44 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:02:44 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:02:44 user nova-compute[73469]:     </rng>
Aug 22 03:02:44 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:02:44 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:02:44 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:02:44 user nova-compute[73469]:     </memballoon>
Aug 22 03:02:44 user nova-compute[73469]:   </devices>
Aug 22 03:02:44 user nova-compute[73469]: </domain>
Aug 22 03:02:44 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-390626074',display_name='tempest-tempest.common.compute-instance-390626074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-390626074',id=26,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzECYecqxKAclQ13djaYo4aP+GCuiMQsT7a2vxvloQrNEucWhpndrbmJM02phQQyzEVLxT8xdS0cQ40404Hf+pU7LkGlE/TIncY5ZMIWkzlf47Mxz0eWcSZbF35ZQNuTQ==',key_name='tempest-keypair-1030511610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d1c312e979e47558b06d4fa70bc103a',ramdisk_id='',reservation_id='r-iptnxvlr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1751677379',owner_user_name='tempest-ServerActionsTestOtherA-1751677379-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b47d6cefd0d4949bf4c3c0fc72a9cd5',uuid=8a34f0c2-c0b0-4ba7-b9e4-673350a81646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "address": "fa:16:3e:ea:7d:48", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f995853-c3", "ovs_interfaceid": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converting VIF {"id": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "address": "fa:16:3e:ea:7d:48", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f995853-c3", "ovs_interfaceid": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=1f995853-c3f9-41c7-a27b-bf970a21b2b1,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f995853-c3') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG os_vif [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=1f995853-c3f9-41c7-a27b-bf970a21b2b1,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f995853-c3') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f995853-c3, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f995853-c3, col_values=(('external_ids', {'iface-id': '1f995853-c3f9-41c7-a27b-bf970a21b2b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:7d:48', 'vm-uuid': '8a34f0c2-c0b0-4ba7-b9e4-673350a81646'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:44 user nova-compute[73469]: INFO os_vif [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=1f995853-c3f9-41c7-a27b-bf970a21b2b1,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f995853-c3')
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] No VIF found with MAC fa:16:3e:ea:7d:48, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:45 user nova-compute[73469]: DEBUG nova.network.neutron [req-850e7781-6fe2-4949-a0ab-f8231325f9cb req-51a60faf-ea02-4834-8e64-ec0b5723f82b service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Updated VIF entry in instance network info cache for port 1f995853-c3f9-41c7-a27b-bf970a21b2b1. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:02:45 user nova-compute[73469]: DEBUG nova.network.neutron [req-850e7781-6fe2-4949-a0ab-f8231325f9cb req-51a60faf-ea02-4834-8e64-ec0b5723f82b service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Updating instance_info_cache with network_info: [{"id": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "address": "fa:16:3e:ea:7d:48", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f995853-c3", "ovs_interfaceid": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:02:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-850e7781-6fe2-4949-a0ab-f8231325f9cb req-51a60faf-ea02-4834-8e64-ec0b5723f82b service nova] Releasing lock "refresh_cache-8a34f0c2-c0b0-4ba7-b9e4-673350a81646" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:02:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG nova.compute.manager [req-b7c21648-102f-4feb-aaba-7d7100e61544 req-afcec7b7-2a3c-4ea1-ba82-9774053c0e85 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received event network-vif-plugged-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b7c21648-102f-4feb-aaba-7d7100e61544 req-afcec7b7-2a3c-4ea1-ba82-9774053c0e85 service nova] Acquiring lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b7c21648-102f-4feb-aaba-7d7100e61544 req-afcec7b7-2a3c-4ea1-ba82-9774053c0e85 service nova] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b7c21648-102f-4feb-aaba-7d7100e61544 req-afcec7b7-2a3c-4ea1-ba82-9774053c0e85 service nova] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG nova.compute.manager [req-b7c21648-102f-4feb-aaba-7d7100e61544 req-afcec7b7-2a3c-4ea1-ba82-9774053c0e85 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] No waiting events found dispatching network-vif-plugged-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:02:46 user nova-compute[73469]: WARNING nova.compute.manager [req-b7c21648-102f-4feb-aaba-7d7100e61544 req-afcec7b7-2a3c-4ea1-ba82-9774053c0e85 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received unexpected event network-vif-plugged-4697b7dd-3290-45e0-baa6-01e13c682505 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 22 03:02:46 user nova-compute[73469]: DEBUG nova.compute.manager [req-b7c21648-102f-4feb-aaba-7d7100e61544 req-afcec7b7-2a3c-4ea1-ba82-9774053c0e85 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received event network-vif-plugged-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b7c21648-102f-4feb-aaba-7d7100e61544 req-afcec7b7-2a3c-4ea1-ba82-9774053c0e85 service nova] Acquiring lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b7c21648-102f-4feb-aaba-7d7100e61544 req-afcec7b7-2a3c-4ea1-ba82-9774053c0e85 service nova] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b7c21648-102f-4feb-aaba-7d7100e61544 req-afcec7b7-2a3c-4ea1-ba82-9774053c0e85 service nova] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG nova.compute.manager [req-b7c21648-102f-4feb-aaba-7d7100e61544 req-afcec7b7-2a3c-4ea1-ba82-9774053c0e85 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] No waiting events found dispatching network-vif-plugged-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:02:46 user nova-compute[73469]: WARNING nova.compute.manager [req-b7c21648-102f-4feb-aaba-7d7100e61544 req-afcec7b7-2a3c-4ea1-ba82-9774053c0e85 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received unexpected event network-vif-plugged-4697b7dd-3290-45e0-baa6-01e13c682505 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 22 03:02:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:02:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:02:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673368.7461874, d8433c45-b889-4a7b-88c2-ba00679b1d26 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:02:49 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] VM Resumed (Lifecycle Event)
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-666f8b66-a11f-43cc-92b3-098a2efa7e16 req-945f8ea4-7142-4e3f-936c-640576dbb997 service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Received event network-vif-plugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-666f8b66-a11f-43cc-92b3-098a2efa7e16 req-945f8ea4-7142-4e3f-936c-640576dbb997 service nova] Acquiring lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-666f8b66-a11f-43cc-92b3-098a2efa7e16 req-945f8ea4-7142-4e3f-936c-640576dbb997 service nova] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-666f8b66-a11f-43cc-92b3-098a2efa7e16 req-945f8ea4-7142-4e3f-936c-640576dbb997 service nova] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-666f8b66-a11f-43cc-92b3-098a2efa7e16 req-945f8ea4-7142-4e3f-936c-640576dbb997 service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] No waiting events found dispatching network-vif-plugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:02:49 user nova-compute[73469]: WARNING nova.compute.manager [req-666f8b66-a11f-43cc-92b3-098a2efa7e16 req-945f8ea4-7142-4e3f-936c-640576dbb997 service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Received unexpected event network-vif-plugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 for instance with vm_state building and task_state spawning.
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-666f8b66-a11f-43cc-92b3-098a2efa7e16 req-945f8ea4-7142-4e3f-936c-640576dbb997 service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Received event network-vif-plugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-666f8b66-a11f-43cc-92b3-098a2efa7e16 req-945f8ea4-7142-4e3f-936c-640576dbb997 service nova] Acquiring lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-666f8b66-a11f-43cc-92b3-098a2efa7e16 req-945f8ea4-7142-4e3f-936c-640576dbb997 service nova] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-666f8b66-a11f-43cc-92b3-098a2efa7e16 req-945f8ea4-7142-4e3f-936c-640576dbb997 service nova] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-666f8b66-a11f-43cc-92b3-098a2efa7e16 req-945f8ea4-7142-4e3f-936c-640576dbb997 service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] No waiting events found dispatching network-vif-plugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:02:49 user nova-compute[73469]: WARNING nova.compute.manager [req-666f8b66-a11f-43cc-92b3-098a2efa7e16 req-945f8ea4-7142-4e3f-936c-640576dbb997 service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Received unexpected event network-vif-plugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 for instance with vm_state building and task_state spawning.
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:02:49 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:02:49 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=7211MB free_disk=24.969268798828125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:49 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Instance spawned successfully.
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:02:49 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673368.7468984, d8433c45-b889-4a7b-88c2-ba00679b1d26 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:02:49 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] VM Started (Lifecycle Event)
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:02:49 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673369.2778552, 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:02:49 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] VM Resumed (Lifecycle Event)
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:02:49 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Instance spawned successfully.
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Applying migration context for instance 5984759d-28f1-45e8-bb4c-27bd8df426f4 as it has an incoming, in-progress migration ab7a6a11-e343-4905-bf2e-fd016f6a6cf7. Migration status is finished {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 22 03:02:49 user nova-compute[73469]: INFO nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Updating resource usage from migration ab7a6a11-e343-4905-bf2e-fd016f6a6cf7
Aug 22 03:02:49 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673369.2815452, 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:02:49 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] VM Started (Lifecycle Event)
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d0668c0-7a49-4857-9b69-541021f18ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance dc3f5545-8ebb-4947-97d0-98a91f67e421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8242cec1-3b35-4d14-9e0b-db8a7e75697d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 2e621408-a0af-460b-80a2-3446b5f1aadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82e872a7-70b0-4290-9a11-5316765aed01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 20316a2a-2f1f-4008-ab14-551e627bf680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 980e57bf-dec9-46f3-8d69-e20a17603af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 0d5a30d1-565c-47c9-8caa-84dab130e117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Migration ab7a6a11-e343-4905-bf2e-fd016f6a6cf7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 5984759d-28f1-45e8-bb4c-27bd8df426f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 4765dbfc-4219-4797-b40f-24698fa033bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:02:49 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:02:49 user nova-compute[73469]: INFO nova.compute.manager [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Took 7.65 seconds to spawn the instance on the hypervisor.
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8bdd15d7-f182-45ef-9360-f0f395f03d64 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.972s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:49 user nova-compute[73469]: INFO nova.compute.manager [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Took 9.10 seconds to build instance.
Aug 22 03:02:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-91401217-c117-40d1-83bc-4990dd808ff2 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.313s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:02:49 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:02:50 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:02:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.865s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:51 user nova-compute[73469]: INFO nova.compute.manager [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Detaching volume 27716b1b-781f-47e7-992b-7521fda49ee3
Aug 22 03:02:51 user nova-compute[73469]: INFO nova.virt.block_device [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Attempting to driver detach volume 27716b1b-781f-47e7-992b-7521fda49ee3 from mountpoint /dev/vdb
Aug 22 03:02:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Attempting to detach device vdb from instance 2e621408-a0af-460b-80a2-3446b5f1aadb from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:02:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:02:51 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:02:51 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:02:51 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:02:51 user nova-compute[73469]:   <serial>27716b1b-781f-47e7-992b-7521fda49ee3</serial>
Aug 22 03:02:51 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 22 03:02:51 user nova-compute[73469]: </disk>
Aug 22 03:02:51 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:02:51 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Successfully detached device vdb from instance 2e621408-a0af-460b-80a2-3446b5f1aadb from the persistent domain config.
Aug 22 03:02:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2e621408-a0af-460b-80a2-3446b5f1aadb from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:02:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:02:51 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:02:51 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:02:51 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:02:51 user nova-compute[73469]:   <serial>27716b1b-781f-47e7-992b-7521fda49ee3</serial>
Aug 22 03:02:51 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 22 03:02:51 user nova-compute[73469]: </disk>
Aug 22 03:02:51 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:02:51 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:02:51 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:02:51 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:02:51 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692673372.3217876, 2e621408-a0af-460b-80a2-3446b5f1aadb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:02:52 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Successfully detached device vdb from instance 2e621408-a0af-460b-80a2-3446b5f1aadb from the live domain config.
Aug 22 03:02:52 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjUoOpBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:02:52 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:02:52 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1d4af7-06c0-4557-9dd5-8c2d358526d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a5142d-03f7-41ba-9ad5-e1b1809cb870]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:02:52 user nova-compute[73469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:02:52 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:02:52 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:02:52 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:02:52 user nova-compute[73469]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 (non-flash)
Aug 22 03:02:52 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:02:52 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:02:52 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a41cc8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[debbf343-d010-43f2-9bfb-f2a19f57acd7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8785efc3-ca3a-49d6-b59e-87124739cef7]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[32205b26-310b-447d-bee4-d07322739484]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88b9519-87d4-42f8-9d72-e6da90d290d8]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fc588f-8292-4c53-924c-7bca2ee4ab3f]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a74693c-3742-4cf5-8baa-53c11635b3a1]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3, portal: 172.16.0.220,3260]
Aug 22 03:02:52 user nova-compute[73469]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3, portal: 172.16.0.220,3260] successful.
Aug 22 03:02:52 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27716b1b-781f-47e7-992b-7521fda49ee3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28a786e-87d3-4b0c-9b18-a8bbc91eac70]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] <== disconnect_volume: return (330ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:02:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:53 user nova-compute[73469]: DEBUG nova.objects.instance [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'flavor' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:02:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-92fc20b3-2a12-4d6c-a6ef-3237fcdbd2eb tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.166s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b498f32c-29ed-4e42-86a5-ee1996c5743a tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b498f32c-29ed-4e42-86a5-ee1996c5743a tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:53 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b498f32c-29ed-4e42-86a5-ee1996c5743a tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:02:53 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b498f32c-29ed-4e42-86a5-ee1996c5743a tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73469) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 22 03:02:53 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b498f32c-29ed-4e42-86a5-ee1996c5743a tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'flavor' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:02:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:54 user nova-compute[73469]: DEBUG nova.compute.manager [req-06eac52a-da66-4065-8d51-dfc46fd6827c req-57a95a59-2edc-4387-8299-65348f5cc6e9 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received event network-vif-unplugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:02:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-06eac52a-da66-4065-8d51-dfc46fd6827c req-57a95a59-2edc-4387-8299-65348f5cc6e9 service nova] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-06eac52a-da66-4065-8d51-dfc46fd6827c req-57a95a59-2edc-4387-8299-65348f5cc6e9 service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-06eac52a-da66-4065-8d51-dfc46fd6827c req-57a95a59-2edc-4387-8299-65348f5cc6e9 service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:54 user nova-compute[73469]: DEBUG nova.compute.manager [req-06eac52a-da66-4065-8d51-dfc46fd6827c req-57a95a59-2edc-4387-8299-65348f5cc6e9 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] No waiting events found dispatching network-vif-unplugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:02:54 user nova-compute[73469]: WARNING nova.compute.manager [req-06eac52a-da66-4065-8d51-dfc46fd6827c req-57a95a59-2edc-4387-8299-65348f5cc6e9 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received unexpected event network-vif-unplugged-1b3de561-7dd1-4d48-8932-05c4e4770538 for instance with vm_state active and task_state powering-off.
Aug 22 03:02:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Instance destroyed successfully.
Aug 22 03:02:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b498f32c-29ed-4e42-86a5-ee1996c5743a tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:02:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b498f32c-29ed-4e42-86a5-ee1996c5743a tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.960s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:56 user nova-compute[73469]: DEBUG nova.compute.manager [req-c3c6e110-0e41-42c0-868d-61b973903775 req-a06ee658-a2ea-4df3-bb48-9de08ebfb903 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received event network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:02:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c3c6e110-0e41-42c0-868d-61b973903775 req-a06ee658-a2ea-4df3-bb48-9de08ebfb903 service nova] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:02:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c3c6e110-0e41-42c0-868d-61b973903775 req-a06ee658-a2ea-4df3-bb48-9de08ebfb903 service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:02:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c3c6e110-0e41-42c0-868d-61b973903775 req-a06ee658-a2ea-4df3-bb48-9de08ebfb903 service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:02:56 user nova-compute[73469]: DEBUG nova.compute.manager [req-c3c6e110-0e41-42c0-868d-61b973903775 req-a06ee658-a2ea-4df3-bb48-9de08ebfb903 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] No waiting events found dispatching network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:02:56 user nova-compute[73469]: WARNING nova.compute.manager [req-c3c6e110-0e41-42c0-868d-61b973903775 req-a06ee658-a2ea-4df3-bb48-9de08ebfb903 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received unexpected event network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 for instance with vm_state stopped and task_state None.
Aug 22 03:02:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:02:59 user nova-compute[73469]: INFO nova.virt.block_device [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Booting with volume 7d2e5a9d-39c1-4c82-ba9f-070343bb317b at /dev/vdb
Aug 22 03:02:59 user nova-compute[73469]: DEBUG os_brick.utils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9e3659-8020-4886-a7a5-0d1bc0a26e9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1248fe6-45ca-44ba-b8c5-dfa8ba414824]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce02298a-816d-4b2f-b718-346bdb1639cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c267367-91f9-4f1b-8269-3b9fd2b3dc83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:02:59 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:02:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c6f917-c50c-4354-b552-f853c82eed1b]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG os_brick.utils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updating existing volume attachment record: f7907258-92d8-44b3-9b04-d225cf6f626c {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:02:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:04 user nova-compute[73469]: DEBUG nova.compute.manager [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:03:04 user nova-compute[73469]: INFO nova.compute.manager [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] instance snapshotting
Aug 22 03:03:04 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Beginning live snapshot process
Aug 22 03:03:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json -f qcow2 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json -f qcow2 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.198s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd7gwf7jb/83f3a3e03cd24e3a9f4b9823497c7815.delta 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd7gwf7jb/83f3a3e03cd24e3a9f4b9823497c7815.delta 1073741824" returned: 0 in 0.055s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:05 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 22 03:03:05 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 03:03:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 03:03:06 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 22 03:03:06 user nova-compute[73469]: DEBUG nova.privsep.utils [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 22 03:03:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd7gwf7jb/83f3a3e03cd24e3a9f4b9823497c7815.delta /opt/stack/data/nova/instances/snapshots/tmpd7gwf7jb/83f3a3e03cd24e3a9f4b9823497c7815 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd7gwf7jb/83f3a3e03cd24e3a9f4b9823497c7815.delta /opt/stack/data/nova/instances/snapshots/tmpd7gwf7jb/83f3a3e03cd24e3a9f4b9823497c7815" returned: 0 in 0.501s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:07 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Snapshot extracted, beginning image upload
Aug 22 03:03:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-4fec2492-d5c3-46b9-ac63-0f2cd68e2eb7 req-f70647a1-b4e0-4db1-afaa-e1c787e8577f service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received event network-changed-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-4fec2492-d5c3-46b9-ac63-0f2cd68e2eb7 req-f70647a1-b4e0-4db1-afaa-e1c787e8577f service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Refreshing instance network info cache due to event network-changed-a64e4e29-61af-465a-8dc2-b8851274e0d9. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4fec2492-d5c3-46b9-ac63-0f2cd68e2eb7 req-f70647a1-b4e0-4db1-afaa-e1c787e8577f service nova] Acquiring lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4fec2492-d5c3-46b9-ac63-0f2cd68e2eb7 req-f70647a1-b4e0-4db1-afaa-e1c787e8577f service nova] Acquired lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG nova.network.neutron [req-4fec2492-d5c3-46b9-ac63-0f2cd68e2eb7 req-f70647a1-b4e0-4db1-afaa-e1c787e8577f service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Refreshing network info cache for port a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG nova.objects.instance [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'flavor' on Instance uuid f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:07 user nova-compute[73469]: INFO nova.compute.manager [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Attaching volume f057580b-77c4-4835-99ac-6fc720392834 to /dev/vdb
Aug 22 03:03:07 user nova-compute[73469]: DEBUG os_brick.utils [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16da673-a633-43d4-9791-13eb87585d0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be4f582-95e5-4d61-b9bb-295467426bf4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcb8c4e-735e-4df2-9458-c818f693a606]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ac803d-cacc-418f-a972-052b8892e0b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:03:07 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:03:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7ad05f-975c-49cf-9211-ff9dcf989e21]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG os_brick.utils [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Updating existing volume attachment record: 22fb1172-7a14-4fef-9ac6-8f5dbeea6660 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:03:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:08 user nova-compute[73469]: DEBUG nova.network.neutron [req-4fec2492-d5c3-46b9-ac63-0f2cd68e2eb7 req-f70647a1-b4e0-4db1-afaa-e1c787e8577f service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Updated VIF entry in instance network info cache for port a64e4e29-61af-465a-8dc2-b8851274e0d9. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:03:08 user nova-compute[73469]: DEBUG nova.network.neutron [req-4fec2492-d5c3-46b9-ac63-0f2cd68e2eb7 req-f70647a1-b4e0-4db1-afaa-e1c787e8577f service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Updating instance_info_cache with network_info: [{"id": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "address": "fa:16:3e:63:38:91", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e4e29-61", "ovs_interfaceid": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:03:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4fec2492-d5c3-46b9-ac63-0f2cd68e2eb7 req-f70647a1-b4e0-4db1-afaa-e1c787e8577f service nova] Releasing lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:03:09 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Snapshot image upload complete
Aug 22 03:03:09 user nova-compute[73469]: INFO nova.compute.manager [None req-0d52d0cd-7488-4524-a603-11bdcfb037a0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Took 5.57 seconds to snapshot the instance on the hypervisor.
Aug 22 03:03:09 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673374.7956336, 2e621408-a0af-460b-80a2-3446b5f1aadb => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:03:09 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] VM Stopped (Lifecycle Event)
Aug 22 03:03:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:09 user nova-compute[73469]: DEBUG nova.compute.manager [None req-8f79e4b1-8168-4fe0-bed6-3998e5168f0c None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:03:09 user nova-compute[73469]: DEBUG nova.compute.manager [None req-8f79e4b1-8168-4fe0-bed6-3998e5168f0c None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:03:11 user nova-compute[73469]: INFO nova.virt.block_device [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Booting with volume eb9fb33f-c49f-487a-8f13-5c8dc20134fa at /dev/vdc
Aug 22 03:03:11 user nova-compute[73469]: DEBUG os_brick.utils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63fc058-cda9-4f71-b21d-efa26e3cc423]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef7f821-fc7e-41c0-93c0-906c4712d89f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7a8d36-2791-436d-9bb8-e46422619fac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe103ac-9e5a-4b58-9a9b-ea091b8277bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:03:11 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:03:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa9018f-afe3-446d-9414-04ec5084d3f7]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG os_brick.utils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:03:11 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updating existing volume attachment record: 761c7914-1ee9-4cbd-ad54-274fc7b9063d {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:03:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "0d5a30d1-565c-47c9-8caa-84dab130e117" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG nova.objects.instance [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lazy-loading 'flavor' on Instance uuid 0d5a30d1-565c-47c9-8caa-84dab130e117 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "0d5a30d1-565c-47c9-8caa-84dab130e117" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:17 user nova-compute[73469]: INFO nova.compute.manager [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Attaching volume 83bb2eca-4fba-475b-9cd5-70fc9996656b to /dev/vdb
Aug 22 03:03:17 user nova-compute[73469]: DEBUG os_brick.utils [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b737d387-611c-4d7b-87b3-9cc0f7ead0c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f9fe25-f450-4248-a012-57dd64889fca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1f61f0-d92a-4dd1-a336-84bd6a65f851]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdabaa7-9b85-4f4a-b93c-5c2927b9303e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:03:17 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:03:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7219610-5040-4b07-a579-22fabd9019f3]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG os_brick.utils [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Updating existing volume attachment record: 36a3dcf6-6037-416c-8813-988f81ecb5d5 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:03:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Acquiring lock "84706228-0050-49ac-886a-70842ce8dd3b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "84706228-0050-49ac-886a-70842ce8dd3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:19 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:03:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:19 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:03:19 user nova-compute[73469]: INFO nova.compute.claims [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Claim successful on node user
Aug 22 03:03:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:19 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:03:19 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:03:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:03:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCnATKjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:03:19 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:03:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:03:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:03:19 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:03:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:03:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:03:19 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:03:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:19 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9140ad6c-1f26-4bb2-842a-c37269bea53c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:03:20 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae80b27-cce1-4735-8a79-47a91d479eed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834] added
Aug 22 03:03:20 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d902e7f-91e1-4044-8e27-bbc36a5e05dc]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:20 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa91292-5876-46bd-a6a7-3536d4d3deca]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XCnATKjF {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XCnATKjF" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b98cfe9-ef0f-4438-9623-724d1a24a809]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XCnATKjF'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cdb60f-30b2-453d-8f94-f7c90e97abbf]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG nova.policy [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11a02c5d43844c22b85222961c574da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc0a68689c648639c37755526bee4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfad867-7428-4cec-98ce-2502b5e43018]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:20 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:20 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:20 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:20 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:20 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:20 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:03:20 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Creating image(s)
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Acquiring lock "/opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "/opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "/opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f6ec9e-5f02-418e-a199-f261b8c6e8f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834, portal: 172.16.0.220,3260]
Aug 22 03:03:20 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834, portal: 172.16.0.220,3260] successful.
Aug 22 03:03:20 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[09216845-f472-478a-99a7-ec952069de31]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3911dc83-8523-42b8-9024-58171d0e326a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:20 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:20 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:20 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:20 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:20 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:20 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:20 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:20 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacecd8a-c8bf-41ff-97bd-2f5e10bdcbbf]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.190s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk 1073741824" returned: 0 in 0.053s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.200s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:03:20 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:21 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Cannot resize image /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:03:21 user nova-compute[73469]: DEBUG nova.objects.instance [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lazy-loading 'migration_context' on Instance uuid 84706228-0050-49ac-886a-70842ce8dd3b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:03:21 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:03:21 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Ensure instance console log exists: /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:03:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:21 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Successfully created port: aa11f705-d214-422e-8d55-988560948a37 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:03:21 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:03:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCnATKjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:03:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:03:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '23638313834656262', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:03:21 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638313834656262', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:03:21 user nova-compute[73469]: DEBUG nova.objects.instance [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'flavor' on Instance uuid f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:03:21 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:03:21 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:03:21 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:03:21 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:03:21 user nova-compute[73469]:   <serial>f057580b-77c4-4835-99ac-6fc720392834</serial>
Aug 22 03:03:21 user nova-compute[73469]: </disk>
Aug 22 03:03:21 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:03:21 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:03:21 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:03:21 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] No VIF found with MAC fa:16:3e:63:38:91, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-60c40cd8-269c-42cb-9f63-c9a56a71b285 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.332s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Successfully updated port: aa11f705-d214-422e-8d55-988560948a37 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Acquiring lock "refresh_cache-84706228-0050-49ac-886a-70842ce8dd3b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Acquired lock "refresh_cache-84706228-0050-49ac-886a-70842ce8dd3b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.compute.manager [req-fd235676-f6e4-4a26-a867-3989d613271d req-c234d627-fd19-4a6a-98c6-a148eaa46fdc service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Received event network-changed-aa11f705-d214-422e-8d55-988560948a37 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.compute.manager [req-fd235676-f6e4-4a26-a867-3989d613271d req-c234d627-fd19-4a6a-98c6-a148eaa46fdc service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Refreshing instance network info cache due to event network-changed-aa11f705-d214-422e-8d55-988560948a37. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fd235676-f6e4-4a26-a867-3989d613271d req-c234d627-fd19-4a6a-98c6-a148eaa46fdc service nova] Acquiring lock "refresh_cache-84706228-0050-49ac-886a-70842ce8dd3b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:03:22 user nova-compute[73469]: INFO nova.compute.manager [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Rescuing
Aug 22 03:03:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquired lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.network.neutron [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Updating instance_info_cache with network_info: [{"id": "aa11f705-d214-422e-8d55-988560948a37", "address": "fa:16:3e:69:bb:e0", "network": {"id": "a19cffdb-7658-4fa9-bbfd-2bd8c7d18e33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-386471556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc0a68689c648639c37755526bee4fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa11f705-d2", "ovs_interfaceid": "aa11f705-d214-422e-8d55-988560948a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Releasing lock "refresh_cache-84706228-0050-49ac-886a-70842ce8dd3b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Instance network_info: |[{"id": "aa11f705-d214-422e-8d55-988560948a37", "address": "fa:16:3e:69:bb:e0", "network": {"id": "a19cffdb-7658-4fa9-bbfd-2bd8c7d18e33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-386471556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc0a68689c648639c37755526bee4fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa11f705-d2", "ovs_interfaceid": "aa11f705-d214-422e-8d55-988560948a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fd235676-f6e4-4a26-a867-3989d613271d req-c234d627-fd19-4a6a-98c6-a148eaa46fdc service nova] Acquired lock "refresh_cache-84706228-0050-49ac-886a-70842ce8dd3b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.network.neutron [req-fd235676-f6e4-4a26-a867-3989d613271d req-c234d627-fd19-4a6a-98c6-a148eaa46fdc service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Refreshing network info cache for port aa11f705-d214-422e-8d55-988560948a37 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Start _get_guest_xml network_info=[{"id": "aa11f705-d214-422e-8d55-988560948a37", "address": "fa:16:3e:69:bb:e0", "network": {"id": "a19cffdb-7658-4fa9-bbfd-2bd8c7d18e33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-386471556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc0a68689c648639c37755526bee4fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa11f705-d2", "ovs_interfaceid": "aa11f705-d214-422e-8d55-988560948a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:03:22 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:03:22 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2112280286',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2112280286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2112280',id=27,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZOSUOHjEWx5VIL7Hm2trZIdpAJEAmt7u83C+t35dlBV1TWa2pg7AG7YhazzQoZc9wN9MzXwb0vhQNLk/GAsxAd/efSI9Xh0WUzoOFSkc+86a1VXpj5tSSnKOHwIJYUbg==',key_name='tempest-keypair-1577026713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efc0a68689c648639c37755526bee4fd',ramdisk_id='',reservation_id='r-19e2c9ua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-521618217',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:03:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11a02c5d43844c22b85222961c574da0',uuid=84706228-0050-49ac-886a-70842ce8dd3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa11f705-d214-422e-8d55-988560948a37", "address": "fa:16:3e:69:bb:e0", "network": {"id": "a19cffdb-7658-4fa9-bbfd-2bd8c7d18e33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-386471556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc0a68689c648639c37755526bee4fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa11f705-d2", "ovs_interfaceid": "aa11f705-d214-422e-8d55-988560948a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Converting VIF {"id": "aa11f705-d214-422e-8d55-988560948a37", "address": "fa:16:3e:69:bb:e0", "network": {"id": "a19cffdb-7658-4fa9-bbfd-2bd8c7d18e33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-386471556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc0a68689c648639c37755526bee4fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa11f705-d2", "ovs_interfaceid": "aa11f705-d214-422e-8d55-988560948a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:bb:e0,bridge_name='br-int',has_traffic_filtering=True,id=aa11f705-d214-422e-8d55-988560948a37,network=Network(a19cffdb-7658-4fa9-bbfd-2bd8c7d18e33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa11f705-d2') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.objects.instance [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lazy-loading 'pci_devices' on Instance uuid 84706228-0050-49ac-886a-70842ce8dd3b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:03:22 user nova-compute[73469]:   <uuid>84706228-0050-49ac-886a-70842ce8dd3b</uuid>
Aug 22 03:03:22 user nova-compute[73469]:   <name>instance-0000001b</name>
Aug 22 03:03:22 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:03:22 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:03:22 user nova-compute[73469]:   <metadata>
Aug 22 03:03:22 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:03:22 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:03:22 user nova-compute[73469]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-2112280286</nova:name>
Aug 22 03:03:22 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:03:22</nova:creationTime>
Aug 22 03:03:22 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:03:22 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:03:22 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:03:22 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:03:22 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:03:22 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:03:22 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:03:22 user nova-compute[73469]:       <nova:owner>
Aug 22 03:03:22 user nova-compute[73469]:         <nova:user uuid="11a02c5d43844c22b85222961c574da0">tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member</nova:user>
Aug 22 03:03:22 user nova-compute[73469]:         <nova:project uuid="efc0a68689c648639c37755526bee4fd">tempest-TestServerVolumeAttachScenarioOldVersion-521618217</nova:project>
Aug 22 03:03:22 user nova-compute[73469]:       </nova:owner>
Aug 22 03:03:22 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:03:22 user nova-compute[73469]:       <nova:ports>
Aug 22 03:03:22 user nova-compute[73469]:         <nova:port uuid="aa11f705-d214-422e-8d55-988560948a37">
Aug 22 03:03:22 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 22 03:03:22 user nova-compute[73469]:         </nova:port>
Aug 22 03:03:22 user nova-compute[73469]:       </nova:ports>
Aug 22 03:03:22 user nova-compute[73469]:     </nova:instance>
Aug 22 03:03:22 user nova-compute[73469]:   </metadata>
Aug 22 03:03:22 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:03:22 user nova-compute[73469]:     <system>
Aug 22 03:03:22 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:03:22 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:03:22 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:03:22 user nova-compute[73469]:       <entry name="serial">84706228-0050-49ac-886a-70842ce8dd3b</entry>
Aug 22 03:03:22 user nova-compute[73469]:       <entry name="uuid">84706228-0050-49ac-886a-70842ce8dd3b</entry>
Aug 22 03:03:22 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:03:22 user nova-compute[73469]:     </system>
Aug 22 03:03:22 user nova-compute[73469]:   </sysinfo>
Aug 22 03:03:22 user nova-compute[73469]:   <os>
Aug 22 03:03:22 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:03:22 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:03:22 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:03:22 user nova-compute[73469]:   </os>
Aug 22 03:03:22 user nova-compute[73469]:   <features>
Aug 22 03:03:22 user nova-compute[73469]:     <acpi/>
Aug 22 03:03:22 user nova-compute[73469]:     <apic/>
Aug 22 03:03:22 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:03:22 user nova-compute[73469]:   </features>
Aug 22 03:03:22 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:03:22 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:03:22 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:03:22 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:03:22 user nova-compute[73469]:   </clock>
Aug 22 03:03:22 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:03:22 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:03:22 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:03:22 user nova-compute[73469]:   </cpu>
Aug 22 03:03:22 user nova-compute[73469]:   <devices>
Aug 22 03:03:22 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:03:22 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:03:22 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk"/>
Aug 22 03:03:22 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:03:22 user nova-compute[73469]:     </disk>
Aug 22 03:03:22 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:03:22 user nova-compute[73469]:       <mac address="fa:16:3e:69:bb:e0"/>
Aug 22 03:03:22 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:03:22 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:03:22 user nova-compute[73469]:       <target dev="tapaa11f705-d2"/>
Aug 22 03:03:22 user nova-compute[73469]:     </interface>
Aug 22 03:03:22 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:03:22 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/console.log" append="off"/>
Aug 22 03:03:22 user nova-compute[73469]:     </serial>
Aug 22 03:03:22 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:03:22 user nova-compute[73469]:     <video>
Aug 22 03:03:22 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:03:22 user nova-compute[73469]:     </video>
Aug 22 03:03:22 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:03:22 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:03:22 user nova-compute[73469]:     </rng>
Aug 22 03:03:22 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:03:22 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:03:22 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:03:22 user nova-compute[73469]:     </memballoon>
Aug 22 03:03:22 user nova-compute[73469]:   </devices>
Aug 22 03:03:22 user nova-compute[73469]: </domain>
Aug 22 03:03:22 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2112280286',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2112280286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2112280',id=27,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZOSUOHjEWx5VIL7Hm2trZIdpAJEAmt7u83C+t35dlBV1TWa2pg7AG7YhazzQoZc9wN9MzXwb0vhQNLk/GAsxAd/efSI9Xh0WUzoOFSkc+86a1VXpj5tSSnKOHwIJYUbg==',key_name='tempest-keypair-1577026713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efc0a68689c648639c37755526bee4fd',ramdisk_id='',reservation_id='r-19e2c9ua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-521618217',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:03:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11a02c5d43844c22b85222961c574da0',uuid=84706228-0050-49ac-886a-70842ce8dd3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa11f705-d214-422e-8d55-988560948a37", "address": "fa:16:3e:69:bb:e0", "network": {"id": "a19cffdb-7658-4fa9-bbfd-2bd8c7d18e33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-386471556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc0a68689c648639c37755526bee4fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa11f705-d2", "ovs_interfaceid": "aa11f705-d214-422e-8d55-988560948a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Converting VIF {"id": "aa11f705-d214-422e-8d55-988560948a37", "address": "fa:16:3e:69:bb:e0", "network": {"id": "a19cffdb-7658-4fa9-bbfd-2bd8c7d18e33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-386471556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc0a68689c648639c37755526bee4fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa11f705-d2", "ovs_interfaceid": "aa11f705-d214-422e-8d55-988560948a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:bb:e0,bridge_name='br-int',has_traffic_filtering=True,id=aa11f705-d214-422e-8d55-988560948a37,network=Network(a19cffdb-7658-4fa9-bbfd-2bd8c7d18e33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa11f705-d2') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG os_vif [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:bb:e0,bridge_name='br-int',has_traffic_filtering=True,id=aa11f705-d214-422e-8d55-988560948a37,network=Network(a19cffdb-7658-4fa9-bbfd-2bd8c7d18e33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa11f705-d2') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa11f705-d2, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaa11f705-d2, col_values=(('external_ids', {'iface-id': 'aa11f705-d214-422e-8d55-988560948a37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:bb:e0', 'vm-uuid': '84706228-0050-49ac-886a-70842ce8dd3b'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:22 user nova-compute[73469]: INFO os_vif [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:bb:e0,bridge_name='br-int',has_traffic_filtering=True,id=aa11f705-d214-422e-8d55-988560948a37,network=Network(a19cffdb-7658-4fa9-bbfd-2bd8c7d18e33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa11f705-d2')
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] No VIF found with MAC fa:16:3e:69:bb:e0, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:03:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:23 user nova-compute[73469]: DEBUG nova.network.neutron [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Updating instance_info_cache with network_info: [{"id": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "address": "fa:16:3e:63:38:91", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e4e29-61", "ovs_interfaceid": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:03:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Releasing lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:03:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:23 user nova-compute[73469]: DEBUG nova.network.neutron [req-fd235676-f6e4-4a26-a867-3989d613271d req-c234d627-fd19-4a6a-98c6-a148eaa46fdc service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Updated VIF entry in instance network info cache for port aa11f705-d214-422e-8d55-988560948a37. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:03:23 user nova-compute[73469]: DEBUG nova.network.neutron [req-fd235676-f6e4-4a26-a867-3989d613271d req-c234d627-fd19-4a6a-98c6-a148eaa46fdc service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Updating instance_info_cache with network_info: [{"id": "aa11f705-d214-422e-8d55-988560948a37", "address": "fa:16:3e:69:bb:e0", "network": {"id": "a19cffdb-7658-4fa9-bbfd-2bd8c7d18e33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-386471556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc0a68689c648639c37755526bee4fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa11f705-d2", "ovs_interfaceid": "aa11f705-d214-422e-8d55-988560948a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:03:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fd235676-f6e4-4a26-a867-3989d613271d req-c234d627-fd19-4a6a-98c6-a148eaa46fdc service nova] Releasing lock "refresh_cache-84706228-0050-49ac-886a-70842ce8dd3b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:03:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-ac673721-8747-4380-99de-acae69801aa4 req-a70a1f68-ba29-49bf-879b-9906c7a90f67 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received event network-vif-unplugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ac673721-8747-4380-99de-acae69801aa4 req-a70a1f68-ba29-49bf-879b-9906c7a90f67 service nova] Acquiring lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ac673721-8747-4380-99de-acae69801aa4 req-a70a1f68-ba29-49bf-879b-9906c7a90f67 service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ac673721-8747-4380-99de-acae69801aa4 req-a70a1f68-ba29-49bf-879b-9906c7a90f67 service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-ac673721-8747-4380-99de-acae69801aa4 req-a70a1f68-ba29-49bf-879b-9906c7a90f67 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] No waiting events found dispatching network-vif-unplugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:23 user nova-compute[73469]: WARNING nova.compute.manager [req-ac673721-8747-4380-99de-acae69801aa4 req-a70a1f68-ba29-49bf-879b-9906c7a90f67 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received unexpected event network-vif-unplugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 for instance with vm_state active and task_state rescuing.
Aug 22 03:03:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:24 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Instance destroyed successfully.
Aug 22 03:03:24 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Attempting rescue
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73469) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Instance directory exists: not creating {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 22 03:03:24 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Creating image(s)
Aug 22 03:03:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "/opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "/opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.objects.instance [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'trusted_certs' on Instance uuid f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk.rescue {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk.rescue" returned: 0 in 0.081s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.objects.instance [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'migration_context' on Instance uuid f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Start _get_guest_xml network_info=[{"id": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "address": "fa:16:3e:63:38:91", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "vif_mac": "fa:16:3e:63:38:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e4e29-61", "ovs_interfaceid": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.objects.instance [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'resources' on Instance uuid f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.objects.instance [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'numa_topology' on Instance uuid f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:24 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:03:24 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.objects.instance [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'vcpu_model' on Instance uuid f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1462217807',display_name='tempest-ServerRescueNegativeTestJSON-server-1462217807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1462217807',id=23,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXw+HABhLBLO82NaXM+wYITZ8kjjO4fDBfHrNaHircMbmq0ESPsalj62yNCub693ZB2AUl++bx/zlIxp/KOGwsJTgZa2DcddLoD4LicVmrTqVCS4jc8imCsGBLvay+cPA==',key_name='tempest-keypair-188206931',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:01:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46cd52eb0f2642bc95dbf216ae280e12',ramdisk_id='',reservation_id='r-3dwgg99t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2020570120',owner_user_name='tempest-ServerRescueNegativeTestJSON-2020570120-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:01:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64b023ffba814ac5b6a3bc4666107767',uuid=f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "address": "fa:16:3e:63:38:91", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "vif_mac": "fa:16:3e:63:38:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e4e29-61", "ovs_interfaceid": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converting VIF {"id": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "address": "fa:16:3e:63:38:91", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "vif_mac": "fa:16:3e:63:38:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e4e29-61", "ovs_interfaceid": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:38:91,bridge_name='br-int',has_traffic_filtering=True,id=a64e4e29-61af-465a-8dc2-b8851274e0d9,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64e4e29-61') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.objects.instance [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'pci_devices' on Instance uuid f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:03:24 user nova-compute[73469]:   <uuid>f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76</uuid>
Aug 22 03:03:24 user nova-compute[73469]:   <name>instance-00000017</name>
Aug 22 03:03:24 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:03:24 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:03:24 user nova-compute[73469]:   <metadata>
Aug 22 03:03:24 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:03:24 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:03:24 user nova-compute[73469]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1462217807</nova:name>
Aug 22 03:03:24 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:03:24</nova:creationTime>
Aug 22 03:03:24 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:03:24 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:03:24 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:03:24 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:03:24 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:03:24 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:03:24 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:03:24 user nova-compute[73469]:       <nova:owner>
Aug 22 03:03:24 user nova-compute[73469]:         <nova:user uuid="64b023ffba814ac5b6a3bc4666107767">tempest-ServerRescueNegativeTestJSON-2020570120-project-member</nova:user>
Aug 22 03:03:24 user nova-compute[73469]:         <nova:project uuid="46cd52eb0f2642bc95dbf216ae280e12">tempest-ServerRescueNegativeTestJSON-2020570120</nova:project>
Aug 22 03:03:24 user nova-compute[73469]:       </nova:owner>
Aug 22 03:03:24 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:03:24 user nova-compute[73469]:       <nova:ports>
Aug 22 03:03:24 user nova-compute[73469]:         <nova:port uuid="a64e4e29-61af-465a-8dc2-b8851274e0d9">
Aug 22 03:03:24 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 22 03:03:24 user nova-compute[73469]:         </nova:port>
Aug 22 03:03:24 user nova-compute[73469]:       </nova:ports>
Aug 22 03:03:24 user nova-compute[73469]:     </nova:instance>
Aug 22 03:03:24 user nova-compute[73469]:   </metadata>
Aug 22 03:03:24 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:03:24 user nova-compute[73469]:     <system>
Aug 22 03:03:24 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:03:24 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:03:24 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:03:24 user nova-compute[73469]:       <entry name="serial">f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76</entry>
Aug 22 03:03:24 user nova-compute[73469]:       <entry name="uuid">f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76</entry>
Aug 22 03:03:24 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:03:24 user nova-compute[73469]:     </system>
Aug 22 03:03:24 user nova-compute[73469]:   </sysinfo>
Aug 22 03:03:24 user nova-compute[73469]:   <os>
Aug 22 03:03:24 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:03:24 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:03:24 user nova-compute[73469]:   </os>
Aug 22 03:03:24 user nova-compute[73469]:   <features>
Aug 22 03:03:24 user nova-compute[73469]:     <acpi/>
Aug 22 03:03:24 user nova-compute[73469]:     <apic/>
Aug 22 03:03:24 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:03:24 user nova-compute[73469]:   </features>
Aug 22 03:03:24 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:03:24 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:03:24 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:03:24 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:03:24 user nova-compute[73469]:   </clock>
Aug 22 03:03:24 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:03:24 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:03:24 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:03:24 user nova-compute[73469]:   </cpu>
Aug 22 03:03:24 user nova-compute[73469]:   <devices>
Aug 22 03:03:24 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:03:24 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:03:24 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk.rescue"/>
Aug 22 03:03:24 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:03:24 user nova-compute[73469]:     </disk>
Aug 22 03:03:24 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:03:24 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:03:24 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk"/>
Aug 22 03:03:24 user nova-compute[73469]:       <target dev="vdb" bus="virtio"/>
Aug 22 03:03:24 user nova-compute[73469]:     </disk>
Aug 22 03:03:24 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:03:24 user nova-compute[73469]:       <mac address="fa:16:3e:63:38:91"/>
Aug 22 03:03:24 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:03:24 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:03:24 user nova-compute[73469]:       <target dev="tapa64e4e29-61"/>
Aug 22 03:03:24 user nova-compute[73469]:     </interface>
Aug 22 03:03:24 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:03:24 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/console.log" append="off"/>
Aug 22 03:03:24 user nova-compute[73469]:     </serial>
Aug 22 03:03:24 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:03:24 user nova-compute[73469]:     <video>
Aug 22 03:03:24 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:03:24 user nova-compute[73469]:     </video>
Aug 22 03:03:24 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:03:24 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:03:24 user nova-compute[73469]:     </rng>
Aug 22 03:03:24 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:03:24 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:03:24 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:03:24 user nova-compute[73469]:     </memballoon>
Aug 22 03:03:24 user nova-compute[73469]:   </devices>
Aug 22 03:03:24 user nova-compute[73469]: </domain>
Aug 22 03:03:24 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:03:24 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Instance destroyed successfully.
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] No VIF found with MAC fa:16:3e:63:38:91, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:03:24 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Creating image(s)
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Did not create local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Ensure instance console log exists: /opt/stack/data/nova/instances/4765dbfc-4219-4797-b40f-24698fa033bf/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Start _get_guest_xml network_info=[{"id": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "address": "fa:16:3e:24:2f:4c", "network": {"id": "08f11990-95e2-453a-a05b-2526367ec3fd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-130047836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5ac4586-bd", "ovs_interfaceid": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "address": "fa:16:3e:e4:03:95", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d0a8d68-79", "ovs_interfaceid": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "029910e1-c407-4728-a2a3-4daf09db5632", "address": "fa:16:3e:58:a3:0d", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029910e1-c4", "ovs_interfaceid": "029910e1-c407-4728-a2a3-4daf09db5632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "address": "fa:16:3e:c2:21:f8", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac8e395-8b", "ovs_interfaceid": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "42e5267b-949c-44dd-9b96-975b4534aaa3", "address": "fa:16:3e:00:55:c5", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5267b-94", "ovs_interfaceid": "42e5267b-949c-44dd-9b96-975b4534aaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc85b38c-492a-46f6-8d44-67882abf29fb", "address": "fa:16:3e:a9:ae:10", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc85b38c-49", "ovs_interfaceid": "bc85b38c-492a-46f6-8d44-67882abf29fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f948c8ed-80d5-411d-95bb-d12e136727e6", "address": "fa:16:3e:e9:38:9c", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948c8ed-80", "ovs_interfaceid": "f948c8ed-80d5-411d-95bb-d12e136727e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'd4bec1a5-a482-4e9c-9fe7-d80e0778d678', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxqMpibw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4765dbfc-4219-4797-b40f-24698fa033bf', 'attached_at': '', 'detached_at': '', 'volume_id': '9aad3172-3eb9-46ea-bab5-b3eed2744c22', 'serial': '9aad3172-3eb9-46ea-bab5-b3eed2744c22'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None}, {'device_type': 'disk', 'boot_index': 1, 'disk_bus': 'virtio', 'attachment_id': 'f7907258-92d8-44b3-9b04-d225cf6f626c', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TqwyCfHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4765dbfc-4219-4797-b40f-24698fa033bf', 'attached_at': '', 'detached_at': '', 'volume_id': '7d2e5a9d-39c1-4c82-ba9f-070343bb317b', 'serial': '7d2e5a9d-39c1-4c82-ba9f-070343bb317b'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None}, {'device_type': 'disk', 'boot_index': 2, 'disk_bus': 'virtio', 'attachment_id': '761c7914-1ee9-4cbd-ad54-274fc7b9063d', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybBlDeFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4765dbfc-4219-4797-b40f-24698fa033bf', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb9fb33f-c49f-487a-8f13-5c8dc20134fa', 'serial': 'eb9fb33f-c49f-487a-8f13-5c8dc20134fa'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:03:25 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:03:25 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxqMpibw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:03:25 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:03:25 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:03:25 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[179b9df2-8604-4c1c-95ef-2fd2581c65e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:03:25 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1273f42-877e-4198-86c0-c0adb5bc760a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22] added
Aug 22 03:03:25 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e9418a-d354-48e7-90ea-ae7acec38ba0]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5575e9b-9499-4438-8c1e-657a89cd4873]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lxqMpibw {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lxqMpibw" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[439bf9c8-5083-48fd-b68d-565a59a33079]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lxqMpibw'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cd4628-4435-4743-9c95-4e61270461ab]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfd44ce-f34f-44bf-90bf-5291cf0ce738]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:25 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:25 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:25 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:25 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:25 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:25 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:25 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:25 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b310ae-6193-45d3-b0f2-513a2c21750f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22, portal: 172.16.0.220,3260]
Aug 22 03:03:25 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22, portal: 172.16.0.220,3260] successful.
Aug 22 03:03:25 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24c1dcf-de67-4aee-ad50-fce07157ef55]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57cc76a-8cf0-4509-8aae-841e8968f885]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:25 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:25 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:25 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:25 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:25 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:25 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:25 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:25 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:25 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:25 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced35558-5d6e-4716-93d8-d802a470133e]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxqMpibw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.compute.manager [req-12d97a9a-a729-4621-ad44-5c8dacad8aba req-92370b5d-d403-4fd0-99bd-b787157f26e2 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received event network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-12d97a9a-a729-4621-ad44-5c8dacad8aba req-92370b5d-d403-4fd0-99bd-b787157f26e2 service nova] Acquiring lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-12d97a9a-a729-4621-ad44-5c8dacad8aba req-92370b5d-d403-4fd0-99bd-b787157f26e2 service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-12d97a9a-a729-4621-ad44-5c8dacad8aba req-92370b5d-d403-4fd0-99bd-b787157f26e2 service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.compute.manager [req-12d97a9a-a729-4621-ad44-5c8dacad8aba req-92370b5d-d403-4fd0-99bd-b787157f26e2 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] No waiting events found dispatching network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:25 user nova-compute[73469]: WARNING nova.compute.manager [req-12d97a9a-a729-4621-ad44-5c8dacad8aba req-92370b5d-d403-4fd0-99bd-b787157f26e2 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received unexpected event network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 for instance with vm_state active and task_state rescuing.
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.compute.manager [req-12d97a9a-a729-4621-ad44-5c8dacad8aba req-92370b5d-d403-4fd0-99bd-b787157f26e2 service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Received event network-vif-plugged-aa11f705-d214-422e-8d55-988560948a37 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-12d97a9a-a729-4621-ad44-5c8dacad8aba req-92370b5d-d403-4fd0-99bd-b787157f26e2 service nova] Acquiring lock "84706228-0050-49ac-886a-70842ce8dd3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-12d97a9a-a729-4621-ad44-5c8dacad8aba req-92370b5d-d403-4fd0-99bd-b787157f26e2 service nova] Lock "84706228-0050-49ac-886a-70842ce8dd3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-12d97a9a-a729-4621-ad44-5c8dacad8aba req-92370b5d-d403-4fd0-99bd-b787157f26e2 service nova] Lock "84706228-0050-49ac-886a-70842ce8dd3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.compute.manager [req-12d97a9a-a729-4621-ad44-5c8dacad8aba req-92370b5d-d403-4fd0-99bd-b787157f26e2 service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] No waiting events found dispatching network-vif-plugged-aa11f705-d214-422e-8d55-988560948a37 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:25 user nova-compute[73469]: WARNING nova.compute.manager [req-12d97a9a-a729-4621-ad44-5c8dacad8aba req-92370b5d-d403-4fd0-99bd-b787157f26e2 service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Received unexpected event network-vif-plugged-aa11f705-d214-422e-8d55-988560948a37 for instance with vm_state building and task_state spawning.
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.compute.manager [req-12d97a9a-a729-4621-ad44-5c8dacad8aba req-92370b5d-d403-4fd0-99bd-b787157f26e2 service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Received event network-vif-plugged-aa11f705-d214-422e-8d55-988560948a37 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-12d97a9a-a729-4621-ad44-5c8dacad8aba req-92370b5d-d403-4fd0-99bd-b787157f26e2 service nova] Acquiring lock "84706228-0050-49ac-886a-70842ce8dd3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-12d97a9a-a729-4621-ad44-5c8dacad8aba req-92370b5d-d403-4fd0-99bd-b787157f26e2 service nova] Lock "84706228-0050-49ac-886a-70842ce8dd3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-12d97a9a-a729-4621-ad44-5c8dacad8aba req-92370b5d-d403-4fd0-99bd-b787157f26e2 service nova] Lock "84706228-0050-49ac-886a-70842ce8dd3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:25 user nova-compute[73469]: DEBUG nova.compute.manager [req-12d97a9a-a729-4621-ad44-5c8dacad8aba req-92370b5d-d403-4fd0-99bd-b787157f26e2 service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] No waiting events found dispatching network-vif-plugged-aa11f705-d214-422e-8d55-988560948a37 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:25 user nova-compute[73469]: WARNING nova.compute.manager [req-12d97a9a-a729-4621-ad44-5c8dacad8aba req-92370b5d-d403-4fd0-99bd-b787157f26e2 service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Received unexpected event network-vif-plugged-aa11f705-d214-422e-8d55-988560948a37 for instance with vm_state building and task_state spawning.
Aug 22 03:03:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26436343266383164', 'path': '/dev/sdf'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436343266383164', 'path': '/dev/sdf'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TqwyCfHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:03:26 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:03:26 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:03:26 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02dd7d3-2971-4123-a5a0-da13282f9a8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:03:26 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca42c73-ea0e-46f7-8c20-670b1de9118b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b] added
Aug 22 03:03:26 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f057fd99-cab8-470c-af1e-f2852e20b6a9]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d9afae-7d0c-4a43-a92e-8ef407bffaa6]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TqwyCfHL {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TqwyCfHL" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6281dc-865a-4374-ae30-29fe5cf75a9e]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TqwyCfHL'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[50596ae9-e2e1-4cbb-92bd-3020c2c3203a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b08b7b-40b3-4343-b06c-9fa4787b171d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:26 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:26 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:26 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:26 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:26 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:26 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:26 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:26 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:26 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:26 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f296b6d-c52a-453b-8d13-b503367ab310]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b, portal: 172.16.0.220,3260]
Aug 22 03:03:26 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b, portal: 172.16.0.220,3260] successful.
Aug 22 03:03:26 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[65559de9-ffd9-427c-bfb6-166cbed50756]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5f484c-fc30-4215-906a-a85388ce7c19]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:26 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:26 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:26 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:26 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:26 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:03:26 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:26 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:26 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:26 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:26 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:26 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:03:26 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] HCTL ('38', '-', '-', 0) found on session 27 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e65f18-1e73-476d-a2c5-013aad7c91ff]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Searching for a device in session 27 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:03:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TqwyCfHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-6e079276-380c-4db1-9724-761b11c9d613 req-fe9b7b52-2bef-47e4-9b47-fcbb3e2fb374 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received event network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6e079276-380c-4db1-9724-761b11c9d613 req-fe9b7b52-2bef-47e4-9b47-fcbb3e2fb374 service nova] Acquiring lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6e079276-380c-4db1-9724-761b11c9d613 req-fe9b7b52-2bef-47e4-9b47-fcbb3e2fb374 service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6e079276-380c-4db1-9724-761b11c9d613 req-fe9b7b52-2bef-47e4-9b47-fcbb3e2fb374 service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-6e079276-380c-4db1-9724-761b11c9d613 req-fe9b7b52-2bef-47e4-9b47-fcbb3e2fb374 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] No waiting events found dispatching network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:27 user nova-compute[73469]: WARNING nova.compute.manager [req-6e079276-380c-4db1-9724-761b11c9d613 req-fe9b7b52-2bef-47e4-9b47-fcbb3e2fb374 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received unexpected event network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 for instance with vm_state active and task_state rescuing.
Aug 22 03:03:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-6e079276-380c-4db1-9724-761b11c9d613 req-fe9b7b52-2bef-47e4-9b47-fcbb3e2fb374 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received event network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6e079276-380c-4db1-9724-761b11c9d613 req-fe9b7b52-2bef-47e4-9b47-fcbb3e2fb374 service nova] Acquiring lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6e079276-380c-4db1-9724-761b11c9d613 req-fe9b7b52-2bef-47e4-9b47-fcbb3e2fb374 service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6e079276-380c-4db1-9724-761b11c9d613 req-fe9b7b52-2bef-47e4-9b47-fcbb3e2fb374 service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-6e079276-380c-4db1-9724-761b11c9d613 req-fe9b7b52-2bef-47e4-9b47-fcbb3e2fb374 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] No waiting events found dispatching network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:27 user nova-compute[73469]: WARNING nova.compute.manager [req-6e079276-380c-4db1-9724-761b11c9d613 req-fe9b7b52-2bef-47e4-9b47-fcbb3e2fb374 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received unexpected event network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 for instance with vm_state active and task_state rescuing.
Aug 22 03:03:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23031313863633433', 'path': '/dev/sdg'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031313863633433', 'path': '/dev/sdg'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybBlDeFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:03:27 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:03:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:03:27 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:03:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:03:27 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:03:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6911d26-6279-44d5-9a12-d2d2405df364]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:03:27 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c95e06-fcd9-497c-ac26-e34d10f06a88]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa] added
Aug 22 03:03:27 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fdd6ba-aa2e-47d9-b205-a20d3bf3d759]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[52245d7d-8831-4299-84ec-18de0a992b68]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ybBlDeFk {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ybBlDeFk" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc42e135-8600-470c-9f39-374b0c759cc2]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ybBlDeFk'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7b0a25-e9d0-4b71-b48e-42819aae5980]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9f4dd4-4c92-4714-9b92-e132522fcf3c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:03:28 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:03:28 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673408.0792928, 84706228-0050-49ac-886a-70842ce8dd3b => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:03:28 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] VM Resumed (Lifecycle Event)
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:03:28 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Instance spawned successfully.
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:03:28 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673408.0825746, 84706228-0050-49ac-886a-70842ce8dd3b => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:03:28 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] VM Started (Lifecycle Event)
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba50c6d7-ab40-4fd6-8980-a94b9a36472a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa, portal: 172.16.0.220,3260]
Aug 22 03:03:28 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa, portal: 172.16.0.220,3260] successful.
Aug 22 03:03:28 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:28 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fb3711-3430-4baa-ba63-37f50226e890]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:28 user nova-compute[73469]: INFO nova.compute.manager [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Took 7.97 seconds to spawn the instance on the hypervisor.
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d4109e-5745-448e-8027-e1da49ebce2a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:03:28 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:03:28 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:03:28 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] HCTL ('39', '-', '-', 0) found on session 28 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcbf0f8-6a7f-4515-8c47-7c6d221ab940]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Searching for a device in session 28 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybBlDeFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:03:28 user nova-compute[73469]: INFO nova.compute.manager [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Took 8.92 seconds to build instance.
Aug 22 03:03:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cc59f1aa-cac0-4f70-ad63-8c8a7dbac9c5 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "84706228-0050-49ac-886a-70842ce8dd3b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.022s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Removed pending event for f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 due to event {{(pid=73469) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673408.6778824, f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:03:28 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] VM Resumed (Lifecycle Event)
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-8d3ad16e-6422-4940-8002-bf1c8075d3e6 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:03:28 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673408.679465, f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:03:28 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] VM Started (Lifecycle Event)
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:03:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '26430363262356137', 'path': '/dev/sdh'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430363262356137', 'path': '/dev/sdh'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "address": "fa:16:3e:24:2f:4c", "network": {"id": "08f11990-95e2-453a-a05b-2526367ec3fd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-130047836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5ac4586-bd", "ovs_interfaceid": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "address": "fa:16:3e:24:2f:4c", "network": {"id": "08f11990-95e2-453a-a05b-2526367ec3fd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-130047836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5ac4586-bd", "ovs_interfaceid": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:2f:4c,bridge_name='br-int',has_traffic_filtering=True,id=d5ac4586-bd1a-488b-8c9e-ee23a27e57eb,network=Network(08f11990-95e2-453a-a05b-2526367ec3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5ac4586-bd') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "address": "fa:16:3e:e4:03:95", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d0a8d68-79", "ovs_interfaceid": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "address": "fa:16:3e:e4:03:95", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d0a8d68-79", "ovs_interfaceid": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:03:95,bridge_name='br-int',has_traffic_filtering=True,id=3d0a8d68-796c-4c40-a6df-17d44e3ba385,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d0a8d68-79') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "029910e1-c407-4728-a2a3-4daf09db5632", "address": "fa:16:3e:58:a3:0d", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029910e1-c4", "ovs_interfaceid": "029910e1-c407-4728-a2a3-4daf09db5632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "029910e1-c407-4728-a2a3-4daf09db5632", "address": "fa:16:3e:58:a3:0d", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029910e1-c4", "ovs_interfaceid": "029910e1-c407-4728-a2a3-4daf09db5632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:a3:0d,bridge_name='br-int',has_traffic_filtering=True,id=029910e1-c407-4728-a2a3-4daf09db5632,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap029910e1-c4') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "address": "fa:16:3e:c2:21:f8", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac8e395-8b", "ovs_interfaceid": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "address": "fa:16:3e:c2:21:f8", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac8e395-8b", "ovs_interfaceid": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:21:f8,bridge_name='br-int',has_traffic_filtering=True,id=eac8e395-8b46-4d73-a0b8-495ee2530d6c,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac8e395-8b') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42e5267b-949c-44dd-9b96-975b4534aaa3", "address": "fa:16:3e:00:55:c5", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5267b-94", "ovs_interfaceid": "42e5267b-949c-44dd-9b96-975b4534aaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "42e5267b-949c-44dd-9b96-975b4534aaa3", "address": "fa:16:3e:00:55:c5", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5267b-94", "ovs_interfaceid": "42e5267b-949c-44dd-9b96-975b4534aaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:55:c5,bridge_name='br-int',has_traffic_filtering=True,id=42e5267b-949c-44dd-9b96-975b4534aaa3,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5267b-94') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc85b38c-492a-46f6-8d44-67882abf29fb", "address": "fa:16:3e:a9:ae:10", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc85b38c-49", "ovs_interfaceid": "bc85b38c-492a-46f6-8d44-67882abf29fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "bc85b38c-492a-46f6-8d44-67882abf29fb", "address": "fa:16:3e:a9:ae:10", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc85b38c-49", "ovs_interfaceid": "bc85b38c-492a-46f6-8d44-67882abf29fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ae:10,bridge_name='br-int',has_traffic_filtering=True,id=bc85b38c-492a-46f6-8d44-67882abf29fb,network=Network(caf89e44-6bb1-4832-8053-68378a2c004b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc85b38c-49') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f948c8ed-80d5-411d-95bb-d12e136727e6", "address": "fa:16:3e:e9:38:9c", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948c8ed-80", "ovs_interfaceid": "f948c8ed-80d5-411d-95bb-d12e136727e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "f948c8ed-80d5-411d-95bb-d12e136727e6", "address": "fa:16:3e:e9:38:9c", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948c8ed-80", "ovs_interfaceid": "f948c8ed-80d5-411d-95bb-d12e136727e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:38:9c,bridge_name='br-int',has_traffic_filtering=True,id=f948c8ed-80d5-411d-95bb-d12e136727e6,network=Network(caf89e44-6bb1-4832-8053-68378a2c004b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948c8ed-80') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.objects.instance [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lazy-loading 'pci_devices' on Instance uuid 4765dbfc-4219-4797-b40f-24698fa033bf {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:03:29 user nova-compute[73469]:   <uuid>4765dbfc-4219-4797-b40f-24698fa033bf</uuid>
Aug 22 03:03:29 user nova-compute[73469]:   <name>instance-00000019</name>
Aug 22 03:03:29 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:03:29 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:03:29 user nova-compute[73469]:   <metadata>
Aug 22 03:03:29 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:03:29 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:03:29 user nova-compute[73469]:       <nova:name>tempest-device-tagging-server-1635694698</nova:name>
Aug 22 03:03:29 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:03:25</nova:creationTime>
Aug 22 03:03:29 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:03:29 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:03:29 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:03:29 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:03:29 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:03:29 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:03:29 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:03:29 user nova-compute[73469]:       <nova:owner>
Aug 22 03:03:29 user nova-compute[73469]:         <nova:user uuid="6a8977f5d3814762aae632398cc36913">tempest-TaggedBootDevicesTest_v242-4296881-project-member</nova:user>
Aug 22 03:03:29 user nova-compute[73469]:         <nova:project uuid="78ba7249950f4f20a16ccdee64ee9b66">tempest-TaggedBootDevicesTest_v242-4296881</nova:project>
Aug 22 03:03:29 user nova-compute[73469]:       </nova:owner>
Aug 22 03:03:29 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:03:29 user nova-compute[73469]:       <nova:ports>
Aug 22 03:03:29 user nova-compute[73469]:         <nova:port uuid="d5ac4586-bd1a-488b-8c9e-ee23a27e57eb">
Aug 22 03:03:29 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 22 03:03:29 user nova-compute[73469]:         </nova:port>
Aug 22 03:03:29 user nova-compute[73469]:         <nova:port uuid="3d0a8d68-796c-4c40-a6df-17d44e3ba385">
Aug 22 03:03:29 user nova-compute[73469]:           <nova:ip type="fixed" address="10.1.1.203" ipVersion="4"/>
Aug 22 03:03:29 user nova-compute[73469]:         </nova:port>
Aug 22 03:03:29 user nova-compute[73469]:         <nova:port uuid="029910e1-c407-4728-a2a3-4daf09db5632">
Aug 22 03:03:29 user nova-compute[73469]:           <nova:ip type="fixed" address="10.1.1.65" ipVersion="4"/>
Aug 22 03:03:29 user nova-compute[73469]:         </nova:port>
Aug 22 03:03:29 user nova-compute[73469]:         <nova:port uuid="eac8e395-8b46-4d73-a0b8-495ee2530d6c">
Aug 22 03:03:29 user nova-compute[73469]:           <nova:ip type="fixed" address="10.1.1.244" ipVersion="4"/>
Aug 22 03:03:29 user nova-compute[73469]:         </nova:port>
Aug 22 03:03:29 user nova-compute[73469]:         <nova:port uuid="42e5267b-949c-44dd-9b96-975b4534aaa3">
Aug 22 03:03:29 user nova-compute[73469]:           <nova:ip type="fixed" address="10.1.1.121" ipVersion="4"/>
Aug 22 03:03:29 user nova-compute[73469]:         </nova:port>
Aug 22 03:03:29 user nova-compute[73469]:         <nova:port uuid="bc85b38c-492a-46f6-8d44-67882abf29fb">
Aug 22 03:03:29 user nova-compute[73469]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 22 03:03:29 user nova-compute[73469]:         </nova:port>
Aug 22 03:03:29 user nova-compute[73469]:         <nova:port uuid="f948c8ed-80d5-411d-95bb-d12e136727e6">
Aug 22 03:03:29 user nova-compute[73469]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 22 03:03:29 user nova-compute[73469]:         </nova:port>
Aug 22 03:03:29 user nova-compute[73469]:       </nova:ports>
Aug 22 03:03:29 user nova-compute[73469]:     </nova:instance>
Aug 22 03:03:29 user nova-compute[73469]:   </metadata>
Aug 22 03:03:29 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:03:29 user nova-compute[73469]:     <system>
Aug 22 03:03:29 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:03:29 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:03:29 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:03:29 user nova-compute[73469]:       <entry name="serial">4765dbfc-4219-4797-b40f-24698fa033bf</entry>
Aug 22 03:03:29 user nova-compute[73469]:       <entry name="uuid">4765dbfc-4219-4797-b40f-24698fa033bf</entry>
Aug 22 03:03:29 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:03:29 user nova-compute[73469]:     </system>
Aug 22 03:03:29 user nova-compute[73469]:   </sysinfo>
Aug 22 03:03:29 user nova-compute[73469]:   <os>
Aug 22 03:03:29 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:03:29 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:03:29 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:03:29 user nova-compute[73469]:   </os>
Aug 22 03:03:29 user nova-compute[73469]:   <features>
Aug 22 03:03:29 user nova-compute[73469]:     <acpi/>
Aug 22 03:03:29 user nova-compute[73469]:     <apic/>
Aug 22 03:03:29 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:03:29 user nova-compute[73469]:   </features>
Aug 22 03:03:29 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:03:29 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:03:29 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:03:29 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:03:29 user nova-compute[73469]:   </clock>
Aug 22 03:03:29 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:03:29 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:03:29 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:03:29 user nova-compute[73469]:   </cpu>
Aug 22 03:03:29 user nova-compute[73469]:   <devices>
Aug 22 03:03:29 user nova-compute[73469]:     <disk type="file" device="cdrom">
Aug 22 03:03:29 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none"/>
Aug 22 03:03:29 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/4765dbfc-4219-4797-b40f-24698fa033bf/disk.config"/>
Aug 22 03:03:29 user nova-compute[73469]:       <target dev="hda" bus="ide"/>
Aug 22 03:03:29 user nova-compute[73469]:     </disk>
Aug 22 03:03:29 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:03:29 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:03:29 user nova-compute[73469]:       <source dev="/dev/sdf"/>
Aug 22 03:03:29 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:03:29 user nova-compute[73469]:       <serial>9aad3172-3eb9-46ea-bab5-b3eed2744c22</serial>
Aug 22 03:03:29 user nova-compute[73469]:     </disk>
Aug 22 03:03:29 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:03:29 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:03:29 user nova-compute[73469]:       <source dev="/dev/sdg"/>
Aug 22 03:03:29 user nova-compute[73469]:       <target dev="vdb" bus="virtio"/>
Aug 22 03:03:29 user nova-compute[73469]:       <serial>7d2e5a9d-39c1-4c82-ba9f-070343bb317b</serial>
Aug 22 03:03:29 user nova-compute[73469]:     </disk>
Aug 22 03:03:29 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:03:29 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:03:29 user nova-compute[73469]:       <source dev="/dev/sdh"/>
Aug 22 03:03:29 user nova-compute[73469]:       <target dev="vdc" bus="virtio"/>
Aug 22 03:03:29 user nova-compute[73469]:       <serial>eb9fb33f-c49f-487a-8f13-5c8dc20134fa</serial>
Aug 22 03:03:29 user nova-compute[73469]:     </disk>
Aug 22 03:03:29 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:03:29 user nova-compute[73469]:       <mac address="fa:16:3e:24:2f:4c"/>
Aug 22 03:03:29 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:03:29 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:03:29 user nova-compute[73469]:       <target dev="tapd5ac4586-bd"/>
Aug 22 03:03:29 user nova-compute[73469]:     </interface>
Aug 22 03:03:29 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:03:29 user nova-compute[73469]:       <mac address="fa:16:3e:e4:03:95"/>
Aug 22 03:03:29 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:03:29 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:03:29 user nova-compute[73469]:       <target dev="tap3d0a8d68-79"/>
Aug 22 03:03:29 user nova-compute[73469]:     </interface>
Aug 22 03:03:29 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:03:29 user nova-compute[73469]:       <mac address="fa:16:3e:58:a3:0d"/>
Aug 22 03:03:29 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:03:29 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:03:29 user nova-compute[73469]:       <target dev="tap029910e1-c4"/>
Aug 22 03:03:29 user nova-compute[73469]:     </interface>
Aug 22 03:03:29 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:03:29 user nova-compute[73469]:       <mac address="fa:16:3e:c2:21:f8"/>
Aug 22 03:03:29 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:03:29 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:03:29 user nova-compute[73469]:       <target dev="tapeac8e395-8b"/>
Aug 22 03:03:29 user nova-compute[73469]:     </interface>
Aug 22 03:03:29 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:03:29 user nova-compute[73469]:       <mac address="fa:16:3e:00:55:c5"/>
Aug 22 03:03:29 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:03:29 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:03:29 user nova-compute[73469]:       <target dev="tap42e5267b-94"/>
Aug 22 03:03:29 user nova-compute[73469]:     </interface>
Aug 22 03:03:29 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:03:29 user nova-compute[73469]:       <mac address="fa:16:3e:a9:ae:10"/>
Aug 22 03:03:29 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:03:29 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:03:29 user nova-compute[73469]:       <target dev="tapbc85b38c-49"/>
Aug 22 03:03:29 user nova-compute[73469]:     </interface>
Aug 22 03:03:29 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:03:29 user nova-compute[73469]:       <mac address="fa:16:3e:e9:38:9c"/>
Aug 22 03:03:29 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:03:29 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:03:29 user nova-compute[73469]:       <target dev="tapf948c8ed-80"/>
Aug 22 03:03:29 user nova-compute[73469]:     </interface>
Aug 22 03:03:29 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:03:29 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/4765dbfc-4219-4797-b40f-24698fa033bf/console.log" append="off"/>
Aug 22 03:03:29 user nova-compute[73469]:     </serial>
Aug 22 03:03:29 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:03:29 user nova-compute[73469]:     <video>
Aug 22 03:03:29 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:03:29 user nova-compute[73469]:     </video>
Aug 22 03:03:29 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:03:29 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:03:29 user nova-compute[73469]:     </rng>
Aug 22 03:03:29 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:03:29 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:03:29 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:03:29 user nova-compute[73469]:     </memballoon>
Aug 22 03:03:29 user nova-compute[73469]:   </devices>
Aug 22 03:03:29 user nova-compute[73469]: </domain>
Aug 22 03:03:29 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "address": "fa:16:3e:24:2f:4c", "network": {"id": "08f11990-95e2-453a-a05b-2526367ec3fd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-130047836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5ac4586-bd", "ovs_interfaceid": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "address": "fa:16:3e:24:2f:4c", "network": {"id": "08f11990-95e2-453a-a05b-2526367ec3fd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-130047836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5ac4586-bd", "ovs_interfaceid": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:2f:4c,bridge_name='br-int',has_traffic_filtering=True,id=d5ac4586-bd1a-488b-8c9e-ee23a27e57eb,network=Network(08f11990-95e2-453a-a05b-2526367ec3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5ac4586-bd') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG os_vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:2f:4c,bridge_name='br-int',has_traffic_filtering=True,id=d5ac4586-bd1a-488b-8c9e-ee23a27e57eb,network=Network(08f11990-95e2-453a-a05b-2526367ec3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5ac4586-bd') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5ac4586-bd, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5ac4586-bd, col_values=(('external_ids', {'iface-id': 'd5ac4586-bd1a-488b-8c9e-ee23a27e57eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:2f:4c', 'vm-uuid': '4765dbfc-4219-4797-b40f-24698fa033bf'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: INFO os_vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:2f:4c,bridge_name='br-int',has_traffic_filtering=True,id=d5ac4586-bd1a-488b-8c9e-ee23a27e57eb,network=Network(08f11990-95e2-453a-a05b-2526367ec3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5ac4586-bd')
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "address": "fa:16:3e:e4:03:95", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d0a8d68-79", "ovs_interfaceid": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "address": "fa:16:3e:e4:03:95", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d0a8d68-79", "ovs_interfaceid": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:03:95,bridge_name='br-int',has_traffic_filtering=True,id=3d0a8d68-796c-4c40-a6df-17d44e3ba385,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d0a8d68-79') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG os_vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:03:95,bridge_name='br-int',has_traffic_filtering=True,id=3d0a8d68-796c-4c40-a6df-17d44e3ba385,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d0a8d68-79') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d0a8d68-79, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d0a8d68-79, col_values=(('external_ids', {'iface-id': '3d0a8d68-796c-4c40-a6df-17d44e3ba385', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:03:95', 'vm-uuid': '4765dbfc-4219-4797-b40f-24698fa033bf'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: INFO os_vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:03:95,bridge_name='br-int',has_traffic_filtering=True,id=3d0a8d68-796c-4c40-a6df-17d44e3ba385,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d0a8d68-79')
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "029910e1-c407-4728-a2a3-4daf09db5632", "address": "fa:16:3e:58:a3:0d", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029910e1-c4", "ovs_interfaceid": "029910e1-c407-4728-a2a3-4daf09db5632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "029910e1-c407-4728-a2a3-4daf09db5632", "address": "fa:16:3e:58:a3:0d", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029910e1-c4", "ovs_interfaceid": "029910e1-c407-4728-a2a3-4daf09db5632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:a3:0d,bridge_name='br-int',has_traffic_filtering=True,id=029910e1-c407-4728-a2a3-4daf09db5632,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap029910e1-c4') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG os_vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:a3:0d,bridge_name='br-int',has_traffic_filtering=True,id=029910e1-c407-4728-a2a3-4daf09db5632,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap029910e1-c4') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap029910e1-c4, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap029910e1-c4, col_values=(('external_ids', {'iface-id': '029910e1-c407-4728-a2a3-4daf09db5632', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:a3:0d', 'vm-uuid': '4765dbfc-4219-4797-b40f-24698fa033bf'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: INFO os_vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:a3:0d,bridge_name='br-int',has_traffic_filtering=True,id=029910e1-c407-4728-a2a3-4daf09db5632,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap029910e1-c4')
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "address": "fa:16:3e:c2:21:f8", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac8e395-8b", "ovs_interfaceid": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "address": "fa:16:3e:c2:21:f8", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac8e395-8b", "ovs_interfaceid": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:21:f8,bridge_name='br-int',has_traffic_filtering=True,id=eac8e395-8b46-4d73-a0b8-495ee2530d6c,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac8e395-8b') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG os_vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:21:f8,bridge_name='br-int',has_traffic_filtering=True,id=eac8e395-8b46-4d73-a0b8-495ee2530d6c,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac8e395-8b') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeac8e395-8b, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeac8e395-8b, col_values=(('external_ids', {'iface-id': 'eac8e395-8b46-4d73-a0b8-495ee2530d6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:21:f8', 'vm-uuid': '4765dbfc-4219-4797-b40f-24698fa033bf'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: INFO os_vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:21:f8,bridge_name='br-int',has_traffic_filtering=True,id=eac8e395-8b46-4d73-a0b8-495ee2530d6c,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac8e395-8b')
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42e5267b-949c-44dd-9b96-975b4534aaa3", "address": "fa:16:3e:00:55:c5", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5267b-94", "ovs_interfaceid": "42e5267b-949c-44dd-9b96-975b4534aaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "42e5267b-949c-44dd-9b96-975b4534aaa3", "address": "fa:16:3e:00:55:c5", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5267b-94", "ovs_interfaceid": "42e5267b-949c-44dd-9b96-975b4534aaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:55:c5,bridge_name='br-int',has_traffic_filtering=True,id=42e5267b-949c-44dd-9b96-975b4534aaa3,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5267b-94') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG os_vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:55:c5,bridge_name='br-int',has_traffic_filtering=True,id=42e5267b-949c-44dd-9b96-975b4534aaa3,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5267b-94') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42e5267b-94, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap42e5267b-94, col_values=(('external_ids', {'iface-id': '42e5267b-949c-44dd-9b96-975b4534aaa3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:55:c5', 'vm-uuid': '4765dbfc-4219-4797-b40f-24698fa033bf'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: INFO os_vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:55:c5,bridge_name='br-int',has_traffic_filtering=True,id=42e5267b-949c-44dd-9b96-975b4534aaa3,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5267b-94')
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc85b38c-492a-46f6-8d44-67882abf29fb", "address": "fa:16:3e:a9:ae:10", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc85b38c-49", "ovs_interfaceid": "bc85b38c-492a-46f6-8d44-67882abf29fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "bc85b38c-492a-46f6-8d44-67882abf29fb", "address": "fa:16:3e:a9:ae:10", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc85b38c-49", "ovs_interfaceid": "bc85b38c-492a-46f6-8d44-67882abf29fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ae:10,bridge_name='br-int',has_traffic_filtering=True,id=bc85b38c-492a-46f6-8d44-67882abf29fb,network=Network(caf89e44-6bb1-4832-8053-68378a2c004b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc85b38c-49') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG os_vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ae:10,bridge_name='br-int',has_traffic_filtering=True,id=bc85b38c-492a-46f6-8d44-67882abf29fb,network=Network(caf89e44-6bb1-4832-8053-68378a2c004b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc85b38c-49') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc85b38c-49, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbc85b38c-49, col_values=(('external_ids', {'iface-id': 'bc85b38c-492a-46f6-8d44-67882abf29fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:ae:10', 'vm-uuid': '4765dbfc-4219-4797-b40f-24698fa033bf'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: INFO os_vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ae:10,bridge_name='br-int',has_traffic_filtering=True,id=bc85b38c-492a-46f6-8d44-67882abf29fb,network=Network(caf89e44-6bb1-4832-8053-68378a2c004b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc85b38c-49')
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f948c8ed-80d5-411d-95bb-d12e136727e6", "address": "fa:16:3e:e9:38:9c", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948c8ed-80", "ovs_interfaceid": "f948c8ed-80d5-411d-95bb-d12e136727e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "f948c8ed-80d5-411d-95bb-d12e136727e6", "address": "fa:16:3e:e9:38:9c", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948c8ed-80", "ovs_interfaceid": "f948c8ed-80d5-411d-95bb-d12e136727e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:38:9c,bridge_name='br-int',has_traffic_filtering=True,id=f948c8ed-80d5-411d-95bb-d12e136727e6,network=Network(caf89e44-6bb1-4832-8053-68378a2c004b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948c8ed-80') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG os_vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:38:9c,bridge_name='br-int',has_traffic_filtering=True,id=f948c8ed-80d5-411d-95bb-d12e136727e6,network=Network(caf89e44-6bb1-4832-8053-68378a2c004b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948c8ed-80') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf948c8ed-80, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf948c8ed-80, col_values=(('external_ids', {'iface-id': 'f948c8ed-80d5-411d-95bb-d12e136727e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:38:9c', 'vm-uuid': '4765dbfc-4219-4797-b40f-24698fa033bf'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:29 user nova-compute[73469]: INFO os_vif [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:38:9c,bridge_name='br-int',has_traffic_filtering=True,id=f948c8ed-80d5-411d-95bb-d12e136727e6,network=Network(caf89e44-6bb1-4832-8053-68378a2c004b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948c8ed-80')
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] No BDM found with device name hda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] No VIF found with MAC fa:16:3e:24:2f:4c, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:03:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] No VIF found with MAC fa:16:3e:00:55:c5, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:03:29 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Using config drive
Aug 22 03:03:30 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Creating config drive at /opt/stack/data/nova/instances/4765dbfc-4219-4797-b40f-24698fa033bf/disk.config
Aug 22 03:03:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4765dbfc-4219-4797-b40f-24698fa033bf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbtmmaj2x {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4765dbfc-4219-4797-b40f-24698fa033bf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbtmmaj2x" returned: 0 in 0.076s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uOXPzmbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:03:31 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:03:31 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:03:31 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[446b01b8-7857-48fc-83df-8ed3c4a750f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:03:31 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d1a51e-fe00-4f62-88b3-3576b2ec3c73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b] added
Aug 22 03:03:31 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9290e7b8-b293-49dd-af31-026cc27814ee]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dfa505-4027-48df-b921-b33b2a5e1a61]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uOXPzmbv {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uOXPzmbv" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d27114-a13c-4ce5-b3eb-5db8a85eb032]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uOXPzmbv'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[959f9369-6cd4-47a7-af90-313381ebd42c]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e6ac57-acd4-42ad-91ce-8a14e640a4f1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:03:31 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:03:31 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cdf0e3-8db0-46e5-b074-7c11ce274152]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b, portal: 172.16.0.220,3260]
Aug 22 03:03:31 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b, portal: 172.16.0.220,3260] successful.
Aug 22 03:03:31 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86c926e-a8aa-4f68-8b04-532ed6852c8e]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[760415fc-d994-4f0b-b702-5f5532ae2337]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:03:31 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:03:31 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:03:31 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] HCTL ('40', '-', '-', 0) found on session 29 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.030s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76046de-c7f9-4a0f-9997-5c077e4d4926]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Searching for a device in session 29 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uOXPzmbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-2326203d-24ad-4c4c-bed2-505b8bdd0b78 req-3c3e32f7-0cd8-41e9-a6d3-89ced5684f56 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-d5ac4586-bd1a-488b-8c9e-ee23a27e57eb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2326203d-24ad-4c4c-bed2-505b8bdd0b78 req-3c3e32f7-0cd8-41e9-a6d3-89ced5684f56 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2326203d-24ad-4c4c-bed2-505b8bdd0b78 req-3c3e32f7-0cd8-41e9-a6d3-89ced5684f56 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2326203d-24ad-4c4c-bed2-505b8bdd0b78 req-3c3e32f7-0cd8-41e9-a6d3-89ced5684f56 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-2326203d-24ad-4c4c-bed2-505b8bdd0b78 req-3c3e32f7-0cd8-41e9-a6d3-89ced5684f56 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-d5ac4586-bd1a-488b-8c9e-ee23a27e57eb {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:32 user nova-compute[73469]: WARNING nova.compute.manager [req-2326203d-24ad-4c4c-bed2-505b8bdd0b78 req-3c3e32f7-0cd8-41e9-a6d3-89ced5684f56 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-d5ac4586-bd1a-488b-8c9e-ee23a27e57eb for instance with vm_state building and task_state spawning.
Aug 22 03:03:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '23163336165346264', 'path': '/dev/sdi'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163336165346264', 'path': '/dev/sdi'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG nova.objects.instance [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lazy-loading 'flavor' on Instance uuid 0d5a30d1-565c-47c9-8caa-84dab130e117 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:03:32 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:03:32 user nova-compute[73469]:   <source dev="/dev/sdi"/>
Aug 22 03:03:32 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:03:32 user nova-compute[73469]:   <serial>83bb2eca-4fba-475b-9cd5-70fc9996656b</serial>
Aug 22 03:03:32 user nova-compute[73469]: </disk>
Aug 22 03:03:32 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-16684aab-055d-4cc3-9bc5-1dc796ca33af req-fdfa1681-e975-4b0b-86bd-009c44bbee79 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-eac8e395-8b46-4d73-a0b8-495ee2530d6c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-16684aab-055d-4cc3-9bc5-1dc796ca33af req-fdfa1681-e975-4b0b-86bd-009c44bbee79 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-16684aab-055d-4cc3-9bc5-1dc796ca33af req-fdfa1681-e975-4b0b-86bd-009c44bbee79 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-16684aab-055d-4cc3-9bc5-1dc796ca33af req-fdfa1681-e975-4b0b-86bd-009c44bbee79 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-16684aab-055d-4cc3-9bc5-1dc796ca33af req-fdfa1681-e975-4b0b-86bd-009c44bbee79 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-eac8e395-8b46-4d73-a0b8-495ee2530d6c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:33 user nova-compute[73469]: WARNING nova.compute.manager [req-16684aab-055d-4cc3-9bc5-1dc796ca33af req-fdfa1681-e975-4b0b-86bd-009c44bbee79 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-eac8e395-8b46-4d73-a0b8-495ee2530d6c for instance with vm_state building and task_state spawning.
Aug 22 03:03:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-40b23230-0ee8-4986-895b-1bb4ae47bd2b req-02703d94-0b2d-46ef-88c3-11f8113b3100 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-42e5267b-949c-44dd-9b96-975b4534aaa3 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-40b23230-0ee8-4986-895b-1bb4ae47bd2b req-02703d94-0b2d-46ef-88c3-11f8113b3100 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-40b23230-0ee8-4986-895b-1bb4ae47bd2b req-02703d94-0b2d-46ef-88c3-11f8113b3100 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-40b23230-0ee8-4986-895b-1bb4ae47bd2b req-02703d94-0b2d-46ef-88c3-11f8113b3100 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-40b23230-0ee8-4986-895b-1bb4ae47bd2b req-02703d94-0b2d-46ef-88c3-11f8113b3100 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-42e5267b-949c-44dd-9b96-975b4534aaa3 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:33 user nova-compute[73469]: WARNING nova.compute.manager [req-40b23230-0ee8-4986-895b-1bb4ae47bd2b req-02703d94-0b2d-46ef-88c3-11f8113b3100 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-42e5267b-949c-44dd-9b96-975b4534aaa3 for instance with vm_state building and task_state spawning.
Aug 22 03:03:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] No VIF found with MAC fa:16:3e:1e:69:04, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-a41f273a-87e2-4f0a-986f-952e3e812d68 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.157s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-d5ac4586-bd1a-488b-8c9e-ee23a27e57eb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-d5ac4586-bd1a-488b-8c9e-ee23a27e57eb {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:34 user nova-compute[73469]: WARNING nova.compute.manager [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-d5ac4586-bd1a-488b-8c9e-ee23a27e57eb for instance with vm_state building and task_state spawning.
Aug 22 03:03:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-3d0a8d68-796c-4c40-a6df-17d44e3ba385 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-3d0a8d68-796c-4c40-a6df-17d44e3ba385 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:34 user nova-compute[73469]: WARNING nova.compute.manager [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-3d0a8d68-796c-4c40-a6df-17d44e3ba385 for instance with vm_state building and task_state spawning.
Aug 22 03:03:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-3d0a8d68-796c-4c40-a6df-17d44e3ba385 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-3d0a8d68-796c-4c40-a6df-17d44e3ba385 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:34 user nova-compute[73469]: WARNING nova.compute.manager [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-3d0a8d68-796c-4c40-a6df-17d44e3ba385 for instance with vm_state building and task_state spawning.
Aug 22 03:03:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-029910e1-c407-4728-a2a3-4daf09db5632 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-029910e1-c407-4728-a2a3-4daf09db5632 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:34 user nova-compute[73469]: WARNING nova.compute.manager [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-029910e1-c407-4728-a2a3-4daf09db5632 for instance with vm_state building and task_state spawning.
Aug 22 03:03:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-029910e1-c407-4728-a2a3-4daf09db5632 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-029910e1-c407-4728-a2a3-4daf09db5632 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:34 user nova-compute[73469]: WARNING nova.compute.manager [req-9fddc235-6ee1-4857-ba9e-34a52c65e42b req-4d7fb7a5-7609-4723-83a3-936967ff7ce1 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-029910e1-c407-4728-a2a3-4daf09db5632 for instance with vm_state building and task_state spawning.
Aug 22 03:03:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-54da8949-fc12-4fe6-857c-1fd4f9b4da13 req-3a930728-31c1-4793-8d4b-516a87793a28 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-eac8e395-8b46-4d73-a0b8-495ee2530d6c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-54da8949-fc12-4fe6-857c-1fd4f9b4da13 req-3a930728-31c1-4793-8d4b-516a87793a28 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-54da8949-fc12-4fe6-857c-1fd4f9b4da13 req-3a930728-31c1-4793-8d4b-516a87793a28 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-54da8949-fc12-4fe6-857c-1fd4f9b4da13 req-3a930728-31c1-4793-8d4b-516a87793a28 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-54da8949-fc12-4fe6-857c-1fd4f9b4da13 req-3a930728-31c1-4793-8d4b-516a87793a28 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-eac8e395-8b46-4d73-a0b8-495ee2530d6c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:35 user nova-compute[73469]: WARNING nova.compute.manager [req-54da8949-fc12-4fe6-857c-1fd4f9b4da13 req-3a930728-31c1-4793-8d4b-516a87793a28 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-eac8e395-8b46-4d73-a0b8-495ee2530d6c for instance with vm_state building and task_state spawning.
Aug 22 03:03:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-c278cafe-0299-464a-9906-bc24888412b1 req-07598311-f5db-4619-aa76-aed96c494965 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-42e5267b-949c-44dd-9b96-975b4534aaa3 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c278cafe-0299-464a-9906-bc24888412b1 req-07598311-f5db-4619-aa76-aed96c494965 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c278cafe-0299-464a-9906-bc24888412b1 req-07598311-f5db-4619-aa76-aed96c494965 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c278cafe-0299-464a-9906-bc24888412b1 req-07598311-f5db-4619-aa76-aed96c494965 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-c278cafe-0299-464a-9906-bc24888412b1 req-07598311-f5db-4619-aa76-aed96c494965 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-42e5267b-949c-44dd-9b96-975b4534aaa3 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:35 user nova-compute[73469]: WARNING nova.compute.manager [req-c278cafe-0299-464a-9906-bc24888412b1 req-07598311-f5db-4619-aa76-aed96c494965 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-42e5267b-949c-44dd-9b96-975b4534aaa3 for instance with vm_state building and task_state spawning.
Aug 22 03:03:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-c278cafe-0299-464a-9906-bc24888412b1 req-07598311-f5db-4619-aa76-aed96c494965 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-bc85b38c-492a-46f6-8d44-67882abf29fb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c278cafe-0299-464a-9906-bc24888412b1 req-07598311-f5db-4619-aa76-aed96c494965 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c278cafe-0299-464a-9906-bc24888412b1 req-07598311-f5db-4619-aa76-aed96c494965 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c278cafe-0299-464a-9906-bc24888412b1 req-07598311-f5db-4619-aa76-aed96c494965 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-c278cafe-0299-464a-9906-bc24888412b1 req-07598311-f5db-4619-aa76-aed96c494965 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-bc85b38c-492a-46f6-8d44-67882abf29fb {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:35 user nova-compute[73469]: WARNING nova.compute.manager [req-c278cafe-0299-464a-9906-bc24888412b1 req-07598311-f5db-4619-aa76-aed96c494965 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-bc85b38c-492a-46f6-8d44-67882abf29fb for instance with vm_state building and task_state spawning.
Aug 22 03:03:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-c278cafe-0299-464a-9906-bc24888412b1 req-07598311-f5db-4619-aa76-aed96c494965 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-bc85b38c-492a-46f6-8d44-67882abf29fb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c278cafe-0299-464a-9906-bc24888412b1 req-07598311-f5db-4619-aa76-aed96c494965 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c278cafe-0299-464a-9906-bc24888412b1 req-07598311-f5db-4619-aa76-aed96c494965 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c278cafe-0299-464a-9906-bc24888412b1 req-07598311-f5db-4619-aa76-aed96c494965 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-c278cafe-0299-464a-9906-bc24888412b1 req-07598311-f5db-4619-aa76-aed96c494965 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-bc85b38c-492a-46f6-8d44-67882abf29fb {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:35 user nova-compute[73469]: WARNING nova.compute.manager [req-c278cafe-0299-464a-9906-bc24888412b1 req-07598311-f5db-4619-aa76-aed96c494965 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-bc85b38c-492a-46f6-8d44-67882abf29fb for instance with vm_state building and task_state spawning.
Aug 22 03:03:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673416.4802458, 4765dbfc-4219-4797-b40f-24698fa033bf => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:03:36 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] VM Resumed (Lifecycle Event)
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-521b88b8-86ce-44b2-94b1-dab955d9de91 req-1b190622-d1af-4bf6-bbc1-e0ecd2936018 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-f948c8ed-80d5-411d-95bb-d12e136727e6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-521b88b8-86ce-44b2-94b1-dab955d9de91 req-1b190622-d1af-4bf6-bbc1-e0ecd2936018 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-521b88b8-86ce-44b2-94b1-dab955d9de91 req-1b190622-d1af-4bf6-bbc1-e0ecd2936018 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-521b88b8-86ce-44b2-94b1-dab955d9de91 req-1b190622-d1af-4bf6-bbc1-e0ecd2936018 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-521b88b8-86ce-44b2-94b1-dab955d9de91 req-1b190622-d1af-4bf6-bbc1-e0ecd2936018 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-f948c8ed-80d5-411d-95bb-d12e136727e6 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:36 user nova-compute[73469]: WARNING nova.compute.manager [req-521b88b8-86ce-44b2-94b1-dab955d9de91 req-1b190622-d1af-4bf6-bbc1-e0ecd2936018 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-f948c8ed-80d5-411d-95bb-d12e136727e6 for instance with vm_state building and task_state spawning.
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-521b88b8-86ce-44b2-94b1-dab955d9de91 req-1b190622-d1af-4bf6-bbc1-e0ecd2936018 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-f948c8ed-80d5-411d-95bb-d12e136727e6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-521b88b8-86ce-44b2-94b1-dab955d9de91 req-1b190622-d1af-4bf6-bbc1-e0ecd2936018 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-521b88b8-86ce-44b2-94b1-dab955d9de91 req-1b190622-d1af-4bf6-bbc1-e0ecd2936018 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-521b88b8-86ce-44b2-94b1-dab955d9de91 req-1b190622-d1af-4bf6-bbc1-e0ecd2936018 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-521b88b8-86ce-44b2-94b1-dab955d9de91 req-1b190622-d1af-4bf6-bbc1-e0ecd2936018 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-f948c8ed-80d5-411d-95bb-d12e136727e6 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:36 user nova-compute[73469]: WARNING nova.compute.manager [req-521b88b8-86ce-44b2-94b1-dab955d9de91 req-1b190622-d1af-4bf6-bbc1-e0ecd2936018 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-f948c8ed-80d5-411d-95bb-d12e136727e6 for instance with vm_state building and task_state spawning.
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:03:36 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Instance spawned successfully.
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:03:36 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673416.4803822, 4765dbfc-4219-4797-b40f-24698fa033bf => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:03:36 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] VM Started (Lifecycle Event)
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:03:36 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:03:36 user nova-compute[73469]: INFO nova.compute.manager [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Took 11.65 seconds to spawn the instance on the hypervisor.
Aug 22 03:03:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:03:36 user nova-compute[73469]: INFO nova.compute.manager [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Took 75.61 seconds to build instance.
Aug 22 03:03:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6368693f-93c8-434e-bbc4-947298af7b03 tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "4765dbfc-4219-4797-b40f-24698fa033bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 75.788s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:37 user nova-compute[73469]: DEBUG nova.network.neutron [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Port f38d1396-0fe4-4107-8815-7420deceedab binding to destination host user is already ACTIVE {{(pid=73469) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 22 03:03:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:03:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquired lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:03:37 user nova-compute[73469]: DEBUG nova.network.neutron [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:03:37 user nova-compute[73469]: DEBUG nova.network.neutron [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Updating instance_info_cache with network_info: [{"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:03:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Releasing lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Creating tmpfile /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/tmp_iwg91b2 to verify with other compute node that the instance is on the same shared storage. {{(pid=73469) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-afd15935-f8d0-430d-9999-06869dc43600 req-5b75aaeb-dbb7-43d9-9d7d-91d12558028b service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Received event network-changed-147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-afd15935-f8d0-430d-9999-06869dc43600 req-5b75aaeb-dbb7-43d9-9d7d-91d12558028b service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Refreshing instance network info cache due to event network-changed-147479ad-a9fc-4ccf-a900-95e347d1a79e. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-afd15935-f8d0-430d-9999-06869dc43600 req-5b75aaeb-dbb7-43d9-9d7d-91d12558028b service nova] Acquiring lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-afd15935-f8d0-430d-9999-06869dc43600 req-5b75aaeb-dbb7-43d9-9d7d-91d12558028b service nova] Acquired lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG nova.network.neutron [req-afd15935-f8d0-430d-9999-06869dc43600 req-5b75aaeb-dbb7-43d9-9d7d-91d12558028b service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Refreshing network info cache for port 147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-adb7d46c-7fc1-40a0-978a-58ab6e1041b0 req-97e347f4-50ee-418d-8956-1d6e6302bf25 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Received event network-changed-147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-adb7d46c-7fc1-40a0-978a-58ab6e1041b0 req-97e347f4-50ee-418d-8956-1d6e6302bf25 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Refreshing instance network info cache due to event network-changed-147479ad-a9fc-4ccf-a900-95e347d1a79e. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-adb7d46c-7fc1-40a0-978a-58ab6e1041b0 req-97e347f4-50ee-418d-8956-1d6e6302bf25 service nova] Acquiring lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:38 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Instance destroyed successfully.
Aug 22 03:03:38 user nova-compute[73469]: DEBUG nova.objects.instance [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lazy-loading 'resources' on Instance uuid 5984759d-28f1-45e8-bb4c-27bd8df426f4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1537383573',display_name='tempest-ServerActionsTestOtherB-server-1537383573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1537383573',id=18,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbR7/rnM2AeZHN+BHEO9wy6tT5C/8gqpz2OLyZ0PrOkSO9sSAq61LBq8B59x8O0SJWkSJu3MS+tJxcGT/zQuOBrkxHQmB8JC+FatiKrmiFApJOgsuSU1qC5st2CAxnTvw==',key_name='tempest-keypair-568897893',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:02:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9d41329e1ad49bc94369a54d2798ac6',ramdisk_id='',reservation_id='r-6rax0pzg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1653559752',owner_user_name='tempest-ServerActionsTestOtherB-1653559752-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:02:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d3f2f35df22412cac98e90f1bb80b08',uuid=5984759d-28f1-45e8-bb4c-27bd8df426f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Converting VIF {"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG os_vif [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf38d1396-0f, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:39 user nova-compute[73469]: INFO os_vif [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f')
Aug 22 03:03:39 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvGlDOhP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:03:39 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:03:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25f97aa-6d1a-446b-aec1-b28a8e4466e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.058s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79f59ed-6f4a-471a-aa07-1365454d51a7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:39 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:39 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:39 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:39 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:39 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:03:39 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:03:39 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:03:39 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:39 user nova-compute[73469]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:39 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:39 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:39 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:39 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:03:39 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:03:39 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:03:39 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79806912d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc'): ({'sdd'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Removing single pathed devices sdd {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1639fdbb-6e7e-4466-9169-37c848a53a04]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[689c3c94-78cc-47f9-b3b4-ad5703ce883c]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Flushing IO for device /dev/sdd {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[33970840-708c-4303-a2c3-c36f8a050cc4]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7332de09-5b74-4867-bdde-c6e149d71f42]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d494b2-244c-4bfe-a05d-7a2f872f1891]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG nova.network.neutron [req-afd15935-f8d0-430d-9999-06869dc43600 req-5b75aaeb-dbb7-43d9-9d7d-91d12558028b service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Updated VIF entry in instance network info cache for port 147479ad-a9fc-4ccf-a900-95e347d1a79e. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG nova.network.neutron [req-afd15935-f8d0-430d-9999-06869dc43600 req-5b75aaeb-dbb7-43d9-9d7d-91d12558028b service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Updating instance_info_cache with network_info: [{"id": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "address": "fa:16:3e:1e:69:04", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap147479ad-a9", "ovs_interfaceid": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-afd15935-f8d0-430d-9999-06869dc43600 req-5b75aaeb-dbb7-43d9-9d7d-91d12558028b service nova] Releasing lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-adb7d46c-7fc1-40a0-978a-58ab6e1041b0 req-97e347f4-50ee-418d-8956-1d6e6302bf25 service nova] Acquired lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG nova.network.neutron [req-adb7d46c-7fc1-40a0-978a-58ab6e1041b0 req-97e347f4-50ee-418d-8956-1d6e6302bf25 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Refreshing network info cache for port 147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ae1e5636-ce93-4a37-a652-7170474cd11b tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "0d5a30d1-565c-47c9-8caa-84dab130e117" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ae1e5636-ce93-4a37-a652-7170474cd11b tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:39 user nova-compute[73469]: INFO nova.compute.manager [None req-ae1e5636-ce93-4a37-a652-7170474cd11b tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Rebooting instance
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ae1e5636-ce93-4a37-a652-7170474cd11b tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8630a96b-3bb9-4fb4-bbf5-c2ca65c41e31]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260]
Aug 22 03:03:39 user nova-compute[73469]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260] successful.
Aug 22 03:03:39 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[83aaae95-2295-427a-9180-8d4a12a59186]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.467s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] <== disconnect_volume: return (468ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG nova.network.neutron [req-adb7d46c-7fc1-40a0-978a-58ab6e1041b0 req-97e347f4-50ee-418d-8956-1d6e6302bf25 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Updated VIF entry in instance network info cache for port 147479ad-a9fc-4ccf-a900-95e347d1a79e. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG nova.network.neutron [req-adb7d46c-7fc1-40a0-978a-58ab6e1041b0 req-97e347f4-50ee-418d-8956-1d6e6302bf25 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Updating instance_info_cache with network_info: [{"id": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "address": "fa:16:3e:1e:69:04", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap147479ad-a9", "ovs_interfaceid": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-adb7d46c-7fc1-40a0-978a-58ab6e1041b0 req-97e347f4-50ee-418d-8956-1d6e6302bf25 service nova] Releasing lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-adb7d46c-7fc1-40a0-978a-58ab6e1041b0 req-97e347f4-50ee-418d-8956-1d6e6302bf25 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-vif-unplugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-adb7d46c-7fc1-40a0-978a-58ab6e1041b0 req-97e347f4-50ee-418d-8956-1d6e6302bf25 service nova] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-adb7d46c-7fc1-40a0-978a-58ab6e1041b0 req-97e347f4-50ee-418d-8956-1d6e6302bf25 service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-adb7d46c-7fc1-40a0-978a-58ab6e1041b0 req-97e347f4-50ee-418d-8956-1d6e6302bf25 service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-adb7d46c-7fc1-40a0-978a-58ab6e1041b0 req-97e347f4-50ee-418d-8956-1d6e6302bf25 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] No waiting events found dispatching network-vif-unplugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:39 user nova-compute[73469]: WARNING nova.compute.manager [req-adb7d46c-7fc1-40a0-978a-58ab6e1041b0 req-97e347f4-50ee-418d-8956-1d6e6302bf25 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received unexpected event network-vif-unplugged-f38d1396-0fe4-4107-8815-7420deceedab for instance with vm_state resized and task_state resize_reverting.
Aug 22 03:03:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ae1e5636-ce93-4a37-a652-7170474cd11b tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquired lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:03:39 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ae1e5636-ce93-4a37-a652-7170474cd11b tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ae1e5636-ce93-4a37-a652-7170474cd11b tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Updating instance_info_cache with network_info: [{"id": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "address": "fa:16:3e:1e:69:04", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap147479ad-a9", "ovs_interfaceid": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ae1e5636-ce93-4a37-a652-7170474cd11b tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Releasing lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG nova.objects.instance [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lazy-loading 'migration_context' on Instance uuid 5984759d-28f1-45e8-bb4c-27bd8df426f4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG nova.compute.manager [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG nova.compute.manager [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] No waiting events found dispatching network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:40 user nova-compute[73469]: WARNING nova.compute.manager [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received unexpected event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab for instance with vm_state resized and task_state resize_reverting.
Aug 22 03:03:40 user nova-compute[73469]: DEBUG nova.compute.manager [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG nova.compute.manager [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] No waiting events found dispatching network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:40 user nova-compute[73469]: WARNING nova.compute.manager [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received unexpected event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab for instance with vm_state resized and task_state resize_reverting.
Aug 22 03:03:40 user nova-compute[73469]: DEBUG nova.compute.manager [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG nova.compute.manager [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] No waiting events found dispatching network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:40 user nova-compute[73469]: WARNING nova.compute.manager [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received unexpected event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab for instance with vm_state resized and task_state resize_reverting.
Aug 22 03:03:40 user nova-compute[73469]: DEBUG nova.compute.manager [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-vif-unplugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG nova.compute.manager [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] No waiting events found dispatching network-vif-unplugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:40 user nova-compute[73469]: WARNING nova.compute.manager [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received unexpected event network-vif-unplugged-f38d1396-0fe4-4107-8815-7420deceedab for instance with vm_state resized and task_state resize_reverting.
Aug 22 03:03:40 user nova-compute[73469]: DEBUG nova.compute.manager [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:40 user nova-compute[73469]: DEBUG nova.compute.manager [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] No waiting events found dispatching network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:40 user nova-compute[73469]: WARNING nova.compute.manager [req-8765fd66-ee3e-4f24-9bec-60fc7b3ce2fc req-fac6ac5d-4068-4ee5-910a-4a165645395f service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received unexpected event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab for instance with vm_state resized and task_state resize_reverting.
Aug 22 03:03:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ae1e5636-ce93-4a37-a652-7170474cd11b tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:03:41 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:03:41 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:03:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.798s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:41 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:03:41 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:03:41 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:03:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 22 03:03:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] There are 0 instances to clean {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 22 03:03:41 user nova-compute[73469]: INFO nova.compute.manager [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Swapping old allocation on dict_keys(['4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c']) held by migration ab7a6a11-e343-4905-bf2e-fd016f6a6cf7 for instance
Aug 22 03:03:41 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Overwriting current allocation {'allocations': {'4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 32}}, 'project_id': 'd9d41329e1ad49bc94369a54d2798ac6', 'user_id': '6d3f2f35df22412cac98e90f1bb80b08', 'consumer_generation': 1} on consumer 5984759d-28f1-45e8-bb4c-27bd8df426f4 {{(pid=73469) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 22 03:03:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:03:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquired lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:03:41 user nova-compute[73469]: DEBUG nova.network.neutron [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG nova.network.neutron [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Updating instance_info_cache with network_info: [{"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Releasing lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG os_brick.utils [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf8271d-e335-4a4f-8bfa-e49246db8fe7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[761f5e5a-5efc-401b-9919-2bba20aa2df4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b18988-8642-4ff2-99d6-002e1c0f277b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[34357c1d-9808-4a56-94ed-dcf1221fb75e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:03:42 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:03:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2afe92b-ae38-4265-a152-873337f383e7]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:03:42 user nova-compute[73469]: DEBUG os_brick.utils [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:03:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:43 user nova-compute[73469]: DEBUG nova.compute.manager [req-a91e5a75-bad4-473f-86b6-60e826de0aaa req-e02e67bb-01a3-4cba-985d-a4e810f0381b service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Received event network-vif-unplugged-147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a91e5a75-bad4-473f-86b6-60e826de0aaa req-e02e67bb-01a3-4cba-985d-a4e810f0381b service nova] Acquiring lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a91e5a75-bad4-473f-86b6-60e826de0aaa req-e02e67bb-01a3-4cba-985d-a4e810f0381b service nova] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a91e5a75-bad4-473f-86b6-60e826de0aaa req-e02e67bb-01a3-4cba-985d-a4e810f0381b service nova] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:43 user nova-compute[73469]: DEBUG nova.compute.manager [req-a91e5a75-bad4-473f-86b6-60e826de0aaa req-e02e67bb-01a3-4cba-985d-a4e810f0381b service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] No waiting events found dispatching network-vif-unplugged-147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:43 user nova-compute[73469]: WARNING nova.compute.manager [req-a91e5a75-bad4-473f-86b6-60e826de0aaa req-e02e67bb-01a3-4cba-985d-a4e810f0381b service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Received unexpected event network-vif-unplugged-147479ad-a9fc-4ccf-a900-95e347d1a79e for instance with vm_state active and task_state reboot_started.
Aug 22 03:03:43 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:03:43 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:03:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:43 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:03:43 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ae1e5636-ce93-4a37-a652-7170474cd11b tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Instance shutdown successfully.
Aug 22 03:03:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-024235d2-7cf7-46d9-9950-03d65201fcfd req-23ac3085-a2f4-4bb7-90bc-4095ba31cb79 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Received event network-vif-plugged-147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-024235d2-7cf7-46d9-9950-03d65201fcfd req-23ac3085-a2f4-4bb7-90bc-4095ba31cb79 service nova] Acquiring lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-024235d2-7cf7-46d9-9950-03d65201fcfd req-23ac3085-a2f4-4bb7-90bc-4095ba31cb79 service nova] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-024235d2-7cf7-46d9-9950-03d65201fcfd req-23ac3085-a2f4-4bb7-90bc-4095ba31cb79 service nova] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-024235d2-7cf7-46d9-9950-03d65201fcfd req-23ac3085-a2f4-4bb7-90bc-4095ba31cb79 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] No waiting events found dispatching network-vif-plugged-147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:45 user nova-compute[73469]: WARNING nova.compute.manager [req-024235d2-7cf7-46d9-9950-03d65201fcfd req-23ac3085-a2f4-4bb7-90bc-4095ba31cb79 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Received unexpected event network-vif-plugged-147479ad-a9fc-4ccf-a900-95e347d1a79e for instance with vm_state active and task_state reboot_started.
Aug 22 03:03:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:03:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:03:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG nova.compute.manager [req-87fc5f34-240b-47dc-b7e6-34279ef657d1 req-1302cf94-3049-46a0-a8e6-68a93a9402b4 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Received event network-vif-plugged-147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-87fc5f34-240b-47dc-b7e6-34279ef657d1 req-1302cf94-3049-46a0-a8e6-68a93a9402b4 service nova] Acquiring lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-87fc5f34-240b-47dc-b7e6-34279ef657d1 req-1302cf94-3049-46a0-a8e6-68a93a9402b4 service nova] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-87fc5f34-240b-47dc-b7e6-34279ef657d1 req-1302cf94-3049-46a0-a8e6-68a93a9402b4 service nova] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG nova.compute.manager [req-87fc5f34-240b-47dc-b7e6-34279ef657d1 req-1302cf94-3049-46a0-a8e6-68a93a9402b4 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] No waiting events found dispatching network-vif-plugged-147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:47 user nova-compute[73469]: WARNING nova.compute.manager [req-87fc5f34-240b-47dc-b7e6-34279ef657d1 req-1302cf94-3049-46a0-a8e6-68a93a9402b4 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Received unexpected event network-vif-plugged-147479ad-a9fc-4ccf-a900-95e347d1a79e for instance with vm_state active and task_state reboot_started.
Aug 22 03:03:47 user nova-compute[73469]: DEBUG nova.compute.manager [req-87fc5f34-240b-47dc-b7e6-34279ef657d1 req-1302cf94-3049-46a0-a8e6-68a93a9402b4 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Received event network-vif-plugged-147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-87fc5f34-240b-47dc-b7e6-34279ef657d1 req-1302cf94-3049-46a0-a8e6-68a93a9402b4 service nova] Acquiring lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-87fc5f34-240b-47dc-b7e6-34279ef657d1 req-1302cf94-3049-46a0-a8e6-68a93a9402b4 service nova] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-87fc5f34-240b-47dc-b7e6-34279ef657d1 req-1302cf94-3049-46a0-a8e6-68a93a9402b4 service nova] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG nova.compute.manager [req-87fc5f34-240b-47dc-b7e6-34279ef657d1 req-1302cf94-3049-46a0-a8e6-68a93a9402b4 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] No waiting events found dispatching network-vif-plugged-147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:47 user nova-compute[73469]: WARNING nova.compute.manager [req-87fc5f34-240b-47dc-b7e6-34279ef657d1 req-1302cf94-3049-46a0-a8e6-68a93a9402b4 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Received unexpected event network-vif-plugged-147479ad-a9fc-4ccf-a900-95e347d1a79e for instance with vm_state active and task_state reboot_started.
Aug 22 03:03:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Removed pending event for 0d5a30d1-565c-47c9-8caa-84dab130e117 due to event {{(pid=73469) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673427.6875446, 0d5a30d1-565c-47c9-8caa-84dab130e117 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:03:47 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] VM Resumed (Lifecycle Event)
Aug 22 03:03:47 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Instance running successfully.
Aug 22 03:03:47 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ae1e5636-ce93-4a37-a652-7170474cd11b tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Instance soft rebooted successfully.
Aug 22 03:03:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ae1e5636-ce93-4a37-a652-7170474cd11b tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:03:47 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 22 03:03:47 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673427.7004404, 0d5a30d1-565c-47c9-8caa-84dab130e117 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:03:47 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] VM Started (Lifecycle Event)
Aug 22 03:03:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ae1e5636-ce93-4a37-a652-7170474cd11b tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.449s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:47 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 22 03:03:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:03:49 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:03:49 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=7088MB free_disk=24.94620132446289GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d0668c0-7a49-4857-9b69-541021f18ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance dc3f5545-8ebb-4947-97d0-98a91f67e421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8242cec1-3b35-4d14-9e0b-db8a7e75697d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 2e621408-a0af-460b-80a2-3446b5f1aadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82e872a7-70b0-4290-9a11-5316765aed01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 20316a2a-2f1f-4008-ab14-551e627bf680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 980e57bf-dec9-46f3-8d69-e20a17603af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 0d5a30d1-565c-47c9-8caa-84dab130e117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 5984759d-28f1-45e8-bb4c-27bd8df426f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 4765dbfc-4219-4797-b40f-24698fa033bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance d8433c45-b889-4a7b-88c2-ba00679b1d26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 84706228-0050-49ac-886a-70842ce8dd3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:03:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:03:50 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:03:50 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:03:50 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:03:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:50 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:03:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 22 03:03:51 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:03:51 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:03:51 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:03:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:03:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:03:51 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:03:52 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Updating instance_info_cache with network_info: [{"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:03:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-5984759d-28f1-45e8-bb4c-27bd8df426f4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:03:52 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:03:52 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:03:52 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:03:52 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:03:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:53 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673418.9024308, 5984759d-28f1-45e8-bb4c-27bd8df426f4 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:03:53 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] VM Stopped (Lifecycle Event)
Aug 22 03:03:53 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9f4955b5-e895-46d6-93a2-beef4712476c None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:03:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Starting finish_revert_migration {{(pid=73469) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Start _get_guest_xml network_info=[{"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': '29fcd0f3-2fa1-40ca-b330-85fd64b03663', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvGlDOhP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5984759d-28f1-45e8-bb4c-27bd8df426f4', 'attached_at': '2023-08-22T03:03:55.000000', 'detached_at': '', 'volume_id': 'ab9a6baf-31df-4c2e-a390-daa9a68e83fc', 'serial': 'ab9a6baf-31df-4c2e-a390-daa9a68e83fc'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:03:55 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:03:55 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.objects.instance [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5984759d-28f1-45e8-bb4c-27bd8df426f4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvGlDOhP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:03:55 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:03:55 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:03:55 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cd1664-f646-4751-bcbc-dabd7f9d4885]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:03:55 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8950920a-3b35-43ad-9a6f-ef139748e8b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc] added
Aug 22 03:03:55 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9540881-6ae2-4a26-ad0b-6e908c964c73]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[01047dd9-5c18-41bf-a663-e5c55e70d3c1]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvGlDOhP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvGlDOhP" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[468ebfb5-71a1-4927-9f10-0eecb2ad9192]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tvGlDOhP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1666b5d7-af62-4016-875c-b914c13ae65f]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1709e9c-f9e7-49f0-9d8a-162ce859b499]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:03:55 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:03:55 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[465a1eae-14ac-4cf5-87cc-ccbfae981995]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260]
Aug 22 03:03:55 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260] successful.
Aug 22 03:03:55 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb0a799-98c9-4330-b49d-010fbcbe432a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd0c100-0cda-4eea-a1d5-2594ab5eecc2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:55 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:03:55 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:03:55 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f616b485-c86b-42e2-8879-d9fb40f4d881]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:03:55 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: None {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:03:56 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:03:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvGlDOhP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:03:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:03:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26266363361643366', 'path': '/dev/sdd'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:03:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266363361643366', 'path': '/dev/sdd'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:03:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1537383573',display_name='tempest-ServerActionsTestOtherB-server-1537383573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1537383573',id=18,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbR7/rnM2AeZHN+BHEO9wy6tT5C/8gqpz2OLyZ0PrOkSO9sSAq61LBq8B59x8O0SJWkSJu3MS+tJxcGT/zQuOBrkxHQmB8JC+FatiKrmiFApJOgsuSU1qC5st2CAxnTvw==',key_name='tempest-keypair-568897893',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:02:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d9d41329e1ad49bc94369a54d2798ac6',ramdisk_id='',reservation_id='r-6rax0pzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1653559752',owner_user_name='tempest-ServerActionsTestOtherB-1653559752-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d3f2f35df22412cac98e90f1bb80b08',uuid=5984759d-28f1-45e8-bb4c-27bd8df426f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:03:57 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Converting VIF {"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:57 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:03:57 user nova-compute[73469]:   <uuid>5984759d-28f1-45e8-bb4c-27bd8df426f4</uuid>
Aug 22 03:03:57 user nova-compute[73469]:   <name>instance-00000012</name>
Aug 22 03:03:57 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:03:57 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:03:57 user nova-compute[73469]:   <metadata>
Aug 22 03:03:57 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:03:57 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:03:57 user nova-compute[73469]:       <nova:name>tempest-ServerActionsTestOtherB-server-1537383573</nova:name>
Aug 22 03:03:57 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:03:55</nova:creationTime>
Aug 22 03:03:57 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:03:57 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:03:57 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:03:57 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:03:57 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:03:57 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:03:57 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:03:57 user nova-compute[73469]:       <nova:owner>
Aug 22 03:03:57 user nova-compute[73469]:         <nova:user uuid="6d3f2f35df22412cac98e90f1bb80b08">tempest-ServerActionsTestOtherB-1653559752-project-member</nova:user>
Aug 22 03:03:57 user nova-compute[73469]:         <nova:project uuid="d9d41329e1ad49bc94369a54d2798ac6">tempest-ServerActionsTestOtherB-1653559752</nova:project>
Aug 22 03:03:57 user nova-compute[73469]:       </nova:owner>
Aug 22 03:03:57 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:03:57 user nova-compute[73469]:       <nova:ports>
Aug 22 03:03:57 user nova-compute[73469]:         <nova:port uuid="f38d1396-0fe4-4107-8815-7420deceedab">
Aug 22 03:03:57 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 22 03:03:57 user nova-compute[73469]:         </nova:port>
Aug 22 03:03:57 user nova-compute[73469]:       </nova:ports>
Aug 22 03:03:57 user nova-compute[73469]:     </nova:instance>
Aug 22 03:03:57 user nova-compute[73469]:   </metadata>
Aug 22 03:03:57 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:03:57 user nova-compute[73469]:     <system>
Aug 22 03:03:57 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:03:57 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:03:57 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:03:57 user nova-compute[73469]:       <entry name="serial">5984759d-28f1-45e8-bb4c-27bd8df426f4</entry>
Aug 22 03:03:57 user nova-compute[73469]:       <entry name="uuid">5984759d-28f1-45e8-bb4c-27bd8df426f4</entry>
Aug 22 03:03:57 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:03:57 user nova-compute[73469]:     </system>
Aug 22 03:03:57 user nova-compute[73469]:   </sysinfo>
Aug 22 03:03:57 user nova-compute[73469]:   <os>
Aug 22 03:03:57 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:03:57 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:03:57 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:03:57 user nova-compute[73469]:   </os>
Aug 22 03:03:57 user nova-compute[73469]:   <features>
Aug 22 03:03:57 user nova-compute[73469]:     <acpi/>
Aug 22 03:03:57 user nova-compute[73469]:     <apic/>
Aug 22 03:03:57 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:03:57 user nova-compute[73469]:   </features>
Aug 22 03:03:57 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:03:57 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:03:57 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:03:57 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:03:57 user nova-compute[73469]:   </clock>
Aug 22 03:03:57 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:03:57 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:03:57 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:03:57 user nova-compute[73469]:   </cpu>
Aug 22 03:03:57 user nova-compute[73469]:   <devices>
Aug 22 03:03:57 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:03:57 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:03:57 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk"/>
Aug 22 03:03:57 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:03:57 user nova-compute[73469]:     </disk>
Aug 22 03:03:57 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:03:57 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:03:57 user nova-compute[73469]:       <source dev="/dev/sdd"/>
Aug 22 03:03:57 user nova-compute[73469]:       <target dev="vdb" bus="virtio"/>
Aug 22 03:03:57 user nova-compute[73469]:       <serial>ab9a6baf-31df-4c2e-a390-daa9a68e83fc</serial>
Aug 22 03:03:57 user nova-compute[73469]:     </disk>
Aug 22 03:03:57 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:03:57 user nova-compute[73469]:       <mac address="fa:16:3e:f8:e1:3e"/>
Aug 22 03:03:57 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:03:57 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:03:57 user nova-compute[73469]:       <target dev="tapf38d1396-0f"/>
Aug 22 03:03:57 user nova-compute[73469]:     </interface>
Aug 22 03:03:57 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:03:57 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/console.log" append="off"/>
Aug 22 03:03:57 user nova-compute[73469]:     </serial>
Aug 22 03:03:57 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:03:57 user nova-compute[73469]:     <video>
Aug 22 03:03:57 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:03:57 user nova-compute[73469]:     </video>
Aug 22 03:03:57 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:03:57 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:03:57 user nova-compute[73469]:     </rng>
Aug 22 03:03:57 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:03:57 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:03:57 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:03:57 user nova-compute[73469]:     </memballoon>
Aug 22 03:03:57 user nova-compute[73469]:   </devices>
Aug 22 03:03:57 user nova-compute[73469]: </domain>
Aug 22 03:03:57 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:03:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1537383573',display_name='tempest-ServerActionsTestOtherB-server-1537383573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1537383573',id=18,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbR7/rnM2AeZHN+BHEO9wy6tT5C/8gqpz2OLyZ0PrOkSO9sSAq61LBq8B59x8O0SJWkSJu3MS+tJxcGT/zQuOBrkxHQmB8JC+FatiKrmiFApJOgsuSU1qC5st2CAxnTvw==',key_name='tempest-keypair-568897893',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:02:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d9d41329e1ad49bc94369a54d2798ac6',ramdisk_id='',reservation_id='r-6rax0pzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1653559752',owner_user_name='tempest-ServerActionsTestOtherB-1653559752-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d3f2f35df22412cac98e90f1bb80b08',uuid=5984759d-28f1-45e8-bb4c-27bd8df426f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:03:57 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Converting VIF {"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:03:57 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:03:57 user nova-compute[73469]: DEBUG os_vif [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:03:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:03:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf38d1396-0f, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf38d1396-0f, col_values=(('external_ids', {'iface-id': 'f38d1396-0fe4-4107-8815-7420deceedab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:e1:3e', 'vm-uuid': '5984759d-28f1-45e8-bb4c-27bd8df426f4'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:03:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:03:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:57 user nova-compute[73469]: INFO os_vif [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f')
Aug 22 03:03:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:58 user nova-compute[73469]: DEBUG nova.compute.manager [req-97696ab7-f7d1-4aff-99f6-d2e198dcc906 req-d77d1e46-18e1-4db0-91f6-c801fc782fe3 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:03:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-97696ab7-f7d1-4aff-99f6-d2e198dcc906 req-d77d1e46-18e1-4db0-91f6-c801fc782fe3 service nova] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:03:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-97696ab7-f7d1-4aff-99f6-d2e198dcc906 req-d77d1e46-18e1-4db0-91f6-c801fc782fe3 service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:03:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-97696ab7-f7d1-4aff-99f6-d2e198dcc906 req-d77d1e46-18e1-4db0-91f6-c801fc782fe3 service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:03:58 user nova-compute[73469]: DEBUG nova.compute.manager [req-97696ab7-f7d1-4aff-99f6-d2e198dcc906 req-d77d1e46-18e1-4db0-91f6-c801fc782fe3 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] No waiting events found dispatching network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:03:58 user nova-compute[73469]: WARNING nova.compute.manager [req-97696ab7-f7d1-4aff-99f6-d2e198dcc906 req-d77d1e46-18e1-4db0-91f6-c801fc782fe3 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received unexpected event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab for instance with vm_state resized and task_state resize_reverting.
Aug 22 03:03:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:03:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:00 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673440.5779753, 5984759d-28f1-45e8-bb4c-27bd8df426f4 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:04:00 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] VM Resumed (Lifecycle Event)
Aug 22 03:04:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:04:00 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Instance running successfully.
Aug 22 03:04:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] finish_revert_migration finished successfully. {{(pid=73469) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 22 03:04:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:04:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:04:00 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 22 03:04:00 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673440.5797582, 5984759d-28f1-45e8-bb4c-27bd8df426f4 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:04:00 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] VM Started (Lifecycle Event)
Aug 22 03:04:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:04:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:04:00 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 22 03:04:00 user nova-compute[73469]: DEBUG nova.compute.manager [req-ab09a1ee-0897-4856-a6d1-43235ac6b132 req-50b6cafe-a708-4fcf-98f0-7701d8646c1a service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:04:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ab09a1ee-0897-4856-a6d1-43235ac6b132 req-50b6cafe-a708-4fcf-98f0-7701d8646c1a service nova] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ab09a1ee-0897-4856-a6d1-43235ac6b132 req-50b6cafe-a708-4fcf-98f0-7701d8646c1a service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ab09a1ee-0897-4856-a6d1-43235ac6b132 req-50b6cafe-a708-4fcf-98f0-7701d8646c1a service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:00 user nova-compute[73469]: DEBUG nova.compute.manager [req-ab09a1ee-0897-4856-a6d1-43235ac6b132 req-50b6cafe-a708-4fcf-98f0-7701d8646c1a service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] No waiting events found dispatching network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:04:00 user nova-compute[73469]: WARNING nova.compute.manager [req-ab09a1ee-0897-4856-a6d1-43235ac6b132 req-50b6cafe-a708-4fcf-98f0-7701d8646c1a service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received unexpected event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab for instance with vm_state resized and task_state resize_reverting.
Aug 22 03:04:00 user nova-compute[73469]: INFO nova.compute.manager [None req-f93d0448-c692-412a-bc93-9b96569c8819 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Updating instance to original state: 'active'
Aug 22 03:04:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "20316a2a-2f1f-4008-ab14-551e627bf680" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "20316a2a-2f1f-4008-ab14-551e627bf680" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG nova.objects.instance [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lazy-loading 'flavor' on Instance uuid 20316a2a-2f1f-4008-ab14-551e627bf680 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "20316a2a-2f1f-4008-ab14-551e627bf680" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "20316a2a-2f1f-4008-ab14-551e627bf680" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "20316a2a-2f1f-4008-ab14-551e627bf680" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:08 user nova-compute[73469]: INFO nova.compute.manager [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Attaching volume a2728c16-00d9-4b9e-9480-7bf8affa6382 to /dev/vdb
Aug 22 03:04:08 user nova-compute[73469]: DEBUG os_brick.utils [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5fbfe6-6f3a-4272-9c11-151725256da0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51ef9b7-28c8-4fc7-923d-e3b8769d75f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a81e923-ee4a-4eae-bb2f-8afec97f4a74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ce86bb-1aa4-4d92-94ee-a74fee714b57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:04:08 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:04:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[53406aaf-4a64-42c0-b2b4-3d54118c3dd2]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG os_brick.utils [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:04:08 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Updating existing volume attachment record: 8f393b40-d97b-48b3-8c51-31d08c3cfb03 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "e43158b8-28fc-429c-b329-26be91761d4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "e43158b8-28fc-429c-b329-26be91761d4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:04:12 user nova-compute[73469]: INFO nova.compute.claims [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Claim successful on node user
Aug 22 03:04:12 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Refreshing inventories for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Updating ProviderTree inventory for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Updating inventory in ProviderTree for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Refreshing aggregate associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, aggregates: None {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Refreshing trait associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "d8433c45-b889-4a7b-88c2-ba00679b1d26" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:12 user nova-compute[73469]: INFO nova.compute.manager [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Detaching volume 04ccfa44-b35b-49f2-9c95-5ae2d56e4932
Aug 22 03:04:12 user nova-compute[73469]: INFO nova.virt.block_device [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Attempting to driver detach volume 04ccfa44-b35b-49f2-9c95-5ae2d56e4932 from mountpoint /dev/vdc
Aug 22 03:04:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Attempting to detach device vdc from instance d8433c45-b889-4a7b-88c2-ba00679b1d26 from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:04:12 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:04:12 user nova-compute[73469]:   <source dev="/dev/sde"/>
Aug 22 03:04:12 user nova-compute[73469]:   <target dev="vdc" bus="virtio"/>
Aug 22 03:04:12 user nova-compute[73469]:   <serial>04ccfa44-b35b-49f2-9c95-5ae2d56e4932</serial>
Aug 22 03:04:12 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 22 03:04:12 user nova-compute[73469]: </disk>
Aug 22 03:04:12 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:04:12 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Successfully detached device vdc from instance d8433c45-b889-4a7b-88c2-ba00679b1d26 from the persistent domain config.
Aug 22 03:04:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d8433c45-b889-4a7b-88c2-ba00679b1d26 from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:04:12 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:04:12 user nova-compute[73469]:   <source dev="/dev/sde"/>
Aug 22 03:04:12 user nova-compute[73469]:   <target dev="vdc" bus="virtio"/>
Aug 22 03:04:12 user nova-compute[73469]:   <serial>04ccfa44-b35b-49f2-9c95-5ae2d56e4932</serial>
Aug 22 03:04:12 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 22 03:04:12 user nova-compute[73469]: </disk>
Aug 22 03:04:12 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:04:12 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:04:13 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:04:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG nova.policy [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7b228f99c9e4d058e128a5a99636b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9131cb883044191931dc31e51e94766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:04:13 user nova-compute[73469]: INFO nova.virt.block_device [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Booting with volume-backed-image a2a344d0-c924-4f6a-b6e6-23be8c2d6ded at /dev/vda
Aug 22 03:04:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692673453.4255812, d8433c45-b889-4a7b-88c2-ba00679b1d26 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d8433c45-b889-4a7b-88c2-ba00679b1d26 {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:04:13 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Successfully detached device vdc from instance d8433c45-b889-4a7b-88c2-ba00679b1d26 from the live domain config.
Aug 22 03:04:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcgtOVho', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:04:13 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:04:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ef0b7e-2ee2-483a-813a-0ae97dd9f3ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b71f968-aea8-4c8b-b3d1-fa331b4442b5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:13 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:04:13 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:13 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:13 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:13 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:13 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:13 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:13 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:13 user nova-compute[73469]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 (non-flash)
Aug 22 03:04:13 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:13 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:13 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:13 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:13 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:13 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:13 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a41ec700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932'): ({'sde'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Removing single pathed devices sde {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6572dc7-26cf-4c17-bffa-6b1b34d55840]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcda52e-895a-4d5e-a5f2-f20e12bab51a]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Flushing IO for device /dev/sde {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[009cddef-9443-4754-95ab-d567cac8ecc0]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5beb0ef1-4b48-4ea2-b559-de92ca38a377]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] SCSI volumes sde have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[28649c71-e053-4f0f-b03a-01b1b85a4587]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a839705-31ab-4d8a-b803-3767a1e3774a]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932, portal: 172.16.0.220,3260]
Aug 22 03:04:13 user nova-compute[73469]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932, portal: 172.16.0.220,3260] successful.
Aug 22 03:04:13 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ccfa44-b35b-49f2-9c95-5ae2d56e4932 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[844d186c-9609-41c2-a170-e94c9315034a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] <== disconnect_volume: return (363ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:04:13 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Successfully created port: bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:04:14 user nova-compute[73469]: DEBUG nova.objects.instance [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'flavor' on Instance uuid d8433c45-b889-4a7b-88c2-ba00679b1d26 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-727c11d4-6b27-4a49-a197-548d41ecb040 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.020s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:15 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Successfully updated port: bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:04:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "refresh_cache-e43158b8-28fc-429c-b329-26be91761d4f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:04:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquired lock "refresh_cache-e43158b8-28fc-429c-b329-26be91761d4f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:04:15 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:04:15 user nova-compute[73469]: DEBUG nova.compute.manager [req-5f4ab8c2-9858-4d56-89e3-e13da57d43ca req-138c3c70-faab-47f5-965a-fd678fe8d0a0 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received event network-changed-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:04:15 user nova-compute[73469]: DEBUG nova.compute.manager [req-5f4ab8c2-9858-4d56-89e3-e13da57d43ca req-138c3c70-faab-47f5-965a-fd678fe8d0a0 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Refreshing instance network info cache due to event network-changed-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:04:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5f4ab8c2-9858-4d56-89e3-e13da57d43ca req-138c3c70-faab-47f5-965a-fd678fe8d0a0 service nova] Acquiring lock "refresh_cache-e43158b8-28fc-429c-b329-26be91761d4f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:04:15 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:04:15 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Updating instance_info_cache with network_info: [{"id": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "address": "fa:16:3e:94:d6:2d", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbb3f1b-29", "ovs_interfaceid": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:04:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Releasing lock "refresh_cache-e43158b8-28fc-429c-b329-26be91761d4f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:04:15 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Instance network_info: |[{"id": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "address": "fa:16:3e:94:d6:2d", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbb3f1b-29", "ovs_interfaceid": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:04:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5f4ab8c2-9858-4d56-89e3-e13da57d43ca req-138c3c70-faab-47f5-965a-fd678fe8d0a0 service nova] Acquired lock "refresh_cache-e43158b8-28fc-429c-b329-26be91761d4f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:04:15 user nova-compute[73469]: DEBUG nova.network.neutron [req-5f4ab8c2-9858-4d56-89e3-e13da57d43ca req-138c3c70-faab-47f5-965a-fd678fe8d0a0 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Refreshing network info cache for port bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:04:15 user nova-compute[73469]: DEBUG nova.network.neutron [req-5f4ab8c2-9858-4d56-89e3-e13da57d43ca req-138c3c70-faab-47f5-965a-fd678fe8d0a0 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Updated VIF entry in instance network info cache for port bbbb3f1b-29b6-4f01-9296-3452d13d0b0c. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:04:15 user nova-compute[73469]: DEBUG nova.network.neutron [req-5f4ab8c2-9858-4d56-89e3-e13da57d43ca req-138c3c70-faab-47f5-965a-fd678fe8d0a0 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Updating instance_info_cache with network_info: [{"id": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "address": "fa:16:3e:94:d6:2d", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbb3f1b-29", "ovs_interfaceid": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:04:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5f4ab8c2-9858-4d56-89e3-e13da57d43ca req-138c3c70-faab-47f5-965a-fd678fe8d0a0 service nova] Releasing lock "refresh_cache-e43158b8-28fc-429c-b329-26be91761d4f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:04:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOJmkSsj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:04:26 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:04:26 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:04:26 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa4fd97-310f-4cc1-8014-61ea6d27869d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:04:26 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d34683d-4561-4020-aff2-25862863dbef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382] added
Aug 22 03:04:26 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e1924e-853d-4e3e-a284-63e436ab8fa7]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d2199d-abf0-4dd1-8503-c1687dc66f67]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOJmkSsj {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOJmkSsj" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f12de94-80cd-4fbb-b69a-477fdc3c9472]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EOJmkSsj'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3525c8c2-b54a-4089-998b-3649f23bc72a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3966d1-4aa4-41fc-b56c-7296b4a433ae]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:26 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:26 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7ff878-c3c3-46df-95d7-30705cfc9be1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382, portal: 172.16.0.220,3260]
Aug 22 03:04:26 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382, portal: 172.16.0.220,3260] successful.
Aug 22 03:04:26 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ea30b0-2877-4ade-861c-8e9e722c6ce1]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d490ece5-5348-4fab-875f-896be73fe25c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:04:26 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:26 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:04:26 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5b78d8-5110-41c3-96d1-b79a1cd67648]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:04:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOJmkSsj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:04:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:04:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26263343864653065', 'path': '/dev/sde'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:04:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263343864653065', 'path': '/dev/sde'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:04:27 user nova-compute[73469]: DEBUG nova.objects.instance [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lazy-loading 'flavor' on Instance uuid 20316a2a-2f1f-4008-ab14-551e627bf680 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:04:27 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:04:27 user nova-compute[73469]:   <source dev="/dev/sde"/>
Aug 22 03:04:27 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:04:27 user nova-compute[73469]:   <serial>a2728c16-00d9-4b9e-9480-7bf8affa6382</serial>
Aug 22 03:04:27 user nova-compute[73469]: </disk>
Aug 22 03:04:27 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:04:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:04:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:04:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] No VIF found with MAC fa:16:3e:cf:fb:77, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:04:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89bcddb3-a10a-4480-96e3-30d443daade7 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "20316a2a-2f1f-4008-ab14-551e627bf680" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.807s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:29 user nova-compute[73469]: INFO nova.compute.manager [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Rescuing
Aug 22 03:04:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:04:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquired lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:04:29 user nova-compute[73469]: DEBUG nova.network.neutron [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:04:29 user nova-compute[73469]: DEBUG nova.network.neutron [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Updating instance_info_cache with network_info: [{"id": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "address": "fa:16:3e:cf:fb:77", "network": {"id": "48051bc9-cc7d-4248-8077-3bd59a1cb474", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab77793ce9a4b85b90e3b7469daf58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3d6f3d-12", "ovs_interfaceid": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:04:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Releasing lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:04:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-64b7352d-c014-4084-8a15-d9adb0c053f4 req-9de8c618-630c-45bc-97c4-d4e9b34220c2 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received event network-vif-unplugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:04:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-64b7352d-c014-4084-8a15-d9adb0c053f4 req-9de8c618-630c-45bc-97c4-d4e9b34220c2 service nova] Acquiring lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-64b7352d-c014-4084-8a15-d9adb0c053f4 req-9de8c618-630c-45bc-97c4-d4e9b34220c2 service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-64b7352d-c014-4084-8a15-d9adb0c053f4 req-9de8c618-630c-45bc-97c4-d4e9b34220c2 service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-64b7352d-c014-4084-8a15-d9adb0c053f4 req-9de8c618-630c-45bc-97c4-d4e9b34220c2 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] No waiting events found dispatching network-vif-unplugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:04:30 user nova-compute[73469]: WARNING nova.compute.manager [req-64b7352d-c014-4084-8a15-d9adb0c053f4 req-9de8c618-630c-45bc-97c4-d4e9b34220c2 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received unexpected event network-vif-unplugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 for instance with vm_state active and task_state rescuing.
Aug 22 03:04:30 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Instance destroyed successfully.
Aug 22 03:04:30 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Attempting a stable device rescue
Aug 22 03:04:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73469) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 22 03:04:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Instance directory exists: not creating {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 22 03:04:30 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Creating image(s)
Aug 22 03:04:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "/opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "/opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "/opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:30 user nova-compute[73469]: DEBUG nova.objects.instance [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lazy-loading 'trusted_certs' on Instance uuid 20316a2a-2f1f-4008-ab14-551e627bf680 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "5d024a34e4ff0162280fbf83cf1134b4e1104813" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "5d024a34e4ff0162280fbf83cf1134b4e1104813" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d024a34e4ff0162280fbf83cf1134b4e1104813.part --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d024a34e4ff0162280fbf83cf1134b4e1104813.part --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:31 user nova-compute[73469]: DEBUG nova.virt.images [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] 412df048-fbda-44bf-8416-2fa5a9bd0661 was qcow2, converting to raw {{(pid=73469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 22 03:04:31 user nova-compute[73469]: DEBUG nova.privsep.utils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 22 03:04:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d024a34e4ff0162280fbf83cf1134b4e1104813.part /opt/stack/data/nova/instances/_base/5d024a34e4ff0162280fbf83cf1134b4e1104813.converted {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-bc331867-1e84-4c05-b9b2-6614c8cb0f96 req-9b66085c-37f9-40de-ac31-bdbfe05d8c58 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received event network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bc331867-1e84-4c05-b9b2-6614c8cb0f96 req-9b66085c-37f9-40de-ac31-bdbfe05d8c58 service nova] Acquiring lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bc331867-1e84-4c05-b9b2-6614c8cb0f96 req-9b66085c-37f9-40de-ac31-bdbfe05d8c58 service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bc331867-1e84-4c05-b9b2-6614c8cb0f96 req-9b66085c-37f9-40de-ac31-bdbfe05d8c58 service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-bc331867-1e84-4c05-b9b2-6614c8cb0f96 req-9b66085c-37f9-40de-ac31-bdbfe05d8c58 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] No waiting events found dispatching network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:04:32 user nova-compute[73469]: WARNING nova.compute.manager [req-bc331867-1e84-4c05-b9b2-6614c8cb0f96 req-9b66085c-37f9-40de-ac31-bdbfe05d8c58 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received unexpected event network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 for instance with vm_state active and task_state rescuing.
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-bc331867-1e84-4c05-b9b2-6614c8cb0f96 req-9b66085c-37f9-40de-ac31-bdbfe05d8c58 service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Received event network-changed-1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-bc331867-1e84-4c05-b9b2-6614c8cb0f96 req-9b66085c-37f9-40de-ac31-bdbfe05d8c58 service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Refreshing instance network info cache due to event network-changed-1f995853-c3f9-41c7-a27b-bf970a21b2b1. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bc331867-1e84-4c05-b9b2-6614c8cb0f96 req-9b66085c-37f9-40de-ac31-bdbfe05d8c58 service nova] Acquiring lock "refresh_cache-8a34f0c2-c0b0-4ba7-b9e4-673350a81646" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bc331867-1e84-4c05-b9b2-6614c8cb0f96 req-9b66085c-37f9-40de-ac31-bdbfe05d8c58 service nova] Acquired lock "refresh_cache-8a34f0c2-c0b0-4ba7-b9e4-673350a81646" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.network.neutron [req-bc331867-1e84-4c05-b9b2-6614c8cb0f96 req-9b66085c-37f9-40de-ac31-bdbfe05d8c58 service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Refreshing network info cache for port 1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d024a34e4ff0162280fbf83cf1134b4e1104813.part /opt/stack/data/nova/instances/_base/5d024a34e4ff0162280fbf83cf1134b4e1104813.converted" returned: 0 in 0.288s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d024a34e4ff0162280fbf83cf1134b4e1104813.converted --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d024a34e4ff0162280fbf83cf1134b4e1104813.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "5d024a34e4ff0162280fbf83cf1134b4e1104813" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.791s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "5d024a34e4ff0162280fbf83cf1134b4e1104813" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "5d024a34e4ff0162280fbf83cf1134b4e1104813" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d024a34e4ff0162280fbf83cf1134b4e1104813 --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.objects.instance [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'flavor' on Instance uuid 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d024a34e4ff0162280fbf83cf1134b4e1104813 --force-share --output=json" returned: 0 in 0.191s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d024a34e4ff0162280fbf83cf1134b4e1104813,backing_fmt=raw /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk.rescue {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d024a34e4ff0162280fbf83cf1134b4e1104813,backing_fmt=raw /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk.rescue" returned: 0 in 0.056s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "5d024a34e4ff0162280fbf83cf1134b4e1104813" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.objects.instance [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lazy-loading 'migration_context' on Instance uuid 20316a2a-2f1f-4008-ab14-551e627bf680 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Start _get_guest_xml network_info=[{"id": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "address": "fa:16:3e:cf:fb:77", "network": {"id": "48051bc9-cc7d-4248-8077-3bd59a1cb474", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "vif_mac": "fa:16:3e:cf:fb:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab77793ce9a4b85b90e3b7469daf58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3d6f3d-12", "ovs_interfaceid": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '412df048-fbda-44bf-8416-2fa5a9bd0661', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': '8f393b40-d97b-48b3-8c51-31d08c3cfb03', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOJmkSsj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '20316a2a-2f1f-4008-ab14-551e627bf680', 'attached_at': '', 'detached_at': '', 'volume_id': 'a2728c16-00d9-4b9e-9480-7bf8affa6382', 'serial': 'a2728c16-00d9-4b9e-9480-7bf8affa6382'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.objects.instance [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lazy-loading 'resources' on Instance uuid 20316a2a-2f1f-4008-ab14-551e627bf680 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.objects.instance [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lazy-loading 'numa_topology' on Instance uuid 20316a2a-2f1f-4008-ab14-551e627bf680 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:32 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:04:32 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:32 user nova-compute[73469]: INFO nova.compute.manager [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Attaching volume 1072e618-4680-4f68-9c2e-dd56519d5661 to /dev/vdb
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.network.neutron [req-bc331867-1e84-4c05-b9b2-6614c8cb0f96 req-9b66085c-37f9-40de-ac31-bdbfe05d8c58 service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Updated VIF entry in instance network info cache for port 1f995853-c3f9-41c7-a27b-bf970a21b2b1. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.network.neutron [req-bc331867-1e84-4c05-b9b2-6614c8cb0f96 req-9b66085c-37f9-40de-ac31-bdbfe05d8c58 service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Updating instance_info_cache with network_info: [{"id": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "address": "fa:16:3e:ea:7d:48", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f995853-c3", "ovs_interfaceid": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.objects.instance [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lazy-loading 'vcpu_model' on Instance uuid 20316a2a-2f1f-4008-ab14-551e627bf680 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bc331867-1e84-4c05-b9b2-6614c8cb0f96 req-9b66085c-37f9-40de-ac31-bdbfe05d8c58 service nova] Releasing lock "refresh_cache-8a34f0c2-c0b0-4ba7-b9e4-673350a81646" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOJmkSsj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:04:32 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:04:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:04:32 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:04:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:04:32 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:04:32 user nova-compute[73469]: DEBUG os_brick.utils [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d700cb-3c7c-4966-a4bf-b02839d3ec2e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = EOJmkSsj\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 22 03:04:32 user nova-compute[73469]: node.name = iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382
Aug 22 03:04:32 user nova-compute[73469]: node.tpgt = -1
Aug 22 03:04:32 user nova-compute[73469]: node.startup = automatic
Aug 22 03:04:32 user nova-compute[73469]: node.leading_login = No
Aug 22 03:04:32 user nova-compute[73469]: iface.iscsi_ifacename = default
Aug 22 03:04:32 user nova-compute[73469]: iface.net_ifacename = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.ipaddress = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.prefix_len = 0
Aug 22 03:04:32 user nova-compute[73469]: iface.hwaddress = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.transport_name = tcp
Aug 22 03:04:32 user nova-compute[73469]: iface.initiatorname = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.state = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.vlan_id = 0
Aug 22 03:04:32 user nova-compute[73469]: iface.vlan_priority = 0
Aug 22 03:04:32 user nova-compute[73469]: iface.vlan_state = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.iface_num = 0
Aug 22 03:04:32 user nova-compute[73469]: iface.mtu = 0
Aug 22 03:04:32 user nova-compute[73469]: iface.port = 0
Aug 22 03:04:32 user nova-compute[73469]: iface.bootproto = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.subnet_mask = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.gateway = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.dhcp_alt_client_id_state = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.dhcp_alt_client_id = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.dhcp_dns = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.dhcp_learn_iqn = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.dhcp_req_vendor_id_state = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.dhcp_vendor_id_state = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.dhcp_vendor_id = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.dhcp_slp_da = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.fragmentation = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.gratuitous_arp = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.incoming_forwarding = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.tos_state = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.tos = 0
Aug 22 03:04:32 user nova-compute[73469]: iface.ttl = 0
Aug 22 03:04:32 user nova-compute[73469]: iface.delayed_ack = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.tcp_nagle = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.tcp_wsf_state = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.tcp_wsf = 0
Aug 22 03:04:32 user nova-compute[73469]: iface.tcp_timer_scale = 0
Aug 22 03:04:32 user nova-compute[73469]: iface.tcp_timestamp = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.redirect = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.def_task_mgmt_timeout = 0
Aug 22 03:04:32 user nova-compute[73469]: iface.header_digest = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.data_digest = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.immediate_data = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.initial_r2t = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.data_seq_inorder = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.data_pdu_inorder = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.erl = 0
Aug 22 03:04:32 user nova-compute[73469]: iface.max_receive_data_len = 0
Aug 22 03:04:32 user nova-compute[73469]: iface.first_burst_len = 0
Aug 22 03:04:32 user nova-compute[73469]: iface.max_outstanding_r2t = 0
Aug 22 03:04:32 user nova-compute[73469]: iface.max_burst_len = 0
Aug 22 03:04:32 user nova-compute[73469]: iface.chap_auth = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.bidi_chap = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.strict_login_compliance = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.discovery_auth = <empty>
Aug 22 03:04:32 user nova-compute[73469]: iface.discovery_logout = <empty>
Aug 22 03:04:32 user nova-compute[73469]: node.discovery_address = <empty>
Aug 22 03:04:32 user nova-compute[73469]: node.discovery_port = 0
Aug 22 03:04:32 user nova-compute[73469]: node.discovery_type = static
Aug 22 03:04:32 user nova-compute[73469]: node.session.initial_cmdsn = 0
Aug 22 03:04:32 user nova-compute[73469]: node.session.initial_login_retry_max = 8
Aug 22 03:04:32 user nova-compute[73469]: node.session.xmit_thread_priority = -20
Aug 22 03:04:32 user nova-compute[73469]: node.session.cmds_max = 128
Aug 22 03:04:32 user nova-compute[73469]: node.session.queue_depth = 32
Aug 22 03:04:32 user nova-compute[73469]: node.session.nr_sessions = 1
Aug 22 03:04:32 user nova-compute[73469]: node.session.auth.authmethod = CHAP
Aug 22 03:04:32 user nova-compute[73469]: node.session.auth.username = EOJmkSsj
Aug 22 03:04:32 user nova-compute[73469]: node.session.auth.password = ***
Aug 22 03:04:32 user nova-compute[73469]: node.session.auth.username_in = <empty>
Aug 22 03:04:32 user nova-compute[73469]: node.session.auth.password_in = <empty>
Aug 22 03:04:32 user nova-compute[73469]: node.session.auth.chap_algs = MD5
Aug 22 03:04:32 user nova-compute[73469]: node.session.timeo.replacement_timeout = 120
Aug 22 03:04:32 user nova-compute[73469]: node.session.err_timeo.abort_timeout = 15
Aug 22 03:04:32 user nova-compute[73469]: node.session.err_timeo.lu_reset_timeout = 30
Aug 22 03:04:32 user nova-compute[73469]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 22 03:04:32 user nova-compute[73469]: node.session.err_timeo.host_reset_timeout = 60
Aug 22 03:04:32 user nova-compute[73469]: node.session.iscsi.FastAbort = Yes
Aug 22 03:04:32 user nova-compute[73469]: node.session.iscsi.InitialR2T = No
Aug 22 03:04:32 user nova-compute[73469]: node.session.iscsi.ImmediateData = Yes
Aug 22 03:04:32 user nova-compute[73469]: node.session.iscsi.FirstBurstLength = 262144
Aug 22 03:04:32 user nova-compute[73469]: node.session.iscsi.MaxBurstLength = 16776192
Aug 22 03:04:32 user nova-compute[73469]: node.session.iscsi.DefaultTime2Retain = 0
Aug 22 03:04:32 user nova-compute[73469]: node.session.iscsi.DefaultTime2Wait = 2
Aug 22 03:04:32 user nova-compute[73469]: node.session.iscsi.MaxConnections = 1
Aug 22 03:04:32 user nova-compute[73469]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 22 03:04:32 user nova-compute[73469]: node.session.iscsi.ERL = 0
Aug 22 03:04:32 user nova-compute[73469]: node.session.scan = manual
Aug 22 03:04:32 user nova-compute[73469]: node.session.reopen_max = 0
Aug 22 03:04:32 user nova-compute[73469]: node.conn[0].address = 172.16.0.220
Aug 22 03:04:32 user nova-compute[73469]: node.conn[0].port = 3260
Aug 22 03:04:32 user nova-compute[73469]: node.conn[0].startup = manual
Aug 22 03:04:32 user nova-compute[73469]: node.conn[0].tcp.window_size = 524288
Aug 22 03:04:32 user nova-compute[73469]: node.conn[0].tcp.type_of_service = 0
Aug 22 03:04:32 user nova-compute[73469]: node.conn[0].timeo.logout_timeout = 15
Aug 22 03:04:32 user nova-compute[73469]: node.conn[0].timeo.login_timeout = 15
Aug 22 03:04:32 user nova-compute[73469]: node.conn[0].timeo.auth_timeout = 45
Aug 22 03:04:32 user nova-compute[73469]: node.conn[0].timeo.noop_out_interval = 5
Aug 22 03:04:32 user nova-compute[73469]: node.conn[0].timeo.noop_out_timeout = 5
Aug 22 03:04:32 user nova-compute[73469]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 22 03:04:32 user nova-compute[73469]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 22 03:04:32 user nova-compute[73469]: node.conn[0].iscsi.HeaderDigest = None
Aug 22 03:04:32 user nova-compute[73469]: node.conn[0].iscsi.DataDigest = None
Aug 22 03:04:32 user nova-compute[73469]: node.conn[0].iscsi.IFMarker = No
Aug 22 03:04:32 user nova-compute[73469]: node.conn[0].iscsi.OFMarker = No
Aug 22 03:04:32 user nova-compute[73469]: # END RECORD
Aug 22 03:04:32 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[425aed3e-660f-4330-bdde-21ede4926a02]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3ba961-c1c9-46cc-8800-3e784c1e4eb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16e9793-d43f-42b9-a6c0-e2ca25a3f267]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9fe14e-0cd3-46a8-8753-d4f0cb63f7e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7835e1a0-d671-45f8-b0a9-571919864c64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5d9cca-a0f6-4afc-833b-2e56e4e30692]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOJmkSsj {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:04:32 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f22866-9035-4069-ae9f-c985550e738b]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG os_brick.utils [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Updating existing volume attachment record: 212e52b5-9d14-49e1-9d5b-136789f74c98 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOJmkSsj" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c598cd-c4f8-40ec-9dad-2010f9c0dbf4]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EOJmkSsj'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d785240-50ac-40e0-ae9c-9e613c25f828]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[027bfb42-8c1b-4782-8541-22af9046c6bc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:33 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:33 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:33 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:33 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:33 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:33 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:33 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:04:33 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:33 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:33 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:33 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:33 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:33 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:33 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:33 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:04:33 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.199s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] HCTL ('36', '0', '0', 0) found on session 31 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4815c7-180a-43ca-a193-9a92653bedd6]: (4, ('0 0 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Searching for a device in session 31 and hctl ('36', '0', '0', 0) yield: sde {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOJmkSsj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.223s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] <== connect_volume: return (224ms) {'type': 'block', 'scsi_wwn': '26263343864653065', 'path': '/dev/sde'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263343864653065', 'path': '/dev/sde'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1727070642',display_name='tempest-ServerStableDeviceRescueTest-server-1727070642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1727070642',id=21,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiFlw3K8uDuM14/olen5zZ3xxURmyCaloygS00hJxnTba04UwFxEPmyd3pqvFzE5IMeLVX+Gz0VhQsbsX4+RX+wUL04HnKgIab7U3aNj441PRpAzk5Ih/odplWzrEC+Lg==',key_name='tempest-keypair-1439006082',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:00:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ab77793ce9a4b85b90e3b7469daf58b',ramdisk_id='',reservation_id='r-68qh01zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-71202601',owner_user_name='tempest-ServerStableDeviceRescueTest-71202601-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab41a6128d3c49e89e5a2b3710eeea95',uuid=20316a2a-2f1f-4008-ab14-551e627bf680,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "address": "fa:16:3e:cf:fb:77", "network": {"id": "48051bc9-cc7d-4248-8077-3bd59a1cb474", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "vif_mac": "fa:16:3e:cf:fb:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab77793ce9a4b85b90e3b7469daf58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3d6f3d-12", "ovs_interfaceid": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Converting VIF {"id": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "address": "fa:16:3e:cf:fb:77", "network": {"id": "48051bc9-cc7d-4248-8077-3bd59a1cb474", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "vif_mac": "fa:16:3e:cf:fb:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab77793ce9a4b85b90e3b7469daf58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3d6f3d-12", "ovs_interfaceid": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:fb:77,bridge_name='br-int',has_traffic_filtering=True,id=8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8,network=Network(48051bc9-cc7d-4248-8077-3bd59a1cb474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a3d6f3d-12') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG nova.objects.instance [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lazy-loading 'pci_devices' on Instance uuid 20316a2a-2f1f-4008-ab14-551e627bf680 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:04:33 user nova-compute[73469]:   <uuid>20316a2a-2f1f-4008-ab14-551e627bf680</uuid>
Aug 22 03:04:33 user nova-compute[73469]:   <name>instance-00000015</name>
Aug 22 03:04:33 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:04:33 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:04:33 user nova-compute[73469]:   <metadata>
Aug 22 03:04:33 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:04:33 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:04:33 user nova-compute[73469]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1727070642</nova:name>
Aug 22 03:04:33 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:04:32</nova:creationTime>
Aug 22 03:04:33 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:04:33 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:04:33 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:04:33 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:04:33 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:04:33 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:04:33 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:04:33 user nova-compute[73469]:       <nova:owner>
Aug 22 03:04:33 user nova-compute[73469]:         <nova:user uuid="ab41a6128d3c49e89e5a2b3710eeea95">tempest-ServerStableDeviceRescueTest-71202601-project-member</nova:user>
Aug 22 03:04:33 user nova-compute[73469]:         <nova:project uuid="4ab77793ce9a4b85b90e3b7469daf58b">tempest-ServerStableDeviceRescueTest-71202601</nova:project>
Aug 22 03:04:33 user nova-compute[73469]:       </nova:owner>
Aug 22 03:04:33 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:04:33 user nova-compute[73469]:       <nova:ports>
Aug 22 03:04:33 user nova-compute[73469]:         <nova:port uuid="8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8">
Aug 22 03:04:33 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 22 03:04:33 user nova-compute[73469]:         </nova:port>
Aug 22 03:04:33 user nova-compute[73469]:       </nova:ports>
Aug 22 03:04:33 user nova-compute[73469]:     </nova:instance>
Aug 22 03:04:33 user nova-compute[73469]:   </metadata>
Aug 22 03:04:33 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:04:33 user nova-compute[73469]:     <system>
Aug 22 03:04:33 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:04:33 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:04:33 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:04:33 user nova-compute[73469]:       <entry name="serial">20316a2a-2f1f-4008-ab14-551e627bf680</entry>
Aug 22 03:04:33 user nova-compute[73469]:       <entry name="uuid">20316a2a-2f1f-4008-ab14-551e627bf680</entry>
Aug 22 03:04:33 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:04:33 user nova-compute[73469]:     </system>
Aug 22 03:04:33 user nova-compute[73469]:   </sysinfo>
Aug 22 03:04:33 user nova-compute[73469]:   <os>
Aug 22 03:04:33 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:04:33 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:04:33 user nova-compute[73469]:   </os>
Aug 22 03:04:33 user nova-compute[73469]:   <features>
Aug 22 03:04:33 user nova-compute[73469]:     <acpi/>
Aug 22 03:04:33 user nova-compute[73469]:     <apic/>
Aug 22 03:04:33 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:04:33 user nova-compute[73469]:   </features>
Aug 22 03:04:33 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:04:33 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:04:33 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:04:33 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:04:33 user nova-compute[73469]:   </clock>
Aug 22 03:04:33 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:04:33 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:04:33 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:04:33 user nova-compute[73469]:   </cpu>
Aug 22 03:04:33 user nova-compute[73469]:   <devices>
Aug 22 03:04:33 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:04:33 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:04:33 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk"/>
Aug 22 03:04:33 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:04:33 user nova-compute[73469]:     </disk>
Aug 22 03:04:33 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:04:33 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:04:33 user nova-compute[73469]:       <source dev="/dev/sde"/>
Aug 22 03:04:33 user nova-compute[73469]:       <target dev="vdb" bus="virtio"/>
Aug 22 03:04:33 user nova-compute[73469]:       <serial>a2728c16-00d9-4b9e-9480-7bf8affa6382</serial>
Aug 22 03:04:33 user nova-compute[73469]:     </disk>
Aug 22 03:04:33 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:04:33 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:04:33 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk.rescue"/>
Aug 22 03:04:33 user nova-compute[73469]:       <target dev="vdc" bus="virtio"/>
Aug 22 03:04:33 user nova-compute[73469]:       <boot order="1"/>
Aug 22 03:04:33 user nova-compute[73469]:     </disk>
Aug 22 03:04:33 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:04:33 user nova-compute[73469]:       <mac address="fa:16:3e:cf:fb:77"/>
Aug 22 03:04:33 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:04:33 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:04:33 user nova-compute[73469]:       <target dev="tap8a3d6f3d-12"/>
Aug 22 03:04:33 user nova-compute[73469]:     </interface>
Aug 22 03:04:33 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:04:33 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/console.log" append="off"/>
Aug 22 03:04:33 user nova-compute[73469]:     </serial>
Aug 22 03:04:33 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:04:33 user nova-compute[73469]:     <video>
Aug 22 03:04:33 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:04:33 user nova-compute[73469]:     </video>
Aug 22 03:04:33 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:04:33 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:04:33 user nova-compute[73469]:     </rng>
Aug 22 03:04:33 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:04:33 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:04:33 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:04:33 user nova-compute[73469]:     </memballoon>
Aug 22 03:04:33 user nova-compute[73469]:   </devices>
Aug 22 03:04:33 user nova-compute[73469]: </domain>
Aug 22 03:04:33 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:04:33 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Instance destroyed successfully.
Aug 22 03:04:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:04:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] No VIF found with MAC fa:16:3e:cf:fb:77, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG os_brick.utils [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a742e7b5-06a7-438f-afc3-ee58585e3f24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa52236-55ed-40cd-83c4-1adf64807bcd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ca21ee-a018-4a8d-8560-02548dfcff08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[799d1a09-d338-40a7-a94c-c97c14cbeb71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:04:34 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:04:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[13191602-ec1b-4c0c-b786-13fd0853068b]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG os_brick.utils [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Updating existing volume attachment record: fb90a908-76a9-46f9-90c3-0e0fe9132896 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-f8243c77-28cf-448a-b272-2e4efcdff452 req-12fa7282-bb3e-411b-9cf2-2042340b6d91 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received event network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f8243c77-28cf-448a-b272-2e4efcdff452 req-12fa7282-bb3e-411b-9cf2-2042340b6d91 service nova] Acquiring lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f8243c77-28cf-448a-b272-2e4efcdff452 req-12fa7282-bb3e-411b-9cf2-2042340b6d91 service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f8243c77-28cf-448a-b272-2e4efcdff452 req-12fa7282-bb3e-411b-9cf2-2042340b6d91 service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-f8243c77-28cf-448a-b272-2e4efcdff452 req-12fa7282-bb3e-411b-9cf2-2042340b6d91 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] No waiting events found dispatching network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:04:34 user nova-compute[73469]: WARNING nova.compute.manager [req-f8243c77-28cf-448a-b272-2e4efcdff452 req-12fa7282-bb3e-411b-9cf2-2042340b6d91 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received unexpected event network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 for instance with vm_state active and task_state rescuing.
Aug 22 03:04:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-da11672c-e8db-4290-9182-47255b64a1c1 req-3b19bfeb-bb50-43a4-8ffc-457e5068a90d service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received event network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:04:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-da11672c-e8db-4290-9182-47255b64a1c1 req-3b19bfeb-bb50-43a4-8ffc-457e5068a90d service nova] Acquiring lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-da11672c-e8db-4290-9182-47255b64a1c1 req-3b19bfeb-bb50-43a4-8ffc-457e5068a90d service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-da11672c-e8db-4290-9182-47255b64a1c1 req-3b19bfeb-bb50-43a4-8ffc-457e5068a90d service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-da11672c-e8db-4290-9182-47255b64a1c1 req-3b19bfeb-bb50-43a4-8ffc-457e5068a90d service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] No waiting events found dispatching network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:04:36 user nova-compute[73469]: WARNING nova.compute.manager [req-da11672c-e8db-4290-9182-47255b64a1c1 req-3b19bfeb-bb50-43a4-8ffc-457e5068a90d service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received unexpected event network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 for instance with vm_state active and task_state rescuing.
Aug 22 03:04:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Removed pending event for 20316a2a-2f1f-4008-ab14-551e627bf680 due to event {{(pid=73469) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 22 03:04:36 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673476.9838421, 20316a2a-2f1f-4008-ab14-551e627bf680 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:04:36 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] VM Resumed (Lifecycle Event)
Aug 22 03:04:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-582cbc17-0fc6-406b-b5c1-b5eef0782bd8 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:04:37 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:04:37 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:04:37 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 22 03:04:37 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673476.9887683, 20316a2a-2f1f-4008-ab14-551e627bf680 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:04:37 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] VM Started (Lifecycle Event)
Aug 22 03:04:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:37 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:04:37 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:04:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:41 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:04:41 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:04:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:42 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:04:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:43 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:04:44 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:04:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:44 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:04:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'flavor' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "refresh_cache-2e621408-a0af-460b-80a2-3446b5f1aadb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquired lock "refresh_cache-2e621408-a0af-460b-80a2-3446b5f1aadb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'info_cache' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Updating instance_info_cache with network_info: [{"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Releasing lock "refresh_cache-2e621408-a0af-460b-80a2-3446b5f1aadb" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:04:45 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Instance destroyed successfully.
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'resources' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1789351683',display_name='tempest-AttachVolumeTestJSON-server-1789351683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1789351683',id=17,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg3FO8Q1Fyh7Eb17I96O7txjPwDiFqMIfNq8/4/TcYPo08QnJwR73w8ZzPDWLE/eydf8rsuj4/QsACeGK9yAdP5tx7NSUxI3GV9dfyUcRbWNJiAjAgSe8h9Vrksa3qrNg==',key_name='tempest-keypair-647650365',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:57:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e49e405f5aca432097b7ba854fd3055b',ramdisk_id='',reservation_id='r-xv1z21bt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-356928747',owner_user_name='tempest-AttachVolumeTestJSON-356928747-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:02:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e62d25dff554a629a7e0af1406d97a9',uuid=2e621408-a0af-460b-80a2-3446b5f1aadb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converting VIF {"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG os_vif [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b3de561-7d, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:45 user nova-compute[73469]: INFO os_vif [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d')
Aug 22 03:04:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Start _get_guest_xml network_info=[{"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'numa_topology' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:45 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:04:45 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:04:45 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1789351683',display_name='tempest-AttachVolumeTestJSON-server-1789351683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1789351683',id=17,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg3FO8Q1Fyh7Eb17I96O7txjPwDiFqMIfNq8/4/TcYPo08QnJwR73w8ZzPDWLE/eydf8rsuj4/QsACeGK9yAdP5tx7NSUxI3GV9dfyUcRbWNJiAjAgSe8h9Vrksa3qrNg==',key_name='tempest-keypair-647650365',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:57:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e49e405f5aca432097b7ba854fd3055b',ramdisk_id='',reservation_id='r-xv1z21bt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-356928747',owner_user_name='tempest-AttachVolumeTestJSON-356928747-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:02:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e62d25dff554a629a7e0af1406d97a9',uuid=2e621408-a0af-460b-80a2-3446b5f1aadb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converting VIF {"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:04:46 user nova-compute[73469]:   <uuid>2e621408-a0af-460b-80a2-3446b5f1aadb</uuid>
Aug 22 03:04:46 user nova-compute[73469]:   <name>instance-00000011</name>
Aug 22 03:04:46 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:04:46 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:04:46 user nova-compute[73469]:   <metadata>
Aug 22 03:04:46 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:04:46 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:04:46 user nova-compute[73469]:       <nova:name>tempest-AttachVolumeTestJSON-server-1789351683</nova:name>
Aug 22 03:04:46 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:04:45</nova:creationTime>
Aug 22 03:04:46 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:04:46 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:04:46 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:04:46 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:04:46 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:04:46 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:04:46 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:04:46 user nova-compute[73469]:       <nova:owner>
Aug 22 03:04:46 user nova-compute[73469]:         <nova:user uuid="0e62d25dff554a629a7e0af1406d97a9">tempest-AttachVolumeTestJSON-356928747-project-member</nova:user>
Aug 22 03:04:46 user nova-compute[73469]:         <nova:project uuid="e49e405f5aca432097b7ba854fd3055b">tempest-AttachVolumeTestJSON-356928747</nova:project>
Aug 22 03:04:46 user nova-compute[73469]:       </nova:owner>
Aug 22 03:04:46 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:04:46 user nova-compute[73469]:       <nova:ports>
Aug 22 03:04:46 user nova-compute[73469]:         <nova:port uuid="1b3de561-7dd1-4d48-8932-05c4e4770538">
Aug 22 03:04:46 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 22 03:04:46 user nova-compute[73469]:         </nova:port>
Aug 22 03:04:46 user nova-compute[73469]:       </nova:ports>
Aug 22 03:04:46 user nova-compute[73469]:     </nova:instance>
Aug 22 03:04:46 user nova-compute[73469]:   </metadata>
Aug 22 03:04:46 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:04:46 user nova-compute[73469]:     <system>
Aug 22 03:04:46 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:04:46 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:04:46 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:04:46 user nova-compute[73469]:       <entry name="serial">2e621408-a0af-460b-80a2-3446b5f1aadb</entry>
Aug 22 03:04:46 user nova-compute[73469]:       <entry name="uuid">2e621408-a0af-460b-80a2-3446b5f1aadb</entry>
Aug 22 03:04:46 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:04:46 user nova-compute[73469]:     </system>
Aug 22 03:04:46 user nova-compute[73469]:   </sysinfo>
Aug 22 03:04:46 user nova-compute[73469]:   <os>
Aug 22 03:04:46 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:04:46 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:04:46 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:04:46 user nova-compute[73469]:   </os>
Aug 22 03:04:46 user nova-compute[73469]:   <features>
Aug 22 03:04:46 user nova-compute[73469]:     <acpi/>
Aug 22 03:04:46 user nova-compute[73469]:     <apic/>
Aug 22 03:04:46 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:04:46 user nova-compute[73469]:   </features>
Aug 22 03:04:46 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:04:46 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:04:46 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:04:46 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:04:46 user nova-compute[73469]:   </clock>
Aug 22 03:04:46 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:04:46 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:04:46 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:04:46 user nova-compute[73469]:   </cpu>
Aug 22 03:04:46 user nova-compute[73469]:   <devices>
Aug 22 03:04:46 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:04:46 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:04:46 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk"/>
Aug 22 03:04:46 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:04:46 user nova-compute[73469]:     </disk>
Aug 22 03:04:46 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:04:46 user nova-compute[73469]:       <mac address="fa:16:3e:d7:a2:07"/>
Aug 22 03:04:46 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:04:46 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:04:46 user nova-compute[73469]:       <target dev="tap1b3de561-7d"/>
Aug 22 03:04:46 user nova-compute[73469]:     </interface>
Aug 22 03:04:46 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:04:46 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/console.log" append="off"/>
Aug 22 03:04:46 user nova-compute[73469]:     </serial>
Aug 22 03:04:46 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:04:46 user nova-compute[73469]:     <video>
Aug 22 03:04:46 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:04:46 user nova-compute[73469]:     </video>
Aug 22 03:04:46 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:04:46 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:04:46 user nova-compute[73469]:     </rng>
Aug 22 03:04:46 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:04:46 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:04:46 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:04:46 user nova-compute[73469]:     </memballoon>
Aug 22 03:04:46 user nova-compute[73469]:   </devices>
Aug 22 03:04:46 user nova-compute[73469]: </domain>
Aug 22 03:04:46 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.181s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Cannot resize image /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'migration_context' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1789351683',display_name='tempest-AttachVolumeTestJSON-server-1789351683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1789351683',id=17,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg3FO8Q1Fyh7Eb17I96O7txjPwDiFqMIfNq8/4/TcYPo08QnJwR73w8ZzPDWLE/eydf8rsuj4/QsACeGK9yAdP5tx7NSUxI3GV9dfyUcRbWNJiAjAgSe8h9Vrksa3qrNg==',key_name='tempest-keypair-647650365',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:57:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e49e405f5aca432097b7ba854fd3055b',ramdisk_id='',reservation_id='r-xv1z21bt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-356928747',owner_user_name='tempest-AttachVolumeTestJSON-356928747-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:02:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e62d25dff554a629a7e0af1406d97a9',uuid=2e621408-a0af-460b-80a2-3446b5f1aadb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converting VIF {"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG os_vif [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b3de561-7d, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1b3de561-7d, col_values=(('external_ids', {'iface-id': '1b3de561-7dd1-4d48-8932-05c4e4770538', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:a2:07', 'vm-uuid': '2e621408-a0af-460b-80a2-3446b5f1aadb'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:04:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:46 user nova-compute[73469]: INFO os_vif [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d')
Aug 22 03:04:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:04:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qaAvDBNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:04:48 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:04:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:04:48 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:04:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:04:48 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1b24b7-72eb-46b3-8c6f-e8923d75dfb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:04:48 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae10dae-899e-413e-a0a0-d9f506d8bb46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661] added
Aug 22 03:04:48 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cce16b-25f6-484b-b513-ab7e348eda22]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79026c3-af46-4149-b2e8-b7c6042d5264]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qaAvDBNl {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG nova.compute.manager [req-d43c08fe-cb57-4d13-ac44-f321b9523c4b req-bcd084f5-4445-43fc-ad8c-c840287d026f service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received event network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d43c08fe-cb57-4d13-ac44-f321b9523c4b req-bcd084f5-4445-43fc-ad8c-c840287d026f service nova] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d43c08fe-cb57-4d13-ac44-f321b9523c4b req-bcd084f5-4445-43fc-ad8c-c840287d026f service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d43c08fe-cb57-4d13-ac44-f321b9523c4b req-bcd084f5-4445-43fc-ad8c-c840287d026f service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG nova.compute.manager [req-d43c08fe-cb57-4d13-ac44-f321b9523c4b req-bcd084f5-4445-43fc-ad8c-c840287d026f service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] No waiting events found dispatching network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:04:48 user nova-compute[73469]: WARNING nova.compute.manager [req-d43c08fe-cb57-4d13-ac44-f321b9523c4b req-bcd084f5-4445-43fc-ad8c-c840287d026f service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received unexpected event network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 for instance with vm_state stopped and task_state powering-on.
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qaAvDBNl" returned: 0 in 0.033s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[69317e84-8cb5-4446-9c1c-44baa7d464dc]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qaAvDBNl'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27edd07-0b37-43b0-a445-4db9a06445d5]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c40d28-12a0-45e0-ab41-db3a06702d8f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:48 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:48 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:48 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:48 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:48 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:48 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:48 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:04:48 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:48 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:48 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:48 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:48 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:48 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:48 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:48 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:04:48 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c87b942-fca5-482f-ab14-d65e3c1a3cc8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661, portal: 172.16.0.220,3260]
Aug 22 03:04:48 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661, portal: 172.16.0.220,3260] successful.
Aug 22 03:04:48 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[09feaafd-16dd-46bb-b584-08e8a9a8fdc2]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e14bdf5-ad34-4466-850e-44f5134a24af]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:49 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:49 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:49 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:49 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:49 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:49 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:49 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:04:49 user nova-compute[73469]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:04:49 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:49 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:49 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:49 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:49 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:49 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:49 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:49 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:04:49 user nova-compute[73469]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:04:49 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.467s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] HCTL ('41', '-', '-', 0) found on session 32 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d35ca5-741c-4866-9eb0-528e58e0e4e9]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Searching for a device in session 32 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qaAvDBNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.529s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] <== connect_volume: return (1535ms) {'type': 'block', 'scsi_wwn': '23031643130356131', 'path': '/dev/sdj'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031643130356131', 'path': '/dev/sdj'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG nova.objects.instance [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'flavor' on Instance uuid 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:04:50 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:04:50 user nova-compute[73469]:   <source dev="/dev/sdj"/>
Aug 22 03:04:50 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:04:50 user nova-compute[73469]:   <serial>1072e618-4680-4f68-9c2e-dd56519d5661</serial>
Aug 22 03:04:50 user nova-compute[73469]: </disk>
Aug 22 03:04:50 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673490.6091797, 2e621408-a0af-460b-80a2-3446b5f1aadb => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:04:50 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] VM Resumed (Lifecycle Event)
Aug 22 03:04:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:04:50 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Instance rebooted successfully.
Aug 22 03:04:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1a430133-e63a-49a9-ba09-f57a4b8d52b1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] No VIF found with MAC fa:16:3e:ea:7d:48, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:04:50 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 22 03:04:50 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673490.6153705, 2e621408-a0af-460b-80a2-3446b5f1aadb => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:04:50 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] VM Started (Lifecycle Event)
Aug 22 03:04:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG nova.compute.manager [req-de894565-2c52-40e0-9f3a-d4fd7fed0f0d req-fa6b2552-2349-4fe9-9767-4f1549d4839e service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received event network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-de894565-2c52-40e0-9f3a-d4fd7fed0f0d req-fa6b2552-2349-4fe9-9767-4f1549d4839e service nova] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-de894565-2c52-40e0-9f3a-d4fd7fed0f0d req-fa6b2552-2349-4fe9-9767-4f1549d4839e service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-de894565-2c52-40e0-9f3a-d4fd7fed0f0d req-fa6b2552-2349-4fe9-9767-4f1549d4839e service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG nova.compute.manager [req-de894565-2c52-40e0-9f3a-d4fd7fed0f0d req-fa6b2552-2349-4fe9-9767-4f1549d4839e service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] No waiting events found dispatching network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:04:50 user nova-compute[73469]: WARNING nova.compute.manager [req-de894565-2c52-40e0-9f3a-d4fd7fed0f0d req-fa6b2552-2349-4fe9-9767-4f1549d4839e service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received unexpected event network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 for instance with vm_state active and task_state None.
Aug 22 03:04:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-71727064-426f-46b1-b219-db6027586942 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.108s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:04:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:04:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:04:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:04:51 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:04:51 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:04:51 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=6858MB free_disk=24.866168975830078GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:04:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:51 user nova-compute[73469]: INFO nova.compute.manager [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Rebuilding instance
Aug 22 03:04:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:51 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d0668c0-7a49-4857-9b69-541021f18ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance dc3f5545-8ebb-4947-97d0-98a91f67e421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8242cec1-3b35-4d14-9e0b-db8a7e75697d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 2e621408-a0af-460b-80a2-3446b5f1aadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82e872a7-70b0-4290-9a11-5316765aed01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 20316a2a-2f1f-4008-ab14-551e627bf680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 980e57bf-dec9-46f3-8d69-e20a17603af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 0d5a30d1-565c-47c9-8caa-84dab130e117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 5984759d-28f1-45e8-bb4c-27bd8df426f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 4765dbfc-4219-4797-b40f-24698fa033bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance d8433c45-b889-4a7b-88c2-ba00679b1d26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 84706228-0050-49ac-886a-70842ce8dd3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance e43158b8-28fc-429c-b329-26be91761d4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'pci_requests' on Instance uuid 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'resources' on Instance uuid 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'migration_context' on Instance uuid 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73469) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.manager [req-dfe6c017-2c66-4621-a2b1-f7b56944b343 req-9f7fe248-1db0-4d80-864d-6a4019472598 service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Received event network-vif-unplugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dfe6c017-2c66-4621-a2b1-f7b56944b343 req-9f7fe248-1db0-4d80-864d-6a4019472598 service nova] Acquiring lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dfe6c017-2c66-4621-a2b1-f7b56944b343 req-9f7fe248-1db0-4d80-864d-6a4019472598 service nova] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dfe6c017-2c66-4621-a2b1-f7b56944b343 req-9f7fe248-1db0-4d80-864d-6a4019472598 service nova] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.manager [req-dfe6c017-2c66-4621-a2b1-f7b56944b343 req-9f7fe248-1db0-4d80-864d-6a4019472598 service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] No waiting events found dispatching network-vif-unplugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:04:52 user nova-compute[73469]: WARNING nova.compute.manager [req-dfe6c017-2c66-4621-a2b1-f7b56944b343 req-9f7fe248-1db0-4d80-864d-6a4019472598 service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Received unexpected event network-vif-unplugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 for instance with vm_state active and task_state rebuilding.
Aug 22 03:04:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:04:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.936s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:52 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Instance destroyed successfully.
Aug 22 03:04:53 user nova-compute[73469]: INFO nova.compute.manager [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Detaching volume 1072e618-4680-4f68-9c2e-dd56519d5661
Aug 22 03:04:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:53 user nova-compute[73469]: INFO nova.virt.block_device [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Attempting to driver detach volume 1072e618-4680-4f68-9c2e-dd56519d5661 from mountpoint /dev/vdb
Aug 22 03:04:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Attempting to detach device vdb from instance 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:04:53 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:04:53 user nova-compute[73469]:   <source dev="/dev/sdj"/>
Aug 22 03:04:53 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:04:53 user nova-compute[73469]:   <serial>1072e618-4680-4f68-9c2e-dd56519d5661</serial>
Aug 22 03:04:53 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:04:53 user nova-compute[73469]: </disk>
Aug 22 03:04:53 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:04:53 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Successfully detached device vdb from instance 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 from the persistent domain config.
Aug 22 03:04:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qaAvDBNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:04:53 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 22 03:04:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19ebfc0-ebda-4ca8-b25d-5717e6b33a3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[350ea9b0-3afb-4ffd-ae22-583dc6ff0c98]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:53 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:53 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:53 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:53 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:53 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:53 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:53 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:04:53 user nova-compute[73469]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:04:53 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:53 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:53 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:53 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:53 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:53 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:53 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:53 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:04:53 user nova-compute[73469]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:04:53 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79beab2dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661'): ({'sdj'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Removing single pathed devices sdj {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c27ad4-4048-491f-9fd0-d48be0b17a20]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b334601-7e1a-4c4d-a5d7-624049e16662]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Flushing IO for device /dev/sdj {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a35cced-fc9b-41a2-ad1f-0d4c3e644a40]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.038s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[473818de-54b4-43b4-933c-1ec199931ce1]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] SCSI volumes sdj have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2dd877-b5e7-43ad-a6e2-4ba10d6bde19]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d214cb4f-32ee-4444-b7f0-1b25fc8b18bd]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661, portal: 172.16.0.220,3260]
Aug 22 03:04:53 user nova-compute[73469]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661, portal: 172.16.0.220,3260] successful.
Aug 22 03:04:53 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed874d9-d748-458f-8e1d-e84c2fc75af2]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] <== disconnect_volume: return (331ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:04:53 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Updating instance_info_cache with network_info: [{"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-d8433c45-b889-4a7b-88c2-ba00679b1d26" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:04:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Instance destroyed successfully.
Aug 22 03:04:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-390626074',display_name='tempest-ServerActionsTestOtherA-server-1950378600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-390626074',id=26,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzECYecqxKAclQ13djaYo4aP+GCuiMQsT7a2vxvloQrNEucWhpndrbmJM02phQQyzEVLxT8xdS0cQ40404Hf+pU7LkGlE/TIncY5ZMIWkzlf47Mxz0eWcSZbF35ZQNuTQ==',key_name='tempest-keypair-1030511610',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:02:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2d1c312e979e47558b06d4fa70bc103a',ramdisk_id='',reservation_id='r-iptnxvlr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1751677379',owner_user_name='tempest-ServerActionsTestOtherA-1751677379-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:04:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b47d6cefd0d4949bf4c3c0fc72a9cd5',uuid=8a34f0c2-c0b0-4ba7-b9e4-673350a81646,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "address": "fa:16:3e:ea:7d:48", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f995853-c3", "ovs_interfaceid": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converting VIF {"id": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "address": "fa:16:3e:ea:7d:48", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f995853-c3", "ovs_interfaceid": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=1f995853-c3f9-41c7-a27b-bf970a21b2b1,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f995853-c3') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG os_vif [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=1f995853-c3f9-41c7-a27b-bf970a21b2b1,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f995853-c3') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f995853-c3, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:54 user nova-compute[73469]: INFO os_vif [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=1f995853-c3f9-41c7-a27b-bf970a21b2b1,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f995853-c3')
Aug 22 03:04:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qaAvDBNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:04:54 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 22 03:04:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf15fe6-0a65-48ff-9577-ef95c92eb4a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG nova.compute.manager [req-17a50854-9bc2-401a-a395-b0d325d84173 req-069f7850-9ec1-43fa-828c-3b44a6bbfa1b service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Received event network-vif-plugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-17a50854-9bc2-401a-a395-b0d325d84173 req-069f7850-9ec1-43fa-828c-3b44a6bbfa1b service nova] Acquiring lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-17a50854-9bc2-401a-a395-b0d325d84173 req-069f7850-9ec1-43fa-828c-3b44a6bbfa1b service nova] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-17a50854-9bc2-401a-a395-b0d325d84173 req-069f7850-9ec1-43fa-828c-3b44a6bbfa1b service nova] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG nova.compute.manager [req-17a50854-9bc2-401a-a395-b0d325d84173 req-069f7850-9ec1-43fa-828c-3b44a6bbfa1b service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] No waiting events found dispatching network-vif-plugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:04:54 user nova-compute[73469]: WARNING nova.compute.manager [req-17a50854-9bc2-401a-a395-b0d325d84173 req-069f7850-9ec1-43fa-828c-3b44a6bbfa1b service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Received unexpected event network-vif-plugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 for instance with vm_state active and task_state rebuilding.
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a672ca9-c8e5-4c68-9731-cada1be17b12]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:54 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:54 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:54 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:54 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:54 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:54 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:54 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:04:54 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:54 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:54 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:54 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:54 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:54 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:54 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:54 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:04:54 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4663f40>, {}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Disconnecting from: [] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.062s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] <== disconnect_volume: return (64ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:04:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Deleting instance files /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646_del
Aug 22 03:04:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Deletion of /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646_del complete
Aug 22 03:04:54 user nova-compute[73469]: INFO nova.virt.block_device [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Booting with volume 1072e618-4680-4f68-9c2e-dd56519d5661 at /dev/vdb
Aug 22 03:04:54 user nova-compute[73469]: DEBUG os_brick.utils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e99d7fd-77f3-4877-82b6-6980aad13ca4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c59177-cffd-4798-969d-aedf09eea8ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[068f537b-4ed0-488f-a9e0-f9477766598c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b253c2a8-c200-4659-b2bf-0c823b482083]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:04:54 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:04:54 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41de8f4-8e7e-4883-963a-283af11c454c]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG os_brick.utils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:04:54 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Updating existing volume attachment record: 3d71b68e-5bb7-45b9-94c0-e7abfc20a1e5 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:04:58 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Creating image(s)
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Did not create local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Ensure instance console log exists: /opt/stack/data/nova/instances/e43158b8-28fc-429c-b329-26be91761d4f/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Start _get_guest_xml network_info=[{"id": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "address": "fa:16:3e:94:d6:2d", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbb3f1b-29", "ovs_interfaceid": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'fb90a908-76a9-46f9-90c3-0e0fe9132896', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgBPSsQo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e43158b8-28fc-429c-b329-26be91761d4f', 'attached_at': '', 'detached_at': '', 'volume_id': '3315f119-dcfd-456b-8a2f-a361a5e42193', 'serial': '3315f119-dcfd-456b-8a2f-a361a5e42193'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:04:58 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:04:58 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgBPSsQo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:04:58 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:04:58 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:04:58 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39c797a-1171-4ec2-b96f-3917bfb0bddc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:04:58 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb404b3-6778-4884-8b05-d7ca92a59f28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193] added
Aug 22 03:04:58 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d22dc42-1854-4c1d-a3a1-e7aa82736a5e]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdd8ff7-d7f3-4d60-b323-3293c2259cd7]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgBPSsQo {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgBPSsQo" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be8a570-662c-4e8a-879a-9d98b9a88f1d]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IgBPSsQo'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e75e5ac-3e5c-44d1-b2a2-18b2a31f1dc9]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c3d608-21bf-4e07-a088-82bc43aefd33]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:04:58 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:04:58 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[03273cda-11d7-4ac8-902d-ae1fb43c9ef0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193, portal: 172.16.0.220,3260]
Aug 22 03:04:58 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193, portal: 172.16.0.220,3260] successful.
Aug 22 03:04:58 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39f5ce9-4526-45c5-b400-e56b5671a951]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42ec53d-de0b-411f-a1aa-340a2cda9013]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:04:58 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:04:58 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:04:58 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] HCTL ('41', '-', '-', 0) found on session 33 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02310ac-276b-4616-b3a6-963a0d27a0f9]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Searching for a device in session 33 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:04:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgBPSsQo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23937333934663161', 'path': '/dev/sdj'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937333934663161', 'path': '/dev/sdj'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:04:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-159252147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-159252147',id=28,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9131cb883044191931dc31e51e94766',ramdisk_id='',reservation_id='r-dm0r0052',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568629509',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:04:13Z,user_data=None,user_id='a7b228f99c9e4d058e128a5a99636b7b',uuid=e43158b8-28fc-429c-b329-26be91761d4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "address": "fa:16:3e:94:d6:2d", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbb3f1b-29", "ovs_interfaceid": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converting VIF {"id": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "address": "fa:16:3e:94:d6:2d", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbb3f1b-29", "ovs_interfaceid": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:d6:2d,bridge_name='br-int',has_traffic_filtering=True,id=bbbb3f1b-29b6-4f01-9296-3452d13d0b0c,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbbb3f1b-29') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'pci_devices' on Instance uuid e43158b8-28fc-429c-b329-26be91761d4f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:04:59 user nova-compute[73469]:   <uuid>e43158b8-28fc-429c-b329-26be91761d4f</uuid>
Aug 22 03:04:59 user nova-compute[73469]:   <name>instance-0000001c</name>
Aug 22 03:04:59 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:04:59 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:04:59 user nova-compute[73469]:   <metadata>
Aug 22 03:04:59 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:04:59 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:04:59 user nova-compute[73469]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-159252147</nova:name>
Aug 22 03:04:59 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:04:58</nova:creationTime>
Aug 22 03:04:59 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:04:59 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:04:59 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:04:59 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:04:59 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:04:59 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:04:59 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:04:59 user nova-compute[73469]:       <nova:owner>
Aug 22 03:04:59 user nova-compute[73469]:         <nova:user uuid="a7b228f99c9e4d058e128a5a99636b7b">tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member</nova:user>
Aug 22 03:04:59 user nova-compute[73469]:         <nova:project uuid="c9131cb883044191931dc31e51e94766">tempest-ServerBootFromVolumeStableRescueTest-568629509</nova:project>
Aug 22 03:04:59 user nova-compute[73469]:       </nova:owner>
Aug 22 03:04:59 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:04:59 user nova-compute[73469]:       <nova:ports>
Aug 22 03:04:59 user nova-compute[73469]:         <nova:port uuid="bbbb3f1b-29b6-4f01-9296-3452d13d0b0c">
Aug 22 03:04:59 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 22 03:04:59 user nova-compute[73469]:         </nova:port>
Aug 22 03:04:59 user nova-compute[73469]:       </nova:ports>
Aug 22 03:04:59 user nova-compute[73469]:     </nova:instance>
Aug 22 03:04:59 user nova-compute[73469]:   </metadata>
Aug 22 03:04:59 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:04:59 user nova-compute[73469]:     <system>
Aug 22 03:04:59 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:04:59 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:04:59 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:04:59 user nova-compute[73469]:       <entry name="serial">e43158b8-28fc-429c-b329-26be91761d4f</entry>
Aug 22 03:04:59 user nova-compute[73469]:       <entry name="uuid">e43158b8-28fc-429c-b329-26be91761d4f</entry>
Aug 22 03:04:59 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:04:59 user nova-compute[73469]:     </system>
Aug 22 03:04:59 user nova-compute[73469]:   </sysinfo>
Aug 22 03:04:59 user nova-compute[73469]:   <os>
Aug 22 03:04:59 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:04:59 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:04:59 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:04:59 user nova-compute[73469]:   </os>
Aug 22 03:04:59 user nova-compute[73469]:   <features>
Aug 22 03:04:59 user nova-compute[73469]:     <acpi/>
Aug 22 03:04:59 user nova-compute[73469]:     <apic/>
Aug 22 03:04:59 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:04:59 user nova-compute[73469]:   </features>
Aug 22 03:04:59 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:04:59 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:04:59 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:04:59 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:04:59 user nova-compute[73469]:   </clock>
Aug 22 03:04:59 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:04:59 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:04:59 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:04:59 user nova-compute[73469]:   </cpu>
Aug 22 03:04:59 user nova-compute[73469]:   <devices>
Aug 22 03:04:59 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:04:59 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:04:59 user nova-compute[73469]:       <source dev="/dev/sdj"/>
Aug 22 03:04:59 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:04:59 user nova-compute[73469]:       <serial>3315f119-dcfd-456b-8a2f-a361a5e42193</serial>
Aug 22 03:04:59 user nova-compute[73469]:     </disk>
Aug 22 03:04:59 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:04:59 user nova-compute[73469]:       <mac address="fa:16:3e:94:d6:2d"/>
Aug 22 03:04:59 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:04:59 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:04:59 user nova-compute[73469]:       <target dev="tapbbbb3f1b-29"/>
Aug 22 03:04:59 user nova-compute[73469]:     </interface>
Aug 22 03:04:59 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:04:59 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/e43158b8-28fc-429c-b329-26be91761d4f/console.log" append="off"/>
Aug 22 03:04:59 user nova-compute[73469]:     </serial>
Aug 22 03:04:59 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:04:59 user nova-compute[73469]:     <video>
Aug 22 03:04:59 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:04:59 user nova-compute[73469]:     </video>
Aug 22 03:04:59 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:04:59 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:04:59 user nova-compute[73469]:     </rng>
Aug 22 03:04:59 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:04:59 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:04:59 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:04:59 user nova-compute[73469]:     </memballoon>
Aug 22 03:04:59 user nova-compute[73469]:   </devices>
Aug 22 03:04:59 user nova-compute[73469]: </domain>
Aug 22 03:04:59 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:04:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-159252147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-159252147',id=28,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9131cb883044191931dc31e51e94766',ramdisk_id='',reservation_id='r-dm0r0052',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568629509',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:04:13Z,user_data=None,user_id='a7b228f99c9e4d058e128a5a99636b7b',uuid=e43158b8-28fc-429c-b329-26be91761d4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "address": "fa:16:3e:94:d6:2d", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbb3f1b-29", "ovs_interfaceid": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converting VIF {"id": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "address": "fa:16:3e:94:d6:2d", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbb3f1b-29", "ovs_interfaceid": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:d6:2d,bridge_name='br-int',has_traffic_filtering=True,id=bbbb3f1b-29b6-4f01-9296-3452d13d0b0c,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbbb3f1b-29') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG os_vif [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:d6:2d,bridge_name='br-int',has_traffic_filtering=True,id=bbbb3f1b-29b6-4f01-9296-3452d13d0b0c,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbbb3f1b-29') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbbb3f1b-29, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbbbb3f1b-29, col_values=(('external_ids', {'iface-id': 'bbbb3f1b-29b6-4f01-9296-3452d13d0b0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:d6:2d', 'vm-uuid': 'e43158b8-28fc-429c-b329-26be91761d4f'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:04:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:05:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:00 user nova-compute[73469]: INFO os_vif [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:d6:2d,bridge_name='br-int',has_traffic_filtering=True,id=bbbb3f1b-29b6-4f01-9296-3452d13d0b0c,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbbb3f1b-29')
Aug 22 03:05:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:05:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] No VIF found with MAC fa:16:3e:94:d6:2d, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:05:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:01 user nova-compute[73469]: DEBUG nova.compute.manager [req-71d0008e-7776-4e75-8f17-1307eb45a288 req-26a8e1ec-3b84-4017-9e33-fb2d279ff2c2 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received event network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-71d0008e-7776-4e75-8f17-1307eb45a288 req-26a8e1ec-3b84-4017-9e33-fb2d279ff2c2 service nova] Acquiring lock "e43158b8-28fc-429c-b329-26be91761d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-71d0008e-7776-4e75-8f17-1307eb45a288 req-26a8e1ec-3b84-4017-9e33-fb2d279ff2c2 service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-71d0008e-7776-4e75-8f17-1307eb45a288 req-26a8e1ec-3b84-4017-9e33-fb2d279ff2c2 service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:01 user nova-compute[73469]: DEBUG nova.compute.manager [req-71d0008e-7776-4e75-8f17-1307eb45a288 req-26a8e1ec-3b84-4017-9e33-fb2d279ff2c2 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] No waiting events found dispatching network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:01 user nova-compute[73469]: WARNING nova.compute.manager [req-71d0008e-7776-4e75-8f17-1307eb45a288 req-26a8e1ec-3b84-4017-9e33-fb2d279ff2c2 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received unexpected event network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c for instance with vm_state building and task_state spawning.
Aug 22 03:05:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "d8433c45-b889-4a7b-88c2-ba00679b1d26" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:03 user nova-compute[73469]: INFO nova.compute.manager [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Terminating instance
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.compute.manager [req-ef7bbab5-4161-485a-af53-69da0c2bde98 req-efd44a0e-10f7-410d-a10a-63e7fbe88c7b service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received event network-vif-unplugged-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ef7bbab5-4161-485a-af53-69da0c2bde98 req-efd44a0e-10f7-410d-a10a-63e7fbe88c7b service nova] Acquiring lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ef7bbab5-4161-485a-af53-69da0c2bde98 req-efd44a0e-10f7-410d-a10a-63e7fbe88c7b service nova] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ef7bbab5-4161-485a-af53-69da0c2bde98 req-efd44a0e-10f7-410d-a10a-63e7fbe88c7b service nova] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.compute.manager [req-ef7bbab5-4161-485a-af53-69da0c2bde98 req-efd44a0e-10f7-410d-a10a-63e7fbe88c7b service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] No waiting events found dispatching network-vif-unplugged-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.compute.manager [req-ef7bbab5-4161-485a-af53-69da0c2bde98 req-efd44a0e-10f7-410d-a10a-63e7fbe88c7b service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received event network-vif-unplugged-4697b7dd-3290-45e0-baa6-01e13c682505 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673503.6325772, e43158b8-28fc-429c-b329-26be91761d4f => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:05:03 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] VM Resumed (Lifecycle Event)
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:05:03 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Instance spawned successfully.
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:05:03 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673503.634304, e43158b8-28fc-429c-b329-26be91761d4f => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:05:03 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] VM Started (Lifecycle Event)
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.compute.manager [req-a464e1b4-6466-4d4b-a792-11ea58e09208 req-438502b7-313c-4129-8ba7-fce354ae1e8c service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received event network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a464e1b4-6466-4d4b-a792-11ea58e09208 req-438502b7-313c-4129-8ba7-fce354ae1e8c service nova] Acquiring lock "e43158b8-28fc-429c-b329-26be91761d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a464e1b4-6466-4d4b-a792-11ea58e09208 req-438502b7-313c-4129-8ba7-fce354ae1e8c service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a464e1b4-6466-4d4b-a792-11ea58e09208 req-438502b7-313c-4129-8ba7-fce354ae1e8c service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.compute.manager [req-a464e1b4-6466-4d4b-a792-11ea58e09208 req-438502b7-313c-4129-8ba7-fce354ae1e8c service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] No waiting events found dispatching network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:03 user nova-compute[73469]: WARNING nova.compute.manager [req-a464e1b4-6466-4d4b-a792-11ea58e09208 req-438502b7-313c-4129-8ba7-fce354ae1e8c service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received unexpected event network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c for instance with vm_state building and task_state spawning.
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.compute.manager [req-a464e1b4-6466-4d4b-a792-11ea58e09208 req-438502b7-313c-4129-8ba7-fce354ae1e8c service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-changed-d5ac4586-bd1a-488b-8c9e-ee23a27e57eb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.compute.manager [req-a464e1b4-6466-4d4b-a792-11ea58e09208 req-438502b7-313c-4129-8ba7-fce354ae1e8c service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Refreshing instance network info cache due to event network-changed-d5ac4586-bd1a-488b-8c9e-ee23a27e57eb. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a464e1b4-6466-4d4b-a792-11ea58e09208 req-438502b7-313c-4129-8ba7-fce354ae1e8c service nova] Acquiring lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a464e1b4-6466-4d4b-a792-11ea58e09208 req-438502b7-313c-4129-8ba7-fce354ae1e8c service nova] Acquired lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.network.neutron [req-a464e1b4-6466-4d4b-a792-11ea58e09208 req-438502b7-313c-4129-8ba7-fce354ae1e8c service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Refreshing network info cache for port d5ac4586-bd1a-488b-8c9e-ee23a27e57eb {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:05:03 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:05:03 user nova-compute[73469]: INFO nova.compute.manager [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Took 5.27 seconds to spawn the instance on the hypervisor.
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:05:03 user nova-compute[73469]: INFO nova.compute.manager [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Took 51.73 seconds to build instance.
Aug 22 03:05:03 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Instance destroyed successfully.
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'resources' on Instance uuid d8433c45-b889-4a7b-88c2-ba00679b1d26 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ea131d13-ac37-4ffa-b3dd-f0adfa792ccc tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "e43158b8-28fc-429c-b329-26be91761d4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.830s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-22T02:58:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-557066596',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-557066596',id=19,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMTW/Tu7Qz4gAEdctdCddqJYGhHttiA4fs+mQuki8sncrz2C58Mwmx016ibO7bJAestH4l3mZDH5pSwtYnqkhyYMBuOsLjWnHvwC5ttu6BXaJxmcDyZpua6cpuuHaMcLA==',key_name='tempest-keypair-510663035',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:02:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca3e1f2f72c7497ca3ad923a4b9459dc',ramdisk_id='',reservation_id='r-y4g07ft5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-774227889',owner_user_name='tempest-AttachVolumeShelveTestJSON-774227889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41e697cd5e5f422f8ac90f7496f60936',uuid=d8433c45-b889-4a7b-88c2-ba00679b1d26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converting VIF {"id": "4697b7dd-3290-45e0-baa6-01e13c682505", "address": "fa:16:3e:fd:a3:4c", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4697b7dd-32", "ovs_interfaceid": "4697b7dd-3290-45e0-baa6-01e13c682505", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=4697b7dd-3290-45e0-baa6-01e13c682505,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4697b7dd-32') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG os_vif [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=4697b7dd-3290-45e0-baa6-01e13c682505,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4697b7dd-32') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4697b7dd-32, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:05:03 user nova-compute[73469]: INFO os_vif [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=4697b7dd-3290-45e0-baa6-01e13c682505,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4697b7dd-32')
Aug 22 03:05:03 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Deleting instance files /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26_del
Aug 22 03:05:03 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Deletion of /opt/stack/data/nova/instances/d8433c45-b889-4a7b-88c2-ba00679b1d26_del complete
Aug 22 03:05:04 user nova-compute[73469]: INFO nova.compute.manager [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 22 03:05:04 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:05:04 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:05:04 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:05:04 user nova-compute[73469]: DEBUG nova.network.neutron [req-a464e1b4-6466-4d4b-a792-11ea58e09208 req-438502b7-313c-4129-8ba7-fce354ae1e8c service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updated VIF entry in instance network info cache for port d5ac4586-bd1a-488b-8c9e-ee23a27e57eb. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:05:04 user nova-compute[73469]: DEBUG nova.network.neutron [req-a464e1b4-6466-4d4b-a792-11ea58e09208 req-438502b7-313c-4129-8ba7-fce354ae1e8c service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updating instance_info_cache with network_info: [{"id": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "address": "fa:16:3e:24:2f:4c", "network": {"id": "08f11990-95e2-453a-a05b-2526367ec3fd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-130047836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5ac4586-bd", "ovs_interfaceid": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "address": "fa:16:3e:e4:03:95", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d0a8d68-79", "ovs_interfaceid": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "029910e1-c407-4728-a2a3-4daf09db5632", "address": "fa:16:3e:58:a3:0d", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029910e1-c4", "ovs_interfaceid": "029910e1-c407-4728-a2a3-4daf09db5632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "address": "fa:16:3e:c2:21:f8", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac8e395-8b", "ovs_interfaceid": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "42e5267b-949c-44dd-9b96-975b4534aaa3", "address": "fa:16:3e:00:55:c5", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5267b-94", "ovs_interfaceid": "42e5267b-949c-44dd-9b96-975b4534aaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc85b38c-492a-46f6-8d44-67882abf29fb", "address": "fa:16:3e:a9:ae:10", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc85b38c-49", "ovs_interfaceid": "bc85b38c-492a-46f6-8d44-67882abf29fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f948c8ed-80d5-411d-95bb-d12e136727e6", "address": "fa:16:3e:e9:38:9c", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948c8ed-80", "ovs_interfaceid": "f948c8ed-80d5-411d-95bb-d12e136727e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:05:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a464e1b4-6466-4d4b-a792-11ea58e09208 req-438502b7-313c-4129-8ba7-fce354ae1e8c service nova] Releasing lock "refresh_cache-4765dbfc-4219-4797-b40f-24698fa033bf" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:05:05 user nova-compute[73469]: DEBUG nova.compute.manager [req-470bdc84-7971-4640-9581-058513b9530b req-2a85e692-82b3-4cb5-81b4-3c2084207960 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received event network-vif-plugged-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-470bdc84-7971-4640-9581-058513b9530b req-2a85e692-82b3-4cb5-81b4-3c2084207960 service nova] Acquiring lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-470bdc84-7971-4640-9581-058513b9530b req-2a85e692-82b3-4cb5-81b4-3c2084207960 service nova] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-470bdc84-7971-4640-9581-058513b9530b req-2a85e692-82b3-4cb5-81b4-3c2084207960 service nova] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:05 user nova-compute[73469]: DEBUG nova.compute.manager [req-470bdc84-7971-4640-9581-058513b9530b req-2a85e692-82b3-4cb5-81b4-3c2084207960 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] No waiting events found dispatching network-vif-plugged-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:05 user nova-compute[73469]: WARNING nova.compute.manager [req-470bdc84-7971-4640-9581-058513b9530b req-2a85e692-82b3-4cb5-81b4-3c2084207960 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received unexpected event network-vif-plugged-4697b7dd-3290-45e0-baa6-01e13c682505 for instance with vm_state active and task_state deleting.
Aug 22 03:05:05 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:05:05 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Took 1.57 seconds to deallocate network for instance.
Aug 22 03:05:05 user nova-compute[73469]: DEBUG nova.compute.manager [req-4efec635-c3ef-4c42-906a-5f398cef6636 req-2b1502f4-2c3d-4797-ba07-06978b1af425 service nova] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Received event network-vif-deleted-4697b7dd-3290-45e0-baa6-01e13c682505 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "4765dbfc-4219-4797-b40f-24698fa033bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:05 user nova-compute[73469]: INFO nova.compute.manager [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Terminating instance
Aug 22 03:05:05 user nova-compute[73469]: DEBUG nova.compute.manager [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:05:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG nova.compute.manager [req-bb8b2943-4336-4442-ade0-22b8089dd482 req-39213999-5d05-4ade-97f8-da8438ee7bbb service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-unplugged-d5ac4586-bd1a-488b-8c9e-ee23a27e57eb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bb8b2943-4336-4442-ade0-22b8089dd482 req-39213999-5d05-4ade-97f8-da8438ee7bbb service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bb8b2943-4336-4442-ade0-22b8089dd482 req-39213999-5d05-4ade-97f8-da8438ee7bbb service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bb8b2943-4336-4442-ade0-22b8089dd482 req-39213999-5d05-4ade-97f8-da8438ee7bbb service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG nova.compute.manager [req-bb8b2943-4336-4442-ade0-22b8089dd482 req-39213999-5d05-4ade-97f8-da8438ee7bbb service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-unplugged-d5ac4586-bd1a-488b-8c9e-ee23a27e57eb {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG nova.compute.manager [req-bb8b2943-4336-4442-ade0-22b8089dd482 req-39213999-5d05-4ade-97f8-da8438ee7bbb service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-unplugged-d5ac4586-bd1a-488b-8c9e-ee23a27e57eb for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.651s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:06 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Deleted allocations for instance d8433c45-b889-4a7b-88c2-ba00679b1d26
Aug 22 03:05:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1c78f0b8-640d-488c-ad89-fbf10acc4dfe tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "d8433c45-b889-4a7b-88c2-ba00679b1d26" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.509s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-unplugged-42e5267b-949c-44dd-9b96-975b4534aaa3 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-unplugged-42e5267b-949c-44dd-9b96-975b4534aaa3 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-unplugged-42e5267b-949c-44dd-9b96-975b4534aaa3 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-42e5267b-949c-44dd-9b96-975b4534aaa3 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-42e5267b-949c-44dd-9b96-975b4534aaa3 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:07 user nova-compute[73469]: WARNING nova.compute.manager [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-42e5267b-949c-44dd-9b96-975b4534aaa3 for instance with vm_state active and task_state deleting.
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-unplugged-bc85b38c-492a-46f6-8d44-67882abf29fb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-unplugged-bc85b38c-492a-46f6-8d44-67882abf29fb {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-unplugged-bc85b38c-492a-46f6-8d44-67882abf29fb for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-bc85b38c-492a-46f6-8d44-67882abf29fb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-bc85b38c-492a-46f6-8d44-67882abf29fb {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:07 user nova-compute[73469]: WARNING nova.compute.manager [req-fbc4ac0f-7a54-4da7-864f-39b406e964ce req-9a45e524-2e80-4d8d-975d-6138aceb22c8 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-bc85b38c-492a-46f6-8d44-67882abf29fb for instance with vm_state active and task_state deleting.
Aug 22 03:05:07 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Instance destroyed successfully.
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.objects.instance [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lazy-loading 'resources' on Instance uuid 4765dbfc-4219-4797-b40f-24698fa033bf {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "address": "fa:16:3e:24:2f:4c", "network": {"id": "08f11990-95e2-453a-a05b-2526367ec3fd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-130047836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5ac4586-bd", "ovs_interfaceid": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "address": "fa:16:3e:24:2f:4c", "network": {"id": "08f11990-95e2-453a-a05b-2526367ec3fd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-130047836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5ac4586-bd", "ovs_interfaceid": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:2f:4c,bridge_name='br-int',has_traffic_filtering=True,id=d5ac4586-bd1a-488b-8c9e-ee23a27e57eb,network=Network(08f11990-95e2-453a-a05b-2526367ec3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5ac4586-bd') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG os_vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:2f:4c,bridge_name='br-int',has_traffic_filtering=True,id=d5ac4586-bd1a-488b-8c9e-ee23a27e57eb,network=Network(08f11990-95e2-453a-a05b-2526367ec3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5ac4586-bd') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5ac4586-bd, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-a6843f68-9b6e-48aa-bfd3-b5b6c6b04327 req-2c68f414-2dcf-4e48-a2a7-193f8ca7d198 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-unplugged-eac8e395-8b46-4d73-a0b8-495ee2530d6c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a6843f68-9b6e-48aa-bfd3-b5b6c6b04327 req-2c68f414-2dcf-4e48-a2a7-193f8ca7d198 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a6843f68-9b6e-48aa-bfd3-b5b6c6b04327 req-2c68f414-2dcf-4e48-a2a7-193f8ca7d198 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a6843f68-9b6e-48aa-bfd3-b5b6c6b04327 req-2c68f414-2dcf-4e48-a2a7-193f8ca7d198 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-a6843f68-9b6e-48aa-bfd3-b5b6c6b04327 req-2c68f414-2dcf-4e48-a2a7-193f8ca7d198 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-unplugged-eac8e395-8b46-4d73-a0b8-495ee2530d6c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-a6843f68-9b6e-48aa-bfd3-b5b6c6b04327 req-2c68f414-2dcf-4e48-a2a7-193f8ca7d198 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-unplugged-eac8e395-8b46-4d73-a0b8-495ee2530d6c for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-a6843f68-9b6e-48aa-bfd3-b5b6c6b04327 req-2c68f414-2dcf-4e48-a2a7-193f8ca7d198 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-eac8e395-8b46-4d73-a0b8-495ee2530d6c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a6843f68-9b6e-48aa-bfd3-b5b6c6b04327 req-2c68f414-2dcf-4e48-a2a7-193f8ca7d198 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a6843f68-9b6e-48aa-bfd3-b5b6c6b04327 req-2c68f414-2dcf-4e48-a2a7-193f8ca7d198 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a6843f68-9b6e-48aa-bfd3-b5b6c6b04327 req-2c68f414-2dcf-4e48-a2a7-193f8ca7d198 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-a6843f68-9b6e-48aa-bfd3-b5b6c6b04327 req-2c68f414-2dcf-4e48-a2a7-193f8ca7d198 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-eac8e395-8b46-4d73-a0b8-495ee2530d6c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:07 user nova-compute[73469]: WARNING nova.compute.manager [req-a6843f68-9b6e-48aa-bfd3-b5b6c6b04327 req-2c68f414-2dcf-4e48-a2a7-193f8ca7d198 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-eac8e395-8b46-4d73-a0b8-495ee2530d6c for instance with vm_state active and task_state deleting.
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: INFO os_vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:2f:4c,bridge_name='br-int',has_traffic_filtering=True,id=d5ac4586-bd1a-488b-8c9e-ee23a27e57eb,network=Network(08f11990-95e2-453a-a05b-2526367ec3fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5ac4586-bd')
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "address": "fa:16:3e:e4:03:95", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d0a8d68-79", "ovs_interfaceid": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "address": "fa:16:3e:e4:03:95", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d0a8d68-79", "ovs_interfaceid": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:03:95,bridge_name='br-int',has_traffic_filtering=True,id=3d0a8d68-796c-4c40-a6df-17d44e3ba385,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d0a8d68-79') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG os_vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:03:95,bridge_name='br-int',has_traffic_filtering=True,id=3d0a8d68-796c-4c40-a6df-17d44e3ba385,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d0a8d68-79') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d0a8d68-79, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: INFO os_vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:03:95,bridge_name='br-int',has_traffic_filtering=True,id=3d0a8d68-796c-4c40-a6df-17d44e3ba385,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d0a8d68-79')
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "029910e1-c407-4728-a2a3-4daf09db5632", "address": "fa:16:3e:58:a3:0d", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029910e1-c4", "ovs_interfaceid": "029910e1-c407-4728-a2a3-4daf09db5632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "029910e1-c407-4728-a2a3-4daf09db5632", "address": "fa:16:3e:58:a3:0d", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029910e1-c4", "ovs_interfaceid": "029910e1-c407-4728-a2a3-4daf09db5632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:a3:0d,bridge_name='br-int',has_traffic_filtering=True,id=029910e1-c407-4728-a2a3-4daf09db5632,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap029910e1-c4') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG os_vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:a3:0d,bridge_name='br-int',has_traffic_filtering=True,id=029910e1-c407-4728-a2a3-4daf09db5632,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap029910e1-c4') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap029910e1-c4, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: INFO os_vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:a3:0d,bridge_name='br-int',has_traffic_filtering=True,id=029910e1-c407-4728-a2a3-4daf09db5632,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap029910e1-c4')
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "address": "fa:16:3e:c2:21:f8", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac8e395-8b", "ovs_interfaceid": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "address": "fa:16:3e:c2:21:f8", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac8e395-8b", "ovs_interfaceid": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:21:f8,bridge_name='br-int',has_traffic_filtering=True,id=eac8e395-8b46-4d73-a0b8-495ee2530d6c,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac8e395-8b') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG os_vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:21:f8,bridge_name='br-int',has_traffic_filtering=True,id=eac8e395-8b46-4d73-a0b8-495ee2530d6c,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac8e395-8b') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeac8e395-8b, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: INFO os_vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:21:f8,bridge_name='br-int',has_traffic_filtering=True,id=eac8e395-8b46-4d73-a0b8-495ee2530d6c,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac8e395-8b')
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42e5267b-949c-44dd-9b96-975b4534aaa3", "address": "fa:16:3e:00:55:c5", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5267b-94", "ovs_interfaceid": "42e5267b-949c-44dd-9b96-975b4534aaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "42e5267b-949c-44dd-9b96-975b4534aaa3", "address": "fa:16:3e:00:55:c5", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5267b-94", "ovs_interfaceid": "42e5267b-949c-44dd-9b96-975b4534aaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:55:c5,bridge_name='br-int',has_traffic_filtering=True,id=42e5267b-949c-44dd-9b96-975b4534aaa3,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5267b-94') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG os_vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:55:c5,bridge_name='br-int',has_traffic_filtering=True,id=42e5267b-949c-44dd-9b96-975b4534aaa3,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5267b-94') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42e5267b-94, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673492.9496295, 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:05:07 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] VM Stopped (Lifecycle Event)
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.compute.manager [None req-bc3a7497-d795-47dc-9f6a-9d0da68284c0 None None] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:05:07 user nova-compute[73469]: INFO os_vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:55:c5,bridge_name='br-int',has_traffic_filtering=True,id=42e5267b-949c-44dd-9b96-975b4534aaa3,network=Network(cca084c6-afb1-4f30-98c3-4ecbad297687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5267b-94')
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc85b38c-492a-46f6-8d44-67882abf29fb", "address": "fa:16:3e:a9:ae:10", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc85b38c-49", "ovs_interfaceid": "bc85b38c-492a-46f6-8d44-67882abf29fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "bc85b38c-492a-46f6-8d44-67882abf29fb", "address": "fa:16:3e:a9:ae:10", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc85b38c-49", "ovs_interfaceid": "bc85b38c-492a-46f6-8d44-67882abf29fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ae:10,bridge_name='br-int',has_traffic_filtering=True,id=bc85b38c-492a-46f6-8d44-67882abf29fb,network=Network(caf89e44-6bb1-4832-8053-68378a2c004b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc85b38c-49') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG os_vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ae:10,bridge_name='br-int',has_traffic_filtering=True,id=bc85b38c-492a-46f6-8d44-67882abf29fb,network=Network(caf89e44-6bb1-4832-8053-68378a2c004b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc85b38c-49') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc85b38c-49, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:08 user nova-compute[73469]: INFO os_vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:ae:10,bridge_name='br-int',has_traffic_filtering=True,id=bc85b38c-492a-46f6-8d44-67882abf29fb,network=Network(caf89e44-6bb1-4832-8053-68378a2c004b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc85b38c-49')
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-22T03:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1635694698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1635694698',id=25,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg76oZoRwaH5kq1yPCQdskRdZUVBF0whwmBIgSizrIrHEFsKcV060sCci1CVSjvJiWWVlZcTvzluwVAiXCKy5LzlEAdQGZarGiRBe1bJ73w0ri/NLhNy1tZ2WKIMsQe1A==',key_name='tempest-keypair-919502866',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78ba7249950f4f20a16ccdee64ee9b66',ramdisk_id='',reservation_id='r-f4393pyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-4296881',owner_user_name='tempest-TaggedBootDevicesTest_v242-4296881-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a8977f5d3814762aae632398cc36913',uuid=4765dbfc-4219-4797-b40f-24698fa033bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f948c8ed-80d5-411d-95bb-d12e136727e6", "address": "fa:16:3e:e9:38:9c", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948c8ed-80", "ovs_interfaceid": "f948c8ed-80d5-411d-95bb-d12e136727e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converting VIF {"id": "f948c8ed-80d5-411d-95bb-d12e136727e6", "address": "fa:16:3e:e9:38:9c", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948c8ed-80", "ovs_interfaceid": "f948c8ed-80d5-411d-95bb-d12e136727e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:38:9c,bridge_name='br-int',has_traffic_filtering=True,id=f948c8ed-80d5-411d-95bb-d12e136727e6,network=Network(caf89e44-6bb1-4832-8053-68378a2c004b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948c8ed-80') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:38:9c,bridge_name='br-int',has_traffic_filtering=True,id=f948c8ed-80d5-411d-95bb-d12e136727e6,network=Network(caf89e44-6bb1-4832-8053-68378a2c004b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948c8ed-80') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf948c8ed-80, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:08 user nova-compute[73469]: INFO os_vif [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:38:9c,bridge_name='br-int',has_traffic_filtering=True,id=f948c8ed-80d5-411d-95bb-d12e136727e6,network=Network(caf89e44-6bb1-4832-8053-68378a2c004b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948c8ed-80')
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxqMpibw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:05:08 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d4f6ef-ee60-43b0-a0e0-652a1c973b1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6529bccf-b45e-4815-8c4d-ee53bb13ff34]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79806dbd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22'): ({'sdf'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Removing single pathed devices sdf {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[00313ef8-4ec2-4a09-80fe-a0098643ed03]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8056d927-9ea6-4c1d-bca0-e8d8382eb376]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Flushing IO for device /dev/sdf {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecb9a2e-7d3a-45a4-a34b-239e1179ba6c]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d66140-7efd-4779-bf29-f75fa1b45a6e]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] SCSI volumes sdf have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-d5ac4586-bd1a-488b-8c9e-ee23a27e57eb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-d5ac4586-bd1a-488b-8c9e-ee23a27e57eb {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:08 user nova-compute[73469]: WARNING nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-d5ac4586-bd1a-488b-8c9e-ee23a27e57eb for instance with vm_state active and task_state deleting.
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-unplugged-3d0a8d68-796c-4c40-a6df-17d44e3ba385 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-unplugged-3d0a8d68-796c-4c40-a6df-17d44e3ba385 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-unplugged-3d0a8d68-796c-4c40-a6df-17d44e3ba385 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-3d0a8d68-796c-4c40-a6df-17d44e3ba385 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-3d0a8d68-796c-4c40-a6df-17d44e3ba385 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:08 user nova-compute[73469]: WARNING nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-3d0a8d68-796c-4c40-a6df-17d44e3ba385 for instance with vm_state active and task_state deleting.
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-unplugged-029910e1-c407-4728-a2a3-4daf09db5632 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-unplugged-029910e1-c407-4728-a2a3-4daf09db5632 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-unplugged-029910e1-c407-4728-a2a3-4daf09db5632 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-029910e1-c407-4728-a2a3-4daf09db5632 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-029910e1-c407-4728-a2a3-4daf09db5632 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:08 user nova-compute[73469]: WARNING nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-029910e1-c407-4728-a2a3-4daf09db5632 for instance with vm_state active and task_state deleting.
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-unplugged-f948c8ed-80d5-411d-95bb-d12e136727e6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-unplugged-f948c8ed-80d5-411d-95bb-d12e136727e6 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-unplugged-f948c8ed-80d5-411d-95bb-d12e136727e6 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-plugged-f948c8ed-80d5-411d-95bb-d12e136727e6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Acquiring lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] Lock "4765dbfc-4219-4797-b40f-24698fa033bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] No waiting events found dispatching network-vif-plugged-f948c8ed-80d5-411d-95bb-d12e136727e6 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:08 user nova-compute[73469]: WARNING nova.compute.manager [req-0fef4e08-1722-476c-980e-fe71bb2fb28c req-e0796852-9aee-4e1a-90a4-3d8eadc17fc4 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received unexpected event network-vif-plugged-f948c8ed-80d5-411d-95bb-d12e136727e6 for instance with vm_state active and task_state deleting.
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2c2896-30dc-430f-9664-ffddf48a918d]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[083547f1-b27d-4c59-97b5-20bba57a3630]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22, portal: 172.16.0.220,3260]
Aug 22 03:05:08 user nova-compute[73469]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22, portal: 172.16.0.220,3260] successful.
Aug 22 03:05:08 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aad3172-3eb9-46ea-bab5-b3eed2744c22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98051c7-4c7b-496f-8896-5fdb63ff678e]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] <== disconnect_volume: return (361ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TqwyCfHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:05:08 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[803637c8-610a-486d-8b53-029eb7b3fb18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb2d84c-fb5f-4f74-bc7f-590a42d9fdb8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79806dbd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b'): ({'sdg'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Removing single pathed devices sdg {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a02bbc4-b24d-4efc-8df6-7bdcd7078c84]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f358c743-7263-4215-a496-f8a646206ed0]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Flushing IO for device /dev/sdg {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c495acf-d79b-4054-81b6-b5ac78a06489]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1891ca17-f015-4047-b0e8-680927394e49]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] SCSI volumes sdg have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2043f68-d46b-4531-bea0-2aa70f178efd]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:05:08 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Creating image(s)
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "/opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "/opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7251f2f0-5c4f-41b0-8784-920b1ecaaf5b]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b, portal: 172.16.0.220,3260]
Aug 22 03:05:08 user nova-compute[73469]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b, portal: 172.16.0.220,3260] successful.
Aug 22 03:05:08 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2e5a9d-39c1-4c82-ba9f-070343bb317b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98f2c65-3416-4ae1-8255-1c25069b66ac]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] <== disconnect_volume: return (362ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybBlDeFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:05:08 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[608d6bf1-0608-4e03-beeb-29bd0286069e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b38700-47c1-49a1-a7ca-0dabcd8a8164]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:05:08 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a41ccc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa'): ({'sdh'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Removing single pathed devices sdh {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ad57f0-47dc-42a0-80a4-8b51bae491b8]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c6d173-9d51-43ce-86c9-8327ed830c00]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Flushing IO for device /dev/sdh {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[136751ff-153b-4b92-b09e-965b54f1173e]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a743e1-d070-4eff-b2a8-174cec3f8a51]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] SCSI volumes sdh have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:05:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc9ba1d-2144-43d4-9288-c6153ad2e729]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.203s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eaf617f-56e1-4965-902b-547bdda56f2b]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa, portal: 172.16.0.220,3260]
Aug 22 03:05:09 user nova-compute[73469]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa, portal: 172.16.0.220,3260] successful.
Aug 22 03:05:09 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk 1073741824" returned: 0 in 0.050s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9fb33f-c49f-487a-8f13-5c8dc20134fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fb4950-954d-496b-ad9a-72077d4a8494]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] <== disconnect_volume: return (380ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:05:09 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Deleting instance files /opt/stack/data/nova/instances/4765dbfc-4219-4797-b40f-24698fa033bf_del
Aug 22 03:05:09 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Deletion of /opt/stack/data/nova/instances/4765dbfc-4219-4797-b40f-24698fa033bf_del complete
Aug 22 03:05:09 user nova-compute[73469]: INFO nova.compute.manager [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Took 3.43 seconds to destroy the instance on the hypervisor.
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.189s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Cannot resize image /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Ensure instance console log exists: /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Start _get_guest_xml network_info=[{"id": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "address": "fa:16:3e:ea:7d:48", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f995853-c3", "ovs_interfaceid": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': '3d71b68e-5bb7-45b9-94c0-e7abfc20a1e5', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qaAvDBNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8a34f0c2-c0b0-4ba7-b9e4-673350a81646', 'attached_at': '', 'detached_at': '', 'volume_id': '1072e618-4680-4f68-9c2e-dd56519d5661', 'serial': '1072e618-4680-4f68-9c2e-dd56519d5661'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:05:09 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 22 03:05:09 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qaAvDBNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:05:09 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:05:09 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:05:09 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6548a61f-7fda-4a0a-8b8f-a32f74c10139]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:05:09 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c5c351-a39b-46d3-bf70-25fe0d885610]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661] added
Aug 22 03:05:09 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac3f7e8-dc6e-4ae1-9376-495c0e3695d9]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5e31ed-d713-4db1-ad71-89eb16d24bb6]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qaAvDBNl {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qaAvDBNl" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2882552f-6705-4b91-8abc-24d06c40a41f]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qaAvDBNl'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadaa481-6d93-4338-b771-dd2a62ecb01a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb9a42d-79c8-4c5c-928d-4c75cf69d27a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:05:09 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:05:09 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b0378c-40ba-4920-a014-eebd59b717e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661, portal: 172.16.0.220,3260]
Aug 22 03:05:09 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661, portal: 172.16.0.220,3260] successful.
Aug 22 03:05:09 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5012e67-42e7-425f-a7cd-155b2de189cb]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4610490a-d554-445f-9506-c04ef0e26be5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:05:09 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:05:09 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:05:09 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87fd7f5-8d00-4088-9a31-b4d2d1b659bf]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:05:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qaAvDBNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:05:10 user nova-compute[73469]: DEBUG nova.compute.manager [req-ff246504-4fa1-4cef-b753-f89f249306ad req-b5601744-7d7c-4a60-afb6-47947348faed service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Received event network-changed-aa11f705-d214-422e-8d55-988560948a37 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:10 user nova-compute[73469]: DEBUG nova.compute.manager [req-ff246504-4fa1-4cef-b753-f89f249306ad req-b5601744-7d7c-4a60-afb6-47947348faed service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Refreshing instance network info cache due to event network-changed-aa11f705-d214-422e-8d55-988560948a37. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:05:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ff246504-4fa1-4cef-b753-f89f249306ad req-b5601744-7d7c-4a60-afb6-47947348faed service nova] Acquiring lock "refresh_cache-84706228-0050-49ac-886a-70842ce8dd3b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:05:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ff246504-4fa1-4cef-b753-f89f249306ad req-b5601744-7d7c-4a60-afb6-47947348faed service nova] Acquired lock "refresh_cache-84706228-0050-49ac-886a-70842ce8dd3b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:05:10 user nova-compute[73469]: DEBUG nova.network.neutron [req-ff246504-4fa1-4cef-b753-f89f249306ad req-b5601744-7d7c-4a60-afb6-47947348faed service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Refreshing network info cache for port aa11f705-d214-422e-8d55-988560948a37 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:05:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:05:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23031643130356131', 'path': '/dev/sdf'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:05:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031643130356131', 'path': '/dev/sdf'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:05:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-22T03:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-390626074',display_name='tempest-ServerActionsTestOtherA-server-1950378600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-390626074',id=26,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzECYecqxKAclQ13djaYo4aP+GCuiMQsT7a2vxvloQrNEucWhpndrbmJM02phQQyzEVLxT8xdS0cQ40404Hf+pU7LkGlE/TIncY5ZMIWkzlf47Mxz0eWcSZbF35ZQNuTQ==',key_name='tempest-keypair-1030511610',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:02:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2d1c312e979e47558b06d4fa70bc103a',ramdisk_id='',reservation_id='r-iptnxvlr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1751677379',owner_user_name='tempest-ServerActionsTestOtherA-1751677379-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:04:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b47d6cefd0d4949bf4c3c0fc72a9cd5',uuid=8a34f0c2-c0b0-4ba7-b9e4-673350a81646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "address": "fa:16:3e:ea:7d:48", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f995853-c3", "ovs_interfaceid": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:05:10 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converting VIF {"id": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "address": "fa:16:3e:ea:7d:48", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f995853-c3", "ovs_interfaceid": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:05:10 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=1f995853-c3f9-41c7-a27b-bf970a21b2b1,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f995853-c3') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:05:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:05:10 user nova-compute[73469]:   <uuid>8a34f0c2-c0b0-4ba7-b9e4-673350a81646</uuid>
Aug 22 03:05:10 user nova-compute[73469]:   <name>instance-0000001a</name>
Aug 22 03:05:10 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:05:10 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:05:10 user nova-compute[73469]:   <metadata>
Aug 22 03:05:10 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:05:10 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:05:10 user nova-compute[73469]:       <nova:name>tempest-ServerActionsTestOtherA-server-1950378600</nova:name>
Aug 22 03:05:10 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:05:09</nova:creationTime>
Aug 22 03:05:10 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:05:10 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:05:10 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:05:10 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:05:10 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:05:10 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:05:10 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:05:10 user nova-compute[73469]:       <nova:owner>
Aug 22 03:05:10 user nova-compute[73469]:         <nova:user uuid="8b47d6cefd0d4949bf4c3c0fc72a9cd5">tempest-ServerActionsTestOtherA-1751677379-project-member</nova:user>
Aug 22 03:05:10 user nova-compute[73469]:         <nova:project uuid="2d1c312e979e47558b06d4fa70bc103a">tempest-ServerActionsTestOtherA-1751677379</nova:project>
Aug 22 03:05:10 user nova-compute[73469]:       </nova:owner>
Aug 22 03:05:10 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:05:10 user nova-compute[73469]:       <nova:ports>
Aug 22 03:05:10 user nova-compute[73469]:         <nova:port uuid="1f995853-c3f9-41c7-a27b-bf970a21b2b1">
Aug 22 03:05:10 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 22 03:05:10 user nova-compute[73469]:         </nova:port>
Aug 22 03:05:10 user nova-compute[73469]:       </nova:ports>
Aug 22 03:05:10 user nova-compute[73469]:     </nova:instance>
Aug 22 03:05:10 user nova-compute[73469]:   </metadata>
Aug 22 03:05:10 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:05:10 user nova-compute[73469]:     <system>
Aug 22 03:05:10 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:05:10 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:05:10 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:05:10 user nova-compute[73469]:       <entry name="serial">8a34f0c2-c0b0-4ba7-b9e4-673350a81646</entry>
Aug 22 03:05:10 user nova-compute[73469]:       <entry name="uuid">8a34f0c2-c0b0-4ba7-b9e4-673350a81646</entry>
Aug 22 03:05:10 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:05:10 user nova-compute[73469]:     </system>
Aug 22 03:05:10 user nova-compute[73469]:   </sysinfo>
Aug 22 03:05:10 user nova-compute[73469]:   <os>
Aug 22 03:05:10 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:05:10 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:05:10 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:05:10 user nova-compute[73469]:   </os>
Aug 22 03:05:10 user nova-compute[73469]:   <features>
Aug 22 03:05:10 user nova-compute[73469]:     <acpi/>
Aug 22 03:05:10 user nova-compute[73469]:     <apic/>
Aug 22 03:05:10 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:05:10 user nova-compute[73469]:   </features>
Aug 22 03:05:10 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:05:10 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:05:10 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:05:10 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:05:10 user nova-compute[73469]:   </clock>
Aug 22 03:05:10 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:05:10 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:05:10 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:05:10 user nova-compute[73469]:   </cpu>
Aug 22 03:05:10 user nova-compute[73469]:   <devices>
Aug 22 03:05:10 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:05:10 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:05:10 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk"/>
Aug 22 03:05:10 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:05:10 user nova-compute[73469]:     </disk>
Aug 22 03:05:10 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:05:10 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:05:10 user nova-compute[73469]:       <source dev="/dev/sdf"/>
Aug 22 03:05:10 user nova-compute[73469]:       <target dev="vdb" bus="virtio"/>
Aug 22 03:05:10 user nova-compute[73469]:       <serial>1072e618-4680-4f68-9c2e-dd56519d5661</serial>
Aug 22 03:05:10 user nova-compute[73469]:     </disk>
Aug 22 03:05:10 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:05:10 user nova-compute[73469]:       <mac address="fa:16:3e:ea:7d:48"/>
Aug 22 03:05:10 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:05:10 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:05:10 user nova-compute[73469]:       <target dev="tap1f995853-c3"/>
Aug 22 03:05:10 user nova-compute[73469]:     </interface>
Aug 22 03:05:10 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:05:10 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/console.log" append="off"/>
Aug 22 03:05:10 user nova-compute[73469]:     </serial>
Aug 22 03:05:10 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:05:10 user nova-compute[73469]:     <video>
Aug 22 03:05:10 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:05:10 user nova-compute[73469]:     </video>
Aug 22 03:05:10 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:05:10 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:05:10 user nova-compute[73469]:     </rng>
Aug 22 03:05:10 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:05:10 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:05:10 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:05:10 user nova-compute[73469]:     </memballoon>
Aug 22 03:05:10 user nova-compute[73469]:   </devices>
Aug 22 03:05:10 user nova-compute[73469]: </domain>
Aug 22 03:05:10 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-22T03:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-390626074',display_name='tempest-ServerActionsTestOtherA-server-1950378600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-390626074',id=26,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzECYecqxKAclQ13djaYo4aP+GCuiMQsT7a2vxvloQrNEucWhpndrbmJM02phQQyzEVLxT8xdS0cQ40404Hf+pU7LkGlE/TIncY5ZMIWkzlf47Mxz0eWcSZbF35ZQNuTQ==',key_name='tempest-keypair-1030511610',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:02:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2d1c312e979e47558b06d4fa70bc103a',ramdisk_id='',reservation_id='r-iptnxvlr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1751677379',owner_user_name='tempest-ServerActionsTestOtherA-1751677379-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:04:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b47d6cefd0d4949bf4c3c0fc72a9cd5',uuid=8a34f0c2-c0b0-4ba7-b9e4-673350a81646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "address": "fa:16:3e:ea:7d:48", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f995853-c3", "ovs_interfaceid": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converting VIF {"id": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "address": "fa:16:3e:ea:7d:48", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f995853-c3", "ovs_interfaceid": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=1f995853-c3f9-41c7-a27b-bf970a21b2b1,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f995853-c3') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG os_vif [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=1f995853-c3f9-41c7-a27b-bf970a21b2b1,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f995853-c3') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f995853-c3, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f995853-c3, col_values=(('external_ids', {'iface-id': '1f995853-c3f9-41c7-a27b-bf970a21b2b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:7d:48', 'vm-uuid': '8a34f0c2-c0b0-4ba7-b9e4-673350a81646'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:11 user nova-compute[73469]: INFO os_vif [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=1f995853-c3f9-41c7-a27b-bf970a21b2b1,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f995853-c3')
Aug 22 03:05:11 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] No VIF found with MAC fa:16:3e:ea:7d:48, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG nova.network.neutron [req-ff246504-4fa1-4cef-b753-f89f249306ad req-b5601744-7d7c-4a60-afb6-47947348faed service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Updated VIF entry in instance network info cache for port aa11f705-d214-422e-8d55-988560948a37. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG nova.network.neutron [req-ff246504-4fa1-4cef-b753-f89f249306ad req-b5601744-7d7c-4a60-afb6-47947348faed service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Updating instance_info_cache with network_info: [{"id": "aa11f705-d214-422e-8d55-988560948a37", "address": "fa:16:3e:69:bb:e0", "network": {"id": "a19cffdb-7658-4fa9-bbfd-2bd8c7d18e33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-386471556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc0a68689c648639c37755526bee4fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa11f705-d2", "ovs_interfaceid": "aa11f705-d214-422e-8d55-988560948a37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ff246504-4fa1-4cef-b753-f89f249306ad req-b5601744-7d7c-4a60-afb6-47947348faed service nova] Releasing lock "refresh_cache-84706228-0050-49ac-886a-70842ce8dd3b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG nova.compute.manager [req-95805547-acd2-4134-ae9d-1d35bd3346d7 req-cf688e76-c09f-4be4-8f0f-4cf1ab3c8dd6 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-deleted-42e5267b-949c-44dd-9b96-975b4534aaa3 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:11 user nova-compute[73469]: INFO nova.compute.manager [req-95805547-acd2-4134-ae9d-1d35bd3346d7 req-cf688e76-c09f-4be4-8f0f-4cf1ab3c8dd6 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Neutron deleted interface 42e5267b-949c-44dd-9b96-975b4534aaa3; detaching it from the instance and deleting it from the info cache
Aug 22 03:05:11 user nova-compute[73469]: DEBUG nova.network.neutron [req-95805547-acd2-4134-ae9d-1d35bd3346d7 req-cf688e76-c09f-4be4-8f0f-4cf1ab3c8dd6 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updating instance_info_cache with network_info: [{"id": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "address": "fa:16:3e:24:2f:4c", "network": {"id": "08f11990-95e2-453a-a05b-2526367ec3fd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-130047836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5ac4586-bd", "ovs_interfaceid": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "address": "fa:16:3e:e4:03:95", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d0a8d68-79", "ovs_interfaceid": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "029910e1-c407-4728-a2a3-4daf09db5632", "address": "fa:16:3e:58:a3:0d", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029910e1-c4", "ovs_interfaceid": "029910e1-c407-4728-a2a3-4daf09db5632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "address": "fa:16:3e:c2:21:f8", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac8e395-8b", "ovs_interfaceid": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc85b38c-492a-46f6-8d44-67882abf29fb", "address": "fa:16:3e:a9:ae:10", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc85b38c-49", "ovs_interfaceid": "bc85b38c-492a-46f6-8d44-67882abf29fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f948c8ed-80d5-411d-95bb-d12e136727e6", "address": "fa:16:3e:e9:38:9c", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948c8ed-80", "ovs_interfaceid": "f948c8ed-80d5-411d-95bb-d12e136727e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:05:11 user nova-compute[73469]: DEBUG nova.compute.manager [req-95805547-acd2-4134-ae9d-1d35bd3346d7 req-cf688e76-c09f-4be4-8f0f-4cf1ab3c8dd6 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Detach interface failed, port_id=42e5267b-949c-44dd-9b96-975b4534aaa3, reason: Instance 4765dbfc-4219-4797-b40f-24698fa033bf could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 03:05:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:12 user nova-compute[73469]: DEBUG nova.compute.manager [req-20844c33-6754-4423-b8f7-6f562b221f98 req-c237c998-bbea-4303-ae8d-30a339cb95ab service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Received event network-vif-plugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-20844c33-6754-4423-b8f7-6f562b221f98 req-c237c998-bbea-4303-ae8d-30a339cb95ab service nova] Acquiring lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-20844c33-6754-4423-b8f7-6f562b221f98 req-c237c998-bbea-4303-ae8d-30a339cb95ab service nova] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-20844c33-6754-4423-b8f7-6f562b221f98 req-c237c998-bbea-4303-ae8d-30a339cb95ab service nova] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:12 user nova-compute[73469]: DEBUG nova.compute.manager [req-20844c33-6754-4423-b8f7-6f562b221f98 req-c237c998-bbea-4303-ae8d-30a339cb95ab service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] No waiting events found dispatching network-vif-plugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:12 user nova-compute[73469]: WARNING nova.compute.manager [req-20844c33-6754-4423-b8f7-6f562b221f98 req-c237c998-bbea-4303-ae8d-30a339cb95ab service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Received unexpected event network-vif-plugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 for instance with vm_state active and task_state rebuild_spawning.
Aug 22 03:05:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:13 user nova-compute[73469]: INFO nova.compute.manager [None req-4b6aa7cd-ce61-42f5-a84b-61f3285c36e8 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Unrescuing
Aug 22 03:05:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4b6aa7cd-ce61-42f5-a84b-61f3285c36e8 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:05:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4b6aa7cd-ce61-42f5-a84b-61f3285c36e8 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquired lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:05:13 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4b6aa7cd-ce61-42f5-a84b-61f3285c36e8 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:05:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-65024c6a-7f4b-4199-924b-139b36cc6817 req-5973eea5-9eaf-443f-a557-f3d7c8c4ad6d service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-deleted-f948c8ed-80d5-411d-95bb-d12e136727e6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:13 user nova-compute[73469]: INFO nova.compute.manager [req-65024c6a-7f4b-4199-924b-139b36cc6817 req-5973eea5-9eaf-443f-a557-f3d7c8c4ad6d service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Neutron deleted interface f948c8ed-80d5-411d-95bb-d12e136727e6; detaching it from the instance and deleting it from the info cache
Aug 22 03:05:13 user nova-compute[73469]: DEBUG nova.network.neutron [req-65024c6a-7f4b-4199-924b-139b36cc6817 req-5973eea5-9eaf-443f-a557-f3d7c8c4ad6d service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updating instance_info_cache with network_info: [{"id": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "address": "fa:16:3e:24:2f:4c", "network": {"id": "08f11990-95e2-453a-a05b-2526367ec3fd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-130047836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5ac4586-bd", "ovs_interfaceid": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "address": "fa:16:3e:e4:03:95", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d0a8d68-79", "ovs_interfaceid": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "029910e1-c407-4728-a2a3-4daf09db5632", "address": "fa:16:3e:58:a3:0d", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029910e1-c4", "ovs_interfaceid": "029910e1-c407-4728-a2a3-4daf09db5632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "address": "fa:16:3e:c2:21:f8", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac8e395-8b", "ovs_interfaceid": "eac8e395-8b46-4d73-a0b8-495ee2530d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc85b38c-492a-46f6-8d44-67882abf29fb", "address": "fa:16:3e:a9:ae:10", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc85b38c-49", "ovs_interfaceid": "bc85b38c-492a-46f6-8d44-67882abf29fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:05:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-65024c6a-7f4b-4199-924b-139b36cc6817 req-5973eea5-9eaf-443f-a557-f3d7c8c4ad6d service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Detach interface failed, port_id=f948c8ed-80d5-411d-95bb-d12e136727e6, reason: Instance 4765dbfc-4219-4797-b40f-24698fa033bf could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 03:05:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-65024c6a-7f4b-4199-924b-139b36cc6817 req-5973eea5-9eaf-443f-a557-f3d7c8c4ad6d service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-deleted-eac8e395-8b46-4d73-a0b8-495ee2530d6c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:13 user nova-compute[73469]: INFO nova.compute.manager [req-65024c6a-7f4b-4199-924b-139b36cc6817 req-5973eea5-9eaf-443f-a557-f3d7c8c4ad6d service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Neutron deleted interface eac8e395-8b46-4d73-a0b8-495ee2530d6c; detaching it from the instance and deleting it from the info cache
Aug 22 03:05:13 user nova-compute[73469]: DEBUG nova.network.neutron [req-65024c6a-7f4b-4199-924b-139b36cc6817 req-5973eea5-9eaf-443f-a557-f3d7c8c4ad6d service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updating instance_info_cache with network_info: [{"id": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "address": "fa:16:3e:24:2f:4c", "network": {"id": "08f11990-95e2-453a-a05b-2526367ec3fd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-130047836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5ac4586-bd", "ovs_interfaceid": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "address": "fa:16:3e:e4:03:95", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d0a8d68-79", "ovs_interfaceid": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "029910e1-c407-4728-a2a3-4daf09db5632", "address": "fa:16:3e:58:a3:0d", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029910e1-c4", "ovs_interfaceid": "029910e1-c407-4728-a2a3-4daf09db5632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bc85b38c-492a-46f6-8d44-67882abf29fb", "address": "fa:16:3e:a9:ae:10", "network": {"id": "caf89e44-6bb1-4832-8053-68378a2c004b", "bridge": "br-int", "label": "tempest-device-tagging-net2-490318164", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc85b38c-49", "ovs_interfaceid": "bc85b38c-492a-46f6-8d44-67882abf29fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:05:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-65024c6a-7f4b-4199-924b-139b36cc6817 req-5973eea5-9eaf-443f-a557-f3d7c8c4ad6d service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Detach interface failed, port_id=eac8e395-8b46-4d73-a0b8-495ee2530d6c, reason: Instance 4765dbfc-4219-4797-b40f-24698fa033bf could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 03:05:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-65024c6a-7f4b-4199-924b-139b36cc6817 req-5973eea5-9eaf-443f-a557-f3d7c8c4ad6d service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-deleted-bc85b38c-492a-46f6-8d44-67882abf29fb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:13 user nova-compute[73469]: INFO nova.compute.manager [req-65024c6a-7f4b-4199-924b-139b36cc6817 req-5973eea5-9eaf-443f-a557-f3d7c8c4ad6d service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Neutron deleted interface bc85b38c-492a-46f6-8d44-67882abf29fb; detaching it from the instance and deleting it from the info cache
Aug 22 03:05:13 user nova-compute[73469]: DEBUG nova.network.neutron [req-65024c6a-7f4b-4199-924b-139b36cc6817 req-5973eea5-9eaf-443f-a557-f3d7c8c4ad6d service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updating instance_info_cache with network_info: [{"id": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "address": "fa:16:3e:24:2f:4c", "network": {"id": "08f11990-95e2-453a-a05b-2526367ec3fd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-130047836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5ac4586-bd", "ovs_interfaceid": "d5ac4586-bd1a-488b-8c9e-ee23a27e57eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "address": "fa:16:3e:e4:03:95", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d0a8d68-79", "ovs_interfaceid": "3d0a8d68-796c-4c40-a6df-17d44e3ba385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "029910e1-c407-4728-a2a3-4daf09db5632", "address": "fa:16:3e:58:a3:0d", "network": {"id": "cca084c6-afb1-4f30-98c3-4ecbad297687", "bridge": "br-int", "label": "tempest-device-tagging-net1-1426070201", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "78ba7249950f4f20a16ccdee64ee9b66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029910e1-c4", "ovs_interfaceid": "029910e1-c407-4728-a2a3-4daf09db5632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:05:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-65024c6a-7f4b-4199-924b-139b36cc6817 req-5973eea5-9eaf-443f-a557-f3d7c8c4ad6d service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Detach interface failed, port_id=bc85b38c-492a-46f6-8d44-67882abf29fb, reason: Instance 4765dbfc-4219-4797-b40f-24698fa033bf could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:05:14 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Took 4.86 seconds to deallocate network for instance.
Aug 22 03:05:14 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4b6aa7cd-ce61-42f5-a84b-61f3285c36e8 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Updating instance_info_cache with network_info: [{"id": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "address": "fa:16:3e:63:38:91", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e4e29-61", "ovs_interfaceid": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4b6aa7cd-ce61-42f5-a84b-61f3285c36e8 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Releasing lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG nova.objects.instance [None req-4b6aa7cd-ce61-42f5-a84b-61f3285c36e8 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'flavor' on Instance uuid f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-207effff-e9fc-46ae-8f36-c00e4f686cd6 req-158b8bc6-a9d6-496b-a3aa-0a5e4c69946a service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received event network-vif-unplugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-207effff-e9fc-46ae-8f36-c00e4f686cd6 req-158b8bc6-a9d6-496b-a3aa-0a5e4c69946a service nova] Acquiring lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-207effff-e9fc-46ae-8f36-c00e4f686cd6 req-158b8bc6-a9d6-496b-a3aa-0a5e4c69946a service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-207effff-e9fc-46ae-8f36-c00e4f686cd6 req-158b8bc6-a9d6-496b-a3aa-0a5e4c69946a service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-207effff-e9fc-46ae-8f36-c00e4f686cd6 req-158b8bc6-a9d6-496b-a3aa-0a5e4c69946a service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] No waiting events found dispatching network-vif-unplugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:14 user nova-compute[73469]: WARNING nova.compute.manager [req-207effff-e9fc-46ae-8f36-c00e4f686cd6 req-158b8bc6-a9d6-496b-a3aa-0a5e4c69946a service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received unexpected event network-vif-unplugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 for instance with vm_state rescued and task_state unrescuing.
Aug 22 03:05:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:14 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Instance destroyed successfully.
Aug 22 03:05:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-6de12175-6988-4399-89c7-c290b8df1fe4 req-ed9ced30-4551-4afb-a821-62aebc85073f service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Received event network-vif-plugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6de12175-6988-4399-89c7-c290b8df1fe4 req-ed9ced30-4551-4afb-a821-62aebc85073f service nova] Acquiring lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6de12175-6988-4399-89c7-c290b8df1fe4 req-ed9ced30-4551-4afb-a821-62aebc85073f service nova] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6de12175-6988-4399-89c7-c290b8df1fe4 req-ed9ced30-4551-4afb-a821-62aebc85073f service nova] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-6de12175-6988-4399-89c7-c290b8df1fe4 req-ed9ced30-4551-4afb-a821-62aebc85073f service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] No waiting events found dispatching network-vif-plugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:14 user nova-compute[73469]: WARNING nova.compute.manager [req-6de12175-6988-4399-89c7-c290b8df1fe4 req-ed9ced30-4551-4afb-a821-62aebc85073f service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Received unexpected event network-vif-plugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 for instance with vm_state active and task_state rebuild_spawning.
Aug 22 03:05:14 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673514.953186, 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:05:14 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] VM Resumed (Lifecycle Event)
Aug 22 03:05:14 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:05:14 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Instance spawned successfully.
Aug 22 03:05:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:05:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:05:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:05:15 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:05:15 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 22 03:05:15 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673514.9543457, 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:05:15 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] VM Started (Lifecycle Event)
Aug 22 03:05:15 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:05:15 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:05:15 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 22 03:05:15 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:05:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:15 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73469) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 22 03:05:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad0a0c50-d6f5-4b2e-ae08-9d9dca32c3ac tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.073s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:15 user nova-compute[73469]: DEBUG nova.compute.manager [req-f5107301-8b73-41ae-a701-563fa6a2b598 req-5da60a86-1657-49ab-b32b-b120a6094829 service nova] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Received event network-vif-deleted-d5ac4586-bd1a-488b-8c9e-ee23a27e57eb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Acquiring lock "84706228-0050-49ac-886a-70842ce8dd3b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "84706228-0050-49ac-886a-70842ce8dd3b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG nova.objects.instance [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lazy-loading 'flavor' on Instance uuid 84706228-0050-49ac-886a-70842ce8dd3b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "84706228-0050-49ac-886a-70842ce8dd3b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Acquiring lock "84706228-0050-49ac-886a-70842ce8dd3b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "84706228-0050-49ac-886a-70842ce8dd3b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:16 user nova-compute[73469]: INFO nova.compute.manager [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Attaching volume 93ea930f-755e-4ee7-af68-3e281cda5a2b to /dev/vdb
Aug 22 03:05:16 user nova-compute[73469]: DEBUG os_brick.utils [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[49291741-58bf-4b64-8e6f-ddc222f56a03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8123c1-74fb-404f-8571-a2611d37d71a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc23a76-eb1e-4ce1-ab6d-b15cde8dab19]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d303eb50-73ec-4880-8656-a1e1a028dc34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-c94deaac-02ab-4f39-bb26-9f0a15e2b355 req-afd87f1c-9740-479f-98c1-a6281e5f31ba service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received event network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c94deaac-02ab-4f39-bb26-9f0a15e2b355 req-afd87f1c-9740-479f-98c1-a6281e5f31ba service nova] Acquiring lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c94deaac-02ab-4f39-bb26-9f0a15e2b355 req-afd87f1c-9740-479f-98c1-a6281e5f31ba service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c94deaac-02ab-4f39-bb26-9f0a15e2b355 req-afd87f1c-9740-479f-98c1-a6281e5f31ba service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-c94deaac-02ab-4f39-bb26-9f0a15e2b355 req-afd87f1c-9740-479f-98c1-a6281e5f31ba service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] No waiting events found dispatching network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:16 user nova-compute[73469]: WARNING nova.compute.manager [req-c94deaac-02ab-4f39-bb26-9f0a15e2b355 req-afd87f1c-9740-479f-98c1-a6281e5f31ba service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received unexpected event network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 for instance with vm_state rescued and task_state unrescuing.
Aug 22 03:05:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-c94deaac-02ab-4f39-bb26-9f0a15e2b355 req-afd87f1c-9740-479f-98c1-a6281e5f31ba service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received event network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c94deaac-02ab-4f39-bb26-9f0a15e2b355 req-afd87f1c-9740-479f-98c1-a6281e5f31ba service nova] Acquiring lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c94deaac-02ab-4f39-bb26-9f0a15e2b355 req-afd87f1c-9740-479f-98c1-a6281e5f31ba service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c94deaac-02ab-4f39-bb26-9f0a15e2b355 req-afd87f1c-9740-479f-98c1-a6281e5f31ba service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-c94deaac-02ab-4f39-bb26-9f0a15e2b355 req-afd87f1c-9740-479f-98c1-a6281e5f31ba service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] No waiting events found dispatching network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:16 user nova-compute[73469]: WARNING nova.compute.manager [req-c94deaac-02ab-4f39-bb26-9f0a15e2b355 req-afd87f1c-9740-479f-98c1-a6281e5f31ba service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received unexpected event network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 for instance with vm_state rescued and task_state unrescuing.
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:05:16 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd1a5f2-6eb8-4f53-b8c6-4bc4af361e5a]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG os_brick.utils [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Updating existing volume attachment record: 2a9c3d01-b17f-4f7f-994d-f40c9aa7d563 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:05:16 user nova-compute[73469]: INFO nova.compute.manager [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Took 2.82 seconds to detach 3 volumes for instance.
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:17 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:05:17 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:05:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.638s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:17 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Deleted allocations for instance 4765dbfc-4219-4797-b40f-24698fa033bf
Aug 22 03:05:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-063fcbdc-c2a7-4240-81fe-0d5bf257385f tempest-TaggedBootDevicesTest_v242-4296881 tempest-TaggedBootDevicesTest_v242-4296881-project-member] Lock "4765dbfc-4219-4797-b40f-24698fa033bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.145s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-134c664a-f165-46a2-b710-1f2d5dcd55bd req-48aeeee5-96f1-40c7-b60a-41fffa3808c7 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received event network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-134c664a-f165-46a2-b710-1f2d5dcd55bd req-48aeeee5-96f1-40c7-b60a-41fffa3808c7 service nova] Acquiring lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-134c664a-f165-46a2-b710-1f2d5dcd55bd req-48aeeee5-96f1-40c7-b60a-41fffa3808c7 service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-134c664a-f165-46a2-b710-1f2d5dcd55bd req-48aeeee5-96f1-40c7-b60a-41fffa3808c7 service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-134c664a-f165-46a2-b710-1f2d5dcd55bd req-48aeeee5-96f1-40c7-b60a-41fffa3808c7 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] No waiting events found dispatching network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:05:18 user nova-compute[73469]: WARNING nova.compute.manager [req-134c664a-f165-46a2-b710-1f2d5dcd55bd req-48aeeee5-96f1-40c7-b60a-41fffa3808c7 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received unexpected event network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 for instance with vm_state rescued and task_state unrescuing.
Aug 22 03:05:18 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673503.8830836, d8433c45-b889-4a7b-88c2-ba00679b1d26 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:05:18 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] VM Stopped (Lifecycle Event)
Aug 22 03:05:18 user nova-compute[73469]: DEBUG nova.compute.manager [None req-274c53fd-9a6b-4d9e-b714-da27f86d2051 None None] [instance: d8433c45-b889-4a7b-88c2-ba00679b1d26] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:05:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Removed pending event for f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 due to event {{(pid=73469) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 22 03:05:18 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673518.9933097, f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:05:18 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] VM Resumed (Lifecycle Event)
Aug 22 03:05:19 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4b6aa7cd-ce61-42f5-a84b-61f3285c36e8 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:05:19 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:05:19 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:05:19 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 22 03:05:19 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673518.9981716, f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:05:19 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] VM Started (Lifecycle Event)
Aug 22 03:05:19 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:05:19 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:05:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:22 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673507.632108, 4765dbfc-4219-4797-b40f-24698fa033bf => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:05:22 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] VM Stopped (Lifecycle Event)
Aug 22 03:05:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-db806e85-7cca-4d26-8f35-1f4158633b22 None None] [instance: 4765dbfc-4219-4797-b40f-24698fa033bf] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:05:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeXOsPvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:05:29 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:05:29 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:05:29 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[988ea340-1ac4-40a1-a6fb-c2099f2937f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:05:29 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd04bb1-5e9c-40be-8004-688c5ccf21f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b] added
Aug 22 03:05:29 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8b3105-6bb6-45da-9456-094a13fc36ce]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e458cbeb-9f6a-4327-8f78-370b5bd78d1a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zeXOsPvL {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zeXOsPvL" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a45b3f-d297-419c-968e-5084df0fd5c8]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zeXOsPvL'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[65340ab8-e9b7-4d70-8608-e399b688c565]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5f4155-5330-42f6-a782-033b33a9bcdd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d64d07-6078-4bfc-bae2-95a5483a7f04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b, portal: 172.16.0.220,3260]
Aug 22 03:05:29 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b, portal: 172.16.0.220,3260] successful.
Aug 22 03:05:29 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[84aa0838-b9b4-4d31-b79f-38b6dac56c2d]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3247e62c-c074-4b84-b633-a8538a1e8567]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b (non-flash)
Aug 22 03:05:29 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:05:29 user nova-compute[73469]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b (non-flash)
Aug 22 03:05:29 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] HCTL ('38', '-', '-', 0) found on session 35 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ca8c37-80d5-4ba6-a97d-569ba653c1d6]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:05:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeXOsPvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:05:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:05:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23532623933613432', 'path': '/dev/sdg'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:05:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532623933613432', 'path': '/dev/sdg'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:05:30 user nova-compute[73469]: DEBUG nova.objects.instance [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lazy-loading 'flavor' on Instance uuid 84706228-0050-49ac-886a-70842ce8dd3b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:05:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:05:30 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:05:30 user nova-compute[73469]:   <source dev="/dev/sdg"/>
Aug 22 03:05:30 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:05:30 user nova-compute[73469]:   <serial>93ea930f-755e-4ee7-af68-3e281cda5a2b</serial>
Aug 22 03:05:30 user nova-compute[73469]: </disk>
Aug 22 03:05:30 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:05:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:05:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:05:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] No VIF found with MAC fa:16:3e:69:bb:e0, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:05:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6b4283af-dba5-497b-9224-17358993a195 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "84706228-0050-49ac-886a-70842ce8dd3b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.774s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:31 user nova-compute[73469]: DEBUG nova.compute.manager [req-89a3df01-8784-42ef-8ef5-20ec2ae21cfe req-766e5075-3aa2-480b-b6ef-1332acca7dc4 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Received event network-changed-147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:31 user nova-compute[73469]: DEBUG nova.compute.manager [req-89a3df01-8784-42ef-8ef5-20ec2ae21cfe req-766e5075-3aa2-480b-b6ef-1332acca7dc4 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Refreshing instance network info cache due to event network-changed-147479ad-a9fc-4ccf-a900-95e347d1a79e. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:05:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-89a3df01-8784-42ef-8ef5-20ec2ae21cfe req-766e5075-3aa2-480b-b6ef-1332acca7dc4 service nova] Acquiring lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:05:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-89a3df01-8784-42ef-8ef5-20ec2ae21cfe req-766e5075-3aa2-480b-b6ef-1332acca7dc4 service nova] Acquired lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:05:31 user nova-compute[73469]: DEBUG nova.network.neutron [req-89a3df01-8784-42ef-8ef5-20ec2ae21cfe req-766e5075-3aa2-480b-b6ef-1332acca7dc4 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Refreshing network info cache for port 147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:05:31 user nova-compute[73469]: DEBUG nova.network.neutron [req-89a3df01-8784-42ef-8ef5-20ec2ae21cfe req-766e5075-3aa2-480b-b6ef-1332acca7dc4 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Updated VIF entry in instance network info cache for port 147479ad-a9fc-4ccf-a900-95e347d1a79e. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:05:31 user nova-compute[73469]: DEBUG nova.network.neutron [req-89a3df01-8784-42ef-8ef5-20ec2ae21cfe req-766e5075-3aa2-480b-b6ef-1332acca7dc4 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Updating instance_info_cache with network_info: [{"id": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "address": "fa:16:3e:1e:69:04", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap147479ad-a9", "ovs_interfaceid": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:05:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-89a3df01-8784-42ef-8ef5-20ec2ae21cfe req-766e5075-3aa2-480b-b6ef-1332acca7dc4 service nova] Releasing lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:05:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-9f0ea40f-8ecf-4c5b-bca5-ada08d9cfd9e req-82156de8-afbc-4c58-9c8c-0b57a0afa95d service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Received event network-changed-147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-9f0ea40f-8ecf-4c5b-bca5-ada08d9cfd9e req-82156de8-afbc-4c58-9c8c-0b57a0afa95d service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Refreshing instance network info cache due to event network-changed-147479ad-a9fc-4ccf-a900-95e347d1a79e. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:05:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9f0ea40f-8ecf-4c5b-bca5-ada08d9cfd9e req-82156de8-afbc-4c58-9c8c-0b57a0afa95d service nova] Acquiring lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:05:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9f0ea40f-8ecf-4c5b-bca5-ada08d9cfd9e req-82156de8-afbc-4c58-9c8c-0b57a0afa95d service nova] Acquired lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:05:32 user nova-compute[73469]: DEBUG nova.network.neutron [req-9f0ea40f-8ecf-4c5b-bca5-ada08d9cfd9e req-82156de8-afbc-4c58-9c8c-0b57a0afa95d service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Refreshing network info cache for port 147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:05:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "0d5a30d1-565c-47c9-8caa-84dab130e117" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:32 user nova-compute[73469]: INFO nova.compute.manager [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Detaching volume 83bb2eca-4fba-475b-9cd5-70fc9996656b
Aug 22 03:05:32 user nova-compute[73469]: INFO nova.virt.block_device [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Attempting to driver detach volume 83bb2eca-4fba-475b-9cd5-70fc9996656b from mountpoint /dev/vdb
Aug 22 03:05:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Attempting to detach device vdb from instance 0d5a30d1-565c-47c9-8caa-84dab130e117 from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:05:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:05:32 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:05:32 user nova-compute[73469]:   <source dev="/dev/sdi"/>
Aug 22 03:05:32 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:05:32 user nova-compute[73469]:   <serial>83bb2eca-4fba-475b-9cd5-70fc9996656b</serial>
Aug 22 03:05:32 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:05:32 user nova-compute[73469]: </disk>
Aug 22 03:05:32 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:05:32 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Successfully detached device vdb from instance 0d5a30d1-565c-47c9-8caa-84dab130e117 from the persistent domain config.
Aug 22 03:05:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0d5a30d1-565c-47c9-8caa-84dab130e117 from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:05:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:05:32 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:05:32 user nova-compute[73469]:   <source dev="/dev/sdi"/>
Aug 22 03:05:32 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:05:32 user nova-compute[73469]:   <serial>83bb2eca-4fba-475b-9cd5-70fc9996656b</serial>
Aug 22 03:05:32 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:05:32 user nova-compute[73469]: </disk>
Aug 22 03:05:32 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:05:32 user nova-compute[73469]: DEBUG nova.network.neutron [req-9f0ea40f-8ecf-4c5b-bca5-ada08d9cfd9e req-82156de8-afbc-4c58-9c8c-0b57a0afa95d service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Updated VIF entry in instance network info cache for port 147479ad-a9fc-4ccf-a900-95e347d1a79e. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:05:32 user nova-compute[73469]: DEBUG nova.network.neutron [req-9f0ea40f-8ecf-4c5b-bca5-ada08d9cfd9e req-82156de8-afbc-4c58-9c8c-0b57a0afa95d service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Updating instance_info_cache with network_info: [{"id": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "address": "fa:16:3e:1e:69:04", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap147479ad-a9", "ovs_interfaceid": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:05:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9f0ea40f-8ecf-4c5b-bca5-ada08d9cfd9e req-82156de8-afbc-4c58-9c8c-0b57a0afa95d service nova] Releasing lock "refresh_cache-0d5a30d1-565c-47c9-8caa-84dab130e117" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:05:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Acquiring lock "84706228-0050-49ac-886a-70842ce8dd3b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "84706228-0050-49ac-886a-70842ce8dd3b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:33 user nova-compute[73469]: INFO nova.compute.manager [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Detaching volume 93ea930f-755e-4ee7-af68-3e281cda5a2b
Aug 22 03:05:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692673533.051988, 0d5a30d1-565c-47c9-8caa-84dab130e117 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0d5a30d1-565c-47c9-8caa-84dab130e117 {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:05:33 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Successfully detached device vdb from instance 0d5a30d1-565c-47c9-8caa-84dab130e117 from the live domain config.
Aug 22 03:05:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uOXPzmbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:05:33 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:33 user nova-compute[73469]: INFO nova.virt.block_device [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Attempting to driver detach volume 93ea930f-755e-4ee7-af68-3e281cda5a2b from mountpoint /dev/vdb
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bffc99-f9e0-4560-a964-642cb1405f45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Attempting to detach device vdb from instance 84706228-0050-49ac-886a-70842ce8dd3b from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:05:33 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:05:33 user nova-compute[73469]:   <source dev="/dev/sdg"/>
Aug 22 03:05:33 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:05:33 user nova-compute[73469]:   <serial>93ea930f-755e-4ee7-af68-3e281cda5a2b</serial>
Aug 22 03:05:33 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:05:33 user nova-compute[73469]: </disk>
Aug 22 03:05:33 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:05:33 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Successfully detached device vdb from instance 84706228-0050-49ac-886a-70842ce8dd3b from the persistent domain config.
Aug 22 03:05:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 84706228-0050-49ac-886a-70842ce8dd3b from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:05:33 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:05:33 user nova-compute[73469]:   <source dev="/dev/sdg"/>
Aug 22 03:05:33 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:05:33 user nova-compute[73469]:   <serial>93ea930f-755e-4ee7-af68-3e281cda5a2b</serial>
Aug 22 03:05:33 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:05:33 user nova-compute[73469]: </disk>
Aug 22 03:05:33 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[302f6063-ee48-4381-aa35-089acebe674b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b (non-flash)
Aug 22 03:05:33 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b (non-flash)
Aug 22 03:05:33 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79b4141b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b'): ({'sdi'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Removing single pathed devices sdi {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccec7203-285c-4921-a3c1-c97b3b406e2c]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3054a61d-54f3-4997-84bf-af9562938e78]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Flushing IO for device /dev/sdi {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1c7a76-5f6c-4ca0-86d9-e30574cda11d]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe1049d-4700-4d13-827c-9a7956c4a56f]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] SCSI volumes sdi have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1537c462-ef2d-49d3-9fb5-263890a6dcf3]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45fb744-5a57-4df3-9601-0fe248a974c1]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b, portal: 172.16.0.220,3260]
Aug 22 03:05:33 user nova-compute[73469]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b, portal: 172.16.0.220,3260] successful.
Aug 22 03:05:33 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bb2eca-4fba-475b-9cd5-70fc9996656b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9150d7f0-6858-4eb1-9e56-23ca8b786428]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] <== disconnect_volume: return (319ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692673533.560898, 84706228-0050-49ac-886a-70842ce8dd3b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 84706228-0050-49ac-886a-70842ce8dd3b {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:05:33 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Successfully detached device vdb from instance 84706228-0050-49ac-886a-70842ce8dd3b from the live domain config.
Aug 22 03:05:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeXOsPvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:05:33 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af4f7b4-b31b-44bd-8f29-9fe85f984ac6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6934a8f3-782c-4746-aecf-7b5e882e3156]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b (non-flash)
Aug 22 03:05:33 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:05:33 user nova-compute[73469]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b (non-flash)
Aug 22 03:05:33 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a41ceb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b'): ({'sdg'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Removing single pathed devices sdg {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[642bb0ca-df11-4af0-872a-8e5b872b1f20]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af1839d-820f-4b34-afe6-a4b28d0068c1]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Flushing IO for device /dev/sdg {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad29cd7a-9daf-43d1-9a36-149ab6b28506]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[485d3ab2-37ca-4853-8278-c19ac21481e0]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] SCSI volumes sdg have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.050s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[38de654e-08d7-4c4f-a88b-a636e0070af8]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f63904-5462-49f1-85c6-3f9261d09982]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b, portal: 172.16.0.220,3260]
Aug 22 03:05:33 user nova-compute[73469]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b, portal: 172.16.0.220,3260] successful.
Aug 22 03:05:33 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ea930f-755e-4ee7-af68-3e281cda5a2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07af3ef-1fa3-48c3-87dd-07eb2fed559d]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] <== disconnect_volume: return (341ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:05:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:05:34 user nova-compute[73469]: DEBUG nova.objects.instance [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lazy-loading 'flavor' on Instance uuid 0d5a30d1-565c-47c9-8caa-84dab130e117 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:05:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-28df90a9-0d9d-405e-9149-ff1f0f12ad57 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.875s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:34 user nova-compute[73469]: DEBUG nova.objects.instance [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lazy-loading 'flavor' on Instance uuid 84706228-0050-49ac-886a-70842ce8dd3b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:05:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e5dd8335-5648-402c-a4bf-af629c82dfa9 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "84706228-0050-49ac-886a-70842ce8dd3b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.753s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:41 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:05:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:44 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:05:45 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:05:45 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:05:45 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:05:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-bda33a54-edf0-4809-9469-f1774fdc5b12" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:05:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-bda33a54-edf0-4809-9469-f1774fdc5b12" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:05:45 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:05:45 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid bda33a54-edf0-4809-9469-f1774fdc5b12 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Updating instance_info_cache with network_info: [{"id": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "address": "fa:16:3e:bb:16:09", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2932ec7b-19", "ovs_interfaceid": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-bda33a54-edf0-4809-9469-f1774fdc5b12" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:05:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:48 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:05:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:48 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:05:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:05:51 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:05:51 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:05:51 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=6777MB free_disk=24.88744354248047GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:05:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d0668c0-7a49-4857-9b69-541021f18ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance dc3f5545-8ebb-4947-97d0-98a91f67e421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8242cec1-3b35-4d14-9e0b-db8a7e75697d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 2e621408-a0af-460b-80a2-3446b5f1aadb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82e872a7-70b0-4290-9a11-5316765aed01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 20316a2a-2f1f-4008-ab14-551e627bf680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 980e57bf-dec9-46f3-8d69-e20a17603af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 0d5a30d1-565c-47c9-8caa-84dab130e117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 5984759d-28f1-45e8-bb4c-27bd8df426f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 84706228-0050-49ac-886a-70842ce8dd3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance e43158b8-28fc-429c-b329-26be91761d4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:05:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:53 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:05:53 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:05:53 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:05:53 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:05:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:05:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:57 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:05:57 user nova-compute[73469]: INFO nova.compute.claims [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Claim successful on node user
Aug 22 03:05:57 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:05:57 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:05:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:05:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:05:57 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:05:57 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:05:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:05:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:05:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:05:57 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Creating image(s)
Aug 22 03:05:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "/opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "/opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "/opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG nova.policy [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41e697cd5e5f422f8ac90f7496f60936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3e1f2f72c7497ca3ad923a4b9459dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.172s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk 1073741824" returned: 0 in 0.053s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.253s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Successfully created port: 866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Cannot resize image /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'migration_context' on Instance uuid 149b34df-3d3c-48fc-99f2-0c3dc4334b1b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Ensure instance console log exists: /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:05:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Successfully updated port: 866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquired lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.compute.manager [req-fbb4c2d4-9fcf-4aaa-a506-db4b0d10b7ac req-876bb9c5-e869-46e8-b29d-954e9c74e9df service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received event network-changed-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.compute.manager [req-fbb4c2d4-9fcf-4aaa-a506-db4b0d10b7ac req-876bb9c5-e869-46e8-b29d-954e9c74e9df service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Refreshing instance network info cache due to event network-changed-866b90b8-9ca8-4235-9f79-45d13fc5f929. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fbb4c2d4-9fcf-4aaa-a506-db4b0d10b7ac req-876bb9c5-e869-46e8-b29d-954e9c74e9df service nova] Acquiring lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Updating instance_info_cache with network_info: [{"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Releasing lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Instance network_info: |[{"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fbb4c2d4-9fcf-4aaa-a506-db4b0d10b7ac req-876bb9c5-e869-46e8-b29d-954e9c74e9df service nova] Acquired lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.network.neutron [req-fbb4c2d4-9fcf-4aaa-a506-db4b0d10b7ac req-876bb9c5-e869-46e8-b29d-954e9c74e9df service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Refreshing network info cache for port 866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Start _get_guest_xml network_info=[{"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:05:59 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:05:59 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:05:59 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-497177608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-497177608',id=29,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI0YlC0MdxkVUSO81PLfgms40a6G6QD6YfZDORCvcGREtqMCzN/af47ygJmaqeEDyH5JKafVWBVdlK5rvd3tumDct1g36YoiSCIhWA6MhiAMlbCo9hRSMDY7Uq4rNNh/w==',key_name='tempest-keypair-884872358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca3e1f2f72c7497ca3ad923a4b9459dc',ramdisk_id='',reservation_id='r-rzj24vpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-774227889',owner_user_name='tempest-AttachVolumeShelveTestJSON-774227889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:05:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41e697cd5e5f422f8ac90f7496f60936',uuid=149b34df-3d3c-48fc-99f2-0c3dc4334b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converting VIF {"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:58,bridge_name='br-int',has_traffic_filtering=True,id=866b90b8-9ca8-4235-9f79-45d13fc5f929,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b90b8-9c') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'pci_devices' on Instance uuid 149b34df-3d3c-48fc-99f2-0c3dc4334b1b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:06:00 user nova-compute[73469]:   <uuid>149b34df-3d3c-48fc-99f2-0c3dc4334b1b</uuid>
Aug 22 03:06:00 user nova-compute[73469]:   <name>instance-0000001d</name>
Aug 22 03:06:00 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:06:00 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:06:00 user nova-compute[73469]:   <metadata>
Aug 22 03:06:00 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:06:00 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:06:00 user nova-compute[73469]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-497177608</nova:name>
Aug 22 03:06:00 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:05:59</nova:creationTime>
Aug 22 03:06:00 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:06:00 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:06:00 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:06:00 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:06:00 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:06:00 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:06:00 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:06:00 user nova-compute[73469]:       <nova:owner>
Aug 22 03:06:00 user nova-compute[73469]:         <nova:user uuid="41e697cd5e5f422f8ac90f7496f60936">tempest-AttachVolumeShelveTestJSON-774227889-project-member</nova:user>
Aug 22 03:06:00 user nova-compute[73469]:         <nova:project uuid="ca3e1f2f72c7497ca3ad923a4b9459dc">tempest-AttachVolumeShelveTestJSON-774227889</nova:project>
Aug 22 03:06:00 user nova-compute[73469]:       </nova:owner>
Aug 22 03:06:00 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:06:00 user nova-compute[73469]:       <nova:ports>
Aug 22 03:06:00 user nova-compute[73469]:         <nova:port uuid="866b90b8-9ca8-4235-9f79-45d13fc5f929">
Aug 22 03:06:00 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 22 03:06:00 user nova-compute[73469]:         </nova:port>
Aug 22 03:06:00 user nova-compute[73469]:       </nova:ports>
Aug 22 03:06:00 user nova-compute[73469]:     </nova:instance>
Aug 22 03:06:00 user nova-compute[73469]:   </metadata>
Aug 22 03:06:00 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:06:00 user nova-compute[73469]:     <system>
Aug 22 03:06:00 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:06:00 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:06:00 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:06:00 user nova-compute[73469]:       <entry name="serial">149b34df-3d3c-48fc-99f2-0c3dc4334b1b</entry>
Aug 22 03:06:00 user nova-compute[73469]:       <entry name="uuid">149b34df-3d3c-48fc-99f2-0c3dc4334b1b</entry>
Aug 22 03:06:00 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:06:00 user nova-compute[73469]:     </system>
Aug 22 03:06:00 user nova-compute[73469]:   </sysinfo>
Aug 22 03:06:00 user nova-compute[73469]:   <os>
Aug 22 03:06:00 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:06:00 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:06:00 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:06:00 user nova-compute[73469]:   </os>
Aug 22 03:06:00 user nova-compute[73469]:   <features>
Aug 22 03:06:00 user nova-compute[73469]:     <acpi/>
Aug 22 03:06:00 user nova-compute[73469]:     <apic/>
Aug 22 03:06:00 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:06:00 user nova-compute[73469]:   </features>
Aug 22 03:06:00 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:06:00 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:06:00 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:06:00 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:06:00 user nova-compute[73469]:   </clock>
Aug 22 03:06:00 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:06:00 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:06:00 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:06:00 user nova-compute[73469]:   </cpu>
Aug 22 03:06:00 user nova-compute[73469]:   <devices>
Aug 22 03:06:00 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:06:00 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:06:00 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk"/>
Aug 22 03:06:00 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:06:00 user nova-compute[73469]:     </disk>
Aug 22 03:06:00 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:06:00 user nova-compute[73469]:       <mac address="fa:16:3e:a4:7b:58"/>
Aug 22 03:06:00 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:06:00 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:06:00 user nova-compute[73469]:       <target dev="tap866b90b8-9c"/>
Aug 22 03:06:00 user nova-compute[73469]:     </interface>
Aug 22 03:06:00 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:06:00 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/console.log" append="off"/>
Aug 22 03:06:00 user nova-compute[73469]:     </serial>
Aug 22 03:06:00 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:06:00 user nova-compute[73469]:     <video>
Aug 22 03:06:00 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:06:00 user nova-compute[73469]:     </video>
Aug 22 03:06:00 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:06:00 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:06:00 user nova-compute[73469]:     </rng>
Aug 22 03:06:00 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:06:00 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:06:00 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:06:00 user nova-compute[73469]:     </memballoon>
Aug 22 03:06:00 user nova-compute[73469]:   </devices>
Aug 22 03:06:00 user nova-compute[73469]: </domain>
Aug 22 03:06:00 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-497177608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-497177608',id=29,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI0YlC0MdxkVUSO81PLfgms40a6G6QD6YfZDORCvcGREtqMCzN/af47ygJmaqeEDyH5JKafVWBVdlK5rvd3tumDct1g36YoiSCIhWA6MhiAMlbCo9hRSMDY7Uq4rNNh/w==',key_name='tempest-keypair-884872358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca3e1f2f72c7497ca3ad923a4b9459dc',ramdisk_id='',reservation_id='r-rzj24vpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-774227889',owner_user_name='tempest-AttachVolumeShelveTestJSON-774227889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:05:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41e697cd5e5f422f8ac90f7496f60936',uuid=149b34df-3d3c-48fc-99f2-0c3dc4334b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converting VIF {"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:58,bridge_name='br-int',has_traffic_filtering=True,id=866b90b8-9ca8-4235-9f79-45d13fc5f929,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b90b8-9c') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG os_vif [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:58,bridge_name='br-int',has_traffic_filtering=True,id=866b90b8-9ca8-4235-9f79-45d13fc5f929,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b90b8-9c') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap866b90b8-9c, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap866b90b8-9c, col_values=(('external_ids', {'iface-id': '866b90b8-9ca8-4235-9f79-45d13fc5f929', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:7b:58', 'vm-uuid': '149b34df-3d3c-48fc-99f2-0c3dc4334b1b'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:00 user nova-compute[73469]: INFO os_vif [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:58,bridge_name='br-int',has_traffic_filtering=True,id=866b90b8-9ca8-4235-9f79-45d13fc5f929,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b90b8-9c')
Aug 22 03:06:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] No VIF found with MAC fa:16:3e:a4:7b:58, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG nova.network.neutron [req-fbb4c2d4-9fcf-4aaa-a506-db4b0d10b7ac req-876bb9c5-e869-46e8-b29d-954e9c74e9df service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Updated VIF entry in instance network info cache for port 866b90b8-9ca8-4235-9f79-45d13fc5f929. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG nova.network.neutron [req-fbb4c2d4-9fcf-4aaa-a506-db4b0d10b7ac req-876bb9c5-e869-46e8-b29d-954e9c74e9df service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Updating instance_info_cache with network_info: [{"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:06:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fbb4c2d4-9fcf-4aaa-a506-db4b0d10b7ac req-876bb9c5-e869-46e8-b29d-954e9c74e9df service nova] Releasing lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:06:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:01 user nova-compute[73469]: DEBUG nova.compute.manager [req-432cc8df-08a9-4d3d-990c-c96e1eebf4d2 req-1f669d0d-e333-4d23-858d-6e73395e1890 service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received event network-vif-plugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-432cc8df-08a9-4d3d-990c-c96e1eebf4d2 req-1f669d0d-e333-4d23-858d-6e73395e1890 service nova] Acquiring lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-432cc8df-08a9-4d3d-990c-c96e1eebf4d2 req-1f669d0d-e333-4d23-858d-6e73395e1890 service nova] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-432cc8df-08a9-4d3d-990c-c96e1eebf4d2 req-1f669d0d-e333-4d23-858d-6e73395e1890 service nova] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:01 user nova-compute[73469]: DEBUG nova.compute.manager [req-432cc8df-08a9-4d3d-990c-c96e1eebf4d2 req-1f669d0d-e333-4d23-858d-6e73395e1890 service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] No waiting events found dispatching network-vif-plugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:06:01 user nova-compute[73469]: WARNING nova.compute.manager [req-432cc8df-08a9-4d3d-990c-c96e1eebf4d2 req-1f669d0d-e333-4d23-858d-6e73395e1890 service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received unexpected event network-vif-plugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 for instance with vm_state building and task_state spawning.
Aug 22 03:06:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:03 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673563.7523942, 149b34df-3d3c-48fc-99f2-0c3dc4334b1b => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:06:03 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] VM Resumed (Lifecycle Event)
Aug 22 03:06:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:06:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:06:03 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Instance spawned successfully.
Aug 22 03:06:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:06:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:06:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:06:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:06:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:06:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:06:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:06:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:06:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:06:03 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:06:03 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673563.7536113, 149b34df-3d3c-48fc-99f2-0c3dc4334b1b => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:06:03 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] VM Started (Lifecycle Event)
Aug 22 03:06:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:06:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:06:03 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:06:03 user nova-compute[73469]: INFO nova.compute.manager [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Took 5.90 seconds to spawn the instance on the hypervisor.
Aug 22 03:06:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:06:03 user nova-compute[73469]: DEBUG nova.compute.manager [req-37a8c3fc-eb45-41f9-8a15-2125ab57eb5a req-25eafcae-2ee2-4660-8b24-86fd7989bf5d service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received event network-vif-plugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-37a8c3fc-eb45-41f9-8a15-2125ab57eb5a req-25eafcae-2ee2-4660-8b24-86fd7989bf5d service nova] Acquiring lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-37a8c3fc-eb45-41f9-8a15-2125ab57eb5a req-25eafcae-2ee2-4660-8b24-86fd7989bf5d service nova] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-37a8c3fc-eb45-41f9-8a15-2125ab57eb5a req-25eafcae-2ee2-4660-8b24-86fd7989bf5d service nova] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:03 user nova-compute[73469]: DEBUG nova.compute.manager [req-37a8c3fc-eb45-41f9-8a15-2125ab57eb5a req-25eafcae-2ee2-4660-8b24-86fd7989bf5d service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] No waiting events found dispatching network-vif-plugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:06:03 user nova-compute[73469]: WARNING nova.compute.manager [req-37a8c3fc-eb45-41f9-8a15-2125ab57eb5a req-25eafcae-2ee2-4660-8b24-86fd7989bf5d service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received unexpected event network-vif-plugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 for instance with vm_state building and task_state spawning.
Aug 22 03:06:03 user nova-compute[73469]: INFO nova.compute.manager [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Took 6.76 seconds to build instance.
Aug 22 03:06:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ec844db1-3e2d-41f4-b488-84b19f848173 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.860s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:06:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:06:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:06:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:06:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:06:19 user nova-compute[73469]: INFO nova.compute.manager [None req-79263a48-5be2-49f0-8a7f-ebdb20597c5b tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Unrescuing
Aug 22 03:06:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79263a48-5be2-49f0-8a7f-ebdb20597c5b tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:06:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79263a48-5be2-49f0-8a7f-ebdb20597c5b tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquired lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:06:19 user nova-compute[73469]: DEBUG nova.network.neutron [None req-79263a48-5be2-49f0-8a7f-ebdb20597c5b tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:06:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:06:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:06:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:06:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:06:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:20 user nova-compute[73469]: DEBUG nova.network.neutron [None req-79263a48-5be2-49f0-8a7f-ebdb20597c5b tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Updating instance_info_cache with network_info: [{"id": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "address": "fa:16:3e:cf:fb:77", "network": {"id": "48051bc9-cc7d-4248-8077-3bd59a1cb474", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab77793ce9a4b85b90e3b7469daf58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3d6f3d-12", "ovs_interfaceid": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:06:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79263a48-5be2-49f0-8a7f-ebdb20597c5b tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Releasing lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:06:20 user nova-compute[73469]: DEBUG nova.objects.instance [None req-79263a48-5be2-49f0-8a7f-ebdb20597c5b tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lazy-loading 'flavor' on Instance uuid 20316a2a-2f1f-4008-ab14-551e627bf680 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:06:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:20 user nova-compute[73469]: DEBUG nova.compute.manager [req-25fe3ada-2514-4c72-b225-eab220f5c8d1 req-7d86a17e-3d9f-42d8-a30e-c718277629f6 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received event network-vif-unplugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-25fe3ada-2514-4c72-b225-eab220f5c8d1 req-7d86a17e-3d9f-42d8-a30e-c718277629f6 service nova] Acquiring lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-25fe3ada-2514-4c72-b225-eab220f5c8d1 req-7d86a17e-3d9f-42d8-a30e-c718277629f6 service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-25fe3ada-2514-4c72-b225-eab220f5c8d1 req-7d86a17e-3d9f-42d8-a30e-c718277629f6 service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:20 user nova-compute[73469]: DEBUG nova.compute.manager [req-25fe3ada-2514-4c72-b225-eab220f5c8d1 req-7d86a17e-3d9f-42d8-a30e-c718277629f6 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] No waiting events found dispatching network-vif-unplugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:06:20 user nova-compute[73469]: WARNING nova.compute.manager [req-25fe3ada-2514-4c72-b225-eab220f5c8d1 req-7d86a17e-3d9f-42d8-a30e-c718277629f6 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received unexpected event network-vif-unplugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 for instance with vm_state rescued and task_state unrescuing.
Aug 22 03:06:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-ad8e2a36-d3c5-46cd-b509-c7cd0606d5fe req-ab16d178-5f05-469a-9a15-ea3abe7efa12 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received event network-changed-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:21 user nova-compute[73469]: DEBUG nova.compute.manager [req-ad8e2a36-d3c5-46cd-b509-c7cd0606d5fe req-ab16d178-5f05-469a-9a15-ea3abe7efa12 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Refreshing instance network info cache due to event network-changed-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:06:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ad8e2a36-d3c5-46cd-b509-c7cd0606d5fe req-ab16d178-5f05-469a-9a15-ea3abe7efa12 service nova] Acquiring lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:06:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ad8e2a36-d3c5-46cd-b509-c7cd0606d5fe req-ab16d178-5f05-469a-9a15-ea3abe7efa12 service nova] Acquired lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:06:21 user nova-compute[73469]: DEBUG nova.network.neutron [req-ad8e2a36-d3c5-46cd-b509-c7cd0606d5fe req-ab16d178-5f05-469a-9a15-ea3abe7efa12 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Refreshing network info cache for port 8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:06:21 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Instance destroyed successfully.
Aug 22 03:06:21 user nova-compute[73469]: DEBUG nova.network.neutron [req-ad8e2a36-d3c5-46cd-b509-c7cd0606d5fe req-ab16d178-5f05-469a-9a15-ea3abe7efa12 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Updated VIF entry in instance network info cache for port 8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:06:21 user nova-compute[73469]: DEBUG nova.network.neutron [req-ad8e2a36-d3c5-46cd-b509-c7cd0606d5fe req-ab16d178-5f05-469a-9a15-ea3abe7efa12 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Updating instance_info_cache with network_info: [{"id": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "address": "fa:16:3e:cf:fb:77", "network": {"id": "48051bc9-cc7d-4248-8077-3bd59a1cb474", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab77793ce9a4b85b90e3b7469daf58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3d6f3d-12", "ovs_interfaceid": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:06:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ad8e2a36-d3c5-46cd-b509-c7cd0606d5fe req-ab16d178-5f05-469a-9a15-ea3abe7efa12 service nova] Releasing lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:06:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:22 user nova-compute[73469]: DEBUG nova.compute.manager [req-de62d480-d530-457e-861c-d6aa220ff454 req-27b9559f-96e0-4951-9286-5496c0d590e8 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received event network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-de62d480-d530-457e-861c-d6aa220ff454 req-27b9559f-96e0-4951-9286-5496c0d590e8 service nova] Acquiring lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-de62d480-d530-457e-861c-d6aa220ff454 req-27b9559f-96e0-4951-9286-5496c0d590e8 service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-de62d480-d530-457e-861c-d6aa220ff454 req-27b9559f-96e0-4951-9286-5496c0d590e8 service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:22 user nova-compute[73469]: DEBUG nova.compute.manager [req-de62d480-d530-457e-861c-d6aa220ff454 req-27b9559f-96e0-4951-9286-5496c0d590e8 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] No waiting events found dispatching network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:06:22 user nova-compute[73469]: WARNING nova.compute.manager [req-de62d480-d530-457e-861c-d6aa220ff454 req-27b9559f-96e0-4951-9286-5496c0d590e8 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received unexpected event network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 for instance with vm_state rescued and task_state unrescuing.
Aug 22 03:06:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-8b61797c-833f-4927-959d-17703c3ebd05 req-2a39bc6c-eab2-4065-81b7-fcf0f4a8c22a service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received event network-changed-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-8b61797c-833f-4927-959d-17703c3ebd05 req-2a39bc6c-eab2-4065-81b7-fcf0f4a8c22a service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Refreshing instance network info cache due to event network-changed-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:06:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8b61797c-833f-4927-959d-17703c3ebd05 req-2a39bc6c-eab2-4065-81b7-fcf0f4a8c22a service nova] Acquiring lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:06:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8b61797c-833f-4927-959d-17703c3ebd05 req-2a39bc6c-eab2-4065-81b7-fcf0f4a8c22a service nova] Acquired lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:06:23 user nova-compute[73469]: DEBUG nova.network.neutron [req-8b61797c-833f-4927-959d-17703c3ebd05 req-2a39bc6c-eab2-4065-81b7-fcf0f4a8c22a service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Refreshing network info cache for port 8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:06:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:23 user nova-compute[73469]: DEBUG nova.network.neutron [req-8b61797c-833f-4927-959d-17703c3ebd05 req-2a39bc6c-eab2-4065-81b7-fcf0f4a8c22a service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Updated VIF entry in instance network info cache for port 8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:06:23 user nova-compute[73469]: DEBUG nova.network.neutron [req-8b61797c-833f-4927-959d-17703c3ebd05 req-2a39bc6c-eab2-4065-81b7-fcf0f4a8c22a service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Updating instance_info_cache with network_info: [{"id": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "address": "fa:16:3e:cf:fb:77", "network": {"id": "48051bc9-cc7d-4248-8077-3bd59a1cb474", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab77793ce9a4b85b90e3b7469daf58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3d6f3d-12", "ovs_interfaceid": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:06:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8b61797c-833f-4927-959d-17703c3ebd05 req-2a39bc6c-eab2-4065-81b7-fcf0f4a8c22a service nova] Releasing lock "refresh_cache-20316a2a-2f1f-4008-ab14-551e627bf680" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:06:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Removed pending event for 20316a2a-2f1f-4008-ab14-551e627bf680 due to event {{(pid=73469) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 22 03:06:24 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673584.911336, 20316a2a-2f1f-4008-ab14-551e627bf680 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:06:24 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] VM Resumed (Lifecycle Event)
Aug 22 03:06:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-79263a48-5be2-49f0-8a7f-ebdb20597c5b tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:06:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:06:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:06:24 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 22 03:06:24 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673584.914827, 20316a2a-2f1f-4008-ab14-551e627bf680 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:06:24 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] VM Started (Lifecycle Event)
Aug 22 03:06:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:06:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:06:25 user nova-compute[73469]: DEBUG nova.compute.manager [req-5fd47f09-da5f-41d7-afb6-0a7f26e407ff req-865ceab2-339a-467a-a9d9-7f92afc7cf2c service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received event network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5fd47f09-da5f-41d7-afb6-0a7f26e407ff req-865ceab2-339a-467a-a9d9-7f92afc7cf2c service nova] Acquiring lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5fd47f09-da5f-41d7-afb6-0a7f26e407ff req-865ceab2-339a-467a-a9d9-7f92afc7cf2c service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5fd47f09-da5f-41d7-afb6-0a7f26e407ff req-865ceab2-339a-467a-a9d9-7f92afc7cf2c service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:25 user nova-compute[73469]: DEBUG nova.compute.manager [req-5fd47f09-da5f-41d7-afb6-0a7f26e407ff req-865ceab2-339a-467a-a9d9-7f92afc7cf2c service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] No waiting events found dispatching network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:06:25 user nova-compute[73469]: WARNING nova.compute.manager [req-5fd47f09-da5f-41d7-afb6-0a7f26e407ff req-865ceab2-339a-467a-a9d9-7f92afc7cf2c service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received unexpected event network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 for instance with vm_state active and task_state None.
Aug 22 03:06:25 user nova-compute[73469]: DEBUG nova.compute.manager [req-5fd47f09-da5f-41d7-afb6-0a7f26e407ff req-865ceab2-339a-467a-a9d9-7f92afc7cf2c service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received event network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5fd47f09-da5f-41d7-afb6-0a7f26e407ff req-865ceab2-339a-467a-a9d9-7f92afc7cf2c service nova] Acquiring lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5fd47f09-da5f-41d7-afb6-0a7f26e407ff req-865ceab2-339a-467a-a9d9-7f92afc7cf2c service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5fd47f09-da5f-41d7-afb6-0a7f26e407ff req-865ceab2-339a-467a-a9d9-7f92afc7cf2c service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:25 user nova-compute[73469]: DEBUG nova.compute.manager [req-5fd47f09-da5f-41d7-afb6-0a7f26e407ff req-865ceab2-339a-467a-a9d9-7f92afc7cf2c service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] No waiting events found dispatching network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:06:25 user nova-compute[73469]: WARNING nova.compute.manager [req-5fd47f09-da5f-41d7-afb6-0a7f26e407ff req-865ceab2-339a-467a-a9d9-7f92afc7cf2c service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received unexpected event network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 for instance with vm_state active and task_state None.
Aug 22 03:06:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:29 user nova-compute[73469]: INFO nova.compute.manager [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Terminating instance
Aug 22 03:06:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:06:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-88102656-fd48-4d9e-8879-ce4900d0625c req-4629c383-f709-45f5-91df-2677e0874c83 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-vif-unplugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-88102656-fd48-4d9e-8879-ce4900d0625c req-4629c383-f709-45f5-91df-2677e0874c83 service nova] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-88102656-fd48-4d9e-8879-ce4900d0625c req-4629c383-f709-45f5-91df-2677e0874c83 service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-88102656-fd48-4d9e-8879-ce4900d0625c req-4629c383-f709-45f5-91df-2677e0874c83 service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-88102656-fd48-4d9e-8879-ce4900d0625c req-4629c383-f709-45f5-91df-2677e0874c83 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] No waiting events found dispatching network-vif-unplugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-88102656-fd48-4d9e-8879-ce4900d0625c req-4629c383-f709-45f5-91df-2677e0874c83 service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-vif-unplugged-f38d1396-0fe4-4107-8815-7420deceedab for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:30 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Instance destroyed successfully.
Aug 22 03:06:30 user nova-compute[73469]: DEBUG nova.objects.instance [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lazy-loading 'resources' on Instance uuid 5984759d-28f1-45e8-bb4c-27bd8df426f4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1537383573',display_name='tempest-ServerActionsTestOtherB-server-1537383573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1537383573',id=18,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbR7/rnM2AeZHN+BHEO9wy6tT5C/8gqpz2OLyZ0PrOkSO9sSAq61LBq8B59x8O0SJWkSJu3MS+tJxcGT/zQuOBrkxHQmB8JC+FatiKrmiFApJOgsuSU1qC5st2CAxnTvw==',key_name='tempest-keypair-568897893',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:04:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9d41329e1ad49bc94369a54d2798ac6',ramdisk_id='',reservation_id='r-6rax0pzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1653559752',owner_user_name='tempest-ServerActionsTestOtherB-1653559752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:04:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d3f2f35df22412cac98e90f1bb80b08',uuid=5984759d-28f1-45e8-bb4c-27bd8df426f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Converting VIF {"id": "f38d1396-0fe4-4107-8815-7420deceedab", "address": "fa:16:3e:f8:e1:3e", "network": {"id": "30ae07ea-efe4-4cce-a628-ff347f68fe5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-579513350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d41329e1ad49bc94369a54d2798ac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38d1396-0f", "ovs_interfaceid": "f38d1396-0fe4-4107-8815-7420deceedab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG os_vif [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf38d1396-0f, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:06:30 user nova-compute[73469]: INFO os_vif [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e1:3e,bridge_name='br-int',has_traffic_filtering=True,id=f38d1396-0fe4-4107-8815-7420deceedab,network=Network(30ae07ea-efe4-4cce-a628-ff347f68fe5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38d1396-0f')
Aug 22 03:06:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvGlDOhP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:06:30 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:06:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3291e32f-c4f0-4964-8d13-55a191d17f74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2027b4-3543-4edd-8b13-f61120bcdc1b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:06:30 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:06:30 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:06:30 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:06:30 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:06:30 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:06:30 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:06:30 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:06:30 user nova-compute[73469]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc (non-flash)
Aug 22 03:06:30 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:06:30 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:06:30 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:06:30 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a45ec0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc'): ({'sdd'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Removing single pathed devices sdd {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b19e8f-37c6-49a1-8892-f2cbc3364a29]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[757fd96c-248a-41d9-83a6-773fe0acc3b2]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Flushing IO for device /dev/sdd {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7986e8-043a-4c28-9a8f-4fa396c7243c]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c6dc36-2c0c-47be-bf79-c4b57366ca69]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f408769-a608-4ca0-9a03-a46961fad11c]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52eea7f-3a03-4ca1-8ea0-6801a351b8ab]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260]
Aug 22 03:06:30 user nova-compute[73469]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc, portal: 172.16.0.220,3260] successful.
Aug 22 03:06:30 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9a6baf-31df-4c2e-a390-daa9a68e83fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f35d27b-6ae1-45bd-8ac8-463588df86df]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] <== disconnect_volume: return (334ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:06:30 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Deleting instance files /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4_del
Aug 22 03:06:30 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Deletion of /opt/stack/data/nova/instances/5984759d-28f1-45e8-bb4c-27bd8df426f4_del complete
Aug 22 03:06:30 user nova-compute[73469]: INFO nova.compute.manager [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Acquiring lock "84706228-0050-49ac-886a-70842ce8dd3b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "84706228-0050-49ac-886a-70842ce8dd3b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Acquiring lock "84706228-0050-49ac-886a-70842ce8dd3b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "84706228-0050-49ac-886a-70842ce8dd3b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "84706228-0050-49ac-886a-70842ce8dd3b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:30 user nova-compute[73469]: INFO nova.compute.manager [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Terminating instance
Aug 22 03:06:30 user nova-compute[73469]: DEBUG nova.compute.manager [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:06:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Instance destroyed successfully.
Aug 22 03:06:31 user nova-compute[73469]: DEBUG nova.objects.instance [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lazy-loading 'resources' on Instance uuid 84706228-0050-49ac-886a-70842ce8dd3b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:06:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2112280286',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2112280286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2112280',id=27,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZOSUOHjEWx5VIL7Hm2trZIdpAJEAmt7u83C+t35dlBV1TWa2pg7AG7YhazzQoZc9wN9MzXwb0vhQNLk/GAsxAd/efSI9Xh0WUzoOFSkc+86a1VXpj5tSSnKOHwIJYUbg==',key_name='tempest-keypair-1577026713',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:03:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efc0a68689c648639c37755526bee4fd',ramdisk_id='',reservation_id='r-19e2c9ua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-521618217',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:03:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11a02c5d43844c22b85222961c574da0',uuid=84706228-0050-49ac-886a-70842ce8dd3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa11f705-d214-422e-8d55-988560948a37", "address": "fa:16:3e:69:bb:e0", "network": {"id": "a19cffdb-7658-4fa9-bbfd-2bd8c7d18e33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-386471556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc0a68689c648639c37755526bee4fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa11f705-d2", "ovs_interfaceid": "aa11f705-d214-422e-8d55-988560948a37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:06:31 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Converting VIF {"id": "aa11f705-d214-422e-8d55-988560948a37", "address": "fa:16:3e:69:bb:e0", "network": {"id": "a19cffdb-7658-4fa9-bbfd-2bd8c7d18e33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-386471556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc0a68689c648639c37755526bee4fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa11f705-d2", "ovs_interfaceid": "aa11f705-d214-422e-8d55-988560948a37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:06:31 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:bb:e0,bridge_name='br-int',has_traffic_filtering=True,id=aa11f705-d214-422e-8d55-988560948a37,network=Network(a19cffdb-7658-4fa9-bbfd-2bd8c7d18e33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa11f705-d2') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:06:31 user nova-compute[73469]: DEBUG os_vif [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:bb:e0,bridge_name='br-int',has_traffic_filtering=True,id=aa11f705-d214-422e-8d55-988560948a37,network=Network(a19cffdb-7658-4fa9-bbfd-2bd8c7d18e33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa11f705-d2') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:06:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa11f705-d2, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:06:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:06:31 user nova-compute[73469]: INFO os_vif [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:bb:e0,bridge_name='br-int',has_traffic_filtering=True,id=aa11f705-d214-422e-8d55-988560948a37,network=Network(a19cffdb-7658-4fa9-bbfd-2bd8c7d18e33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa11f705-d2')
Aug 22 03:06:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Deleting instance files /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b_del
Aug 22 03:06:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Deletion of /opt/stack/data/nova/instances/84706228-0050-49ac-886a-70842ce8dd3b_del complete
Aug 22 03:06:31 user nova-compute[73469]: INFO nova.compute.manager [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 22 03:06:31 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:06:31 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:06:31 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:06:32 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:06:32 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Took 1.18 seconds to deallocate network for instance.
Aug 22 03:06:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-c26f2777-86e3-40da-84e7-dbc715c98eba req-f9a41154-5159-4aa0-a951-84302061845c service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-vif-deleted-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-c85eb7f0-4877-4770-9959-bb451014b830 req-a43a2648-94f3-4c3c-a07e-37a4e9c5882c service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c85eb7f0-4877-4770-9959-bb451014b830 req-a43a2648-94f3-4c3c-a07e-37a4e9c5882c service nova] Acquiring lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c85eb7f0-4877-4770-9959-bb451014b830 req-a43a2648-94f3-4c3c-a07e-37a4e9c5882c service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c85eb7f0-4877-4770-9959-bb451014b830 req-a43a2648-94f3-4c3c-a07e-37a4e9c5882c service nova] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-c85eb7f0-4877-4770-9959-bb451014b830 req-a43a2648-94f3-4c3c-a07e-37a4e9c5882c service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] No waiting events found dispatching network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:06:32 user nova-compute[73469]: WARNING nova.compute.manager [req-c85eb7f0-4877-4770-9959-bb451014b830 req-a43a2648-94f3-4c3c-a07e-37a4e9c5882c service nova] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Received unexpected event network-vif-plugged-f38d1396-0fe4-4107-8815-7420deceedab for instance with vm_state active and task_state deleting.
Aug 22 03:06:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-c85eb7f0-4877-4770-9959-bb451014b830 req-a43a2648-94f3-4c3c-a07e-37a4e9c5882c service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Received event network-vif-unplugged-aa11f705-d214-422e-8d55-988560948a37 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c85eb7f0-4877-4770-9959-bb451014b830 req-a43a2648-94f3-4c3c-a07e-37a4e9c5882c service nova] Acquiring lock "84706228-0050-49ac-886a-70842ce8dd3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c85eb7f0-4877-4770-9959-bb451014b830 req-a43a2648-94f3-4c3c-a07e-37a4e9c5882c service nova] Lock "84706228-0050-49ac-886a-70842ce8dd3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c85eb7f0-4877-4770-9959-bb451014b830 req-a43a2648-94f3-4c3c-a07e-37a4e9c5882c service nova] Lock "84706228-0050-49ac-886a-70842ce8dd3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-c85eb7f0-4877-4770-9959-bb451014b830 req-a43a2648-94f3-4c3c-a07e-37a4e9c5882c service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] No waiting events found dispatching network-vif-unplugged-aa11f705-d214-422e-8d55-988560948a37 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:06:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-c85eb7f0-4877-4770-9959-bb451014b830 req-a43a2648-94f3-4c3c-a07e-37a4e9c5882c service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Received event network-vif-unplugged-aa11f705-d214-422e-8d55-988560948a37 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:06:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-c85eb7f0-4877-4770-9959-bb451014b830 req-a43a2648-94f3-4c3c-a07e-37a4e9c5882c service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Received event network-vif-plugged-aa11f705-d214-422e-8d55-988560948a37 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c85eb7f0-4877-4770-9959-bb451014b830 req-a43a2648-94f3-4c3c-a07e-37a4e9c5882c service nova] Acquiring lock "84706228-0050-49ac-886a-70842ce8dd3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c85eb7f0-4877-4770-9959-bb451014b830 req-a43a2648-94f3-4c3c-a07e-37a4e9c5882c service nova] Lock "84706228-0050-49ac-886a-70842ce8dd3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c85eb7f0-4877-4770-9959-bb451014b830 req-a43a2648-94f3-4c3c-a07e-37a4e9c5882c service nova] Lock "84706228-0050-49ac-886a-70842ce8dd3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-c85eb7f0-4877-4770-9959-bb451014b830 req-a43a2648-94f3-4c3c-a07e-37a4e9c5882c service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] No waiting events found dispatching network-vif-plugged-aa11f705-d214-422e-8d55-988560948a37 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:06:32 user nova-compute[73469]: WARNING nova.compute.manager [req-c85eb7f0-4877-4770-9959-bb451014b830 req-a43a2648-94f3-4c3c-a07e-37a4e9c5882c service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Received unexpected event network-vif-plugged-aa11f705-d214-422e-8d55-988560948a37 for instance with vm_state active and task_state deleting.
Aug 22 03:06:32 user nova-compute[73469]: INFO nova.compute.manager [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Took 0.96 seconds to detach 1 volumes for instance.
Aug 22 03:06:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:33 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:06:33 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:06:33 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:06:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:33 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Took 1.65 seconds to deallocate network for instance.
Aug 22 03:06:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-3ef89aec-2d63-41a2-9c89-dd8200aea7df req-53cdd151-dfcc-410c-976d-fa970cc66e08 service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Received event network-vif-deleted-aa11f705-d214-422e-8d55-988560948a37 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:33 user nova-compute[73469]: INFO nova.compute.manager [req-3ef89aec-2d63-41a2-9c89-dd8200aea7df req-53cdd151-dfcc-410c-976d-fa970cc66e08 service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Neutron deleted interface aa11f705-d214-422e-8d55-988560948a37; detaching it from the instance and deleting it from the info cache
Aug 22 03:06:33 user nova-compute[73469]: DEBUG nova.network.neutron [req-3ef89aec-2d63-41a2-9c89-dd8200aea7df req-53cdd151-dfcc-410c-976d-fa970cc66e08 service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:06:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-3ef89aec-2d63-41a2-9c89-dd8200aea7df req-53cdd151-dfcc-410c-976d-fa970cc66e08 service nova] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Detach interface failed, port_id=aa11f705-d214-422e-8d55-988560948a37, reason: Instance 84706228-0050-49ac-886a-70842ce8dd3b could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 03:06:33 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Deleted allocations for instance 5984759d-28f1-45e8-bb4c-27bd8df426f4
Aug 22 03:06:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-3e3fa518-83f1-40cd-a6dc-609a3e014f17 tempest-ServerActionsTestOtherB-1653559752 tempest-ServerActionsTestOtherB-1653559752-project-member] Lock "5984759d-28f1-45e8-bb4c-27bd8df426f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.161s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:34 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:06:34 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:06:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:34 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Deleted allocations for instance 84706228-0050-49ac-886a-70842ce8dd3b
Aug 22 03:06:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-727eb609-f058-4c99-b461-6ce1ae1badc6 tempest-TestServerVolumeAttachScenarioOldVersion-521618217 tempest-TestServerVolumeAttachScenarioOldVersion-521618217-project-member] Lock "84706228-0050-49ac-886a-70842ce8dd3b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.263s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:36 user nova-compute[73469]: INFO nova.compute.manager [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Terminating instance
Aug 22 03:06:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:06:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-23658604-69b1-4314-b464-bec6148225c0 req-0329896c-aed8-49eb-a4a3-9e82c39b316a service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received event network-vif-unplugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-23658604-69b1-4314-b464-bec6148225c0 req-0329896c-aed8-49eb-a4a3-9e82c39b316a service nova] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-23658604-69b1-4314-b464-bec6148225c0 req-0329896c-aed8-49eb-a4a3-9e82c39b316a service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-23658604-69b1-4314-b464-bec6148225c0 req-0329896c-aed8-49eb-a4a3-9e82c39b316a service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-23658604-69b1-4314-b464-bec6148225c0 req-0329896c-aed8-49eb-a4a3-9e82c39b316a service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] No waiting events found dispatching network-vif-unplugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:06:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-23658604-69b1-4314-b464-bec6148225c0 req-0329896c-aed8-49eb-a4a3-9e82c39b316a service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received event network-vif-unplugged-1b3de561-7dd1-4d48-8932-05c4e4770538 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:06:37 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Instance destroyed successfully.
Aug 22 03:06:37 user nova-compute[73469]: DEBUG nova.objects.instance [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'resources' on Instance uuid 2e621408-a0af-460b-80a2-3446b5f1aadb {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:06:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1789351683',display_name='tempest-AttachVolumeTestJSON-server-1789351683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1789351683',id=17,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg3FO8Q1Fyh7Eb17I96O7txjPwDiFqMIfNq8/4/TcYPo08QnJwR73w8ZzPDWLE/eydf8rsuj4/QsACeGK9yAdP5tx7NSUxI3GV9dfyUcRbWNJiAjAgSe8h9Vrksa3qrNg==',key_name='tempest-keypair-647650365',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:57:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e49e405f5aca432097b7ba854fd3055b',ramdisk_id='',reservation_id='r-xv1z21bt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-356928747',owner_user_name='tempest-AttachVolumeTestJSON-356928747-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:04:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e62d25dff554a629a7e0af1406d97a9',uuid=2e621408-a0af-460b-80a2-3446b5f1aadb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:06:37 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converting VIF {"id": "1b3de561-7dd1-4d48-8932-05c4e4770538", "address": "fa:16:3e:d7:a2:07", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3de561-7d", "ovs_interfaceid": "1b3de561-7dd1-4d48-8932-05c4e4770538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:06:37 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:06:37 user nova-compute[73469]: DEBUG os_vif [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:06:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b3de561-7d, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:06:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:06:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:37 user nova-compute[73469]: INFO os_vif [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a2:07,bridge_name='br-int',has_traffic_filtering=True,id=1b3de561-7dd1-4d48-8932-05c4e4770538,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3de561-7d')
Aug 22 03:06:37 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Deleting instance files /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb_del
Aug 22 03:06:37 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Deletion of /opt/stack/data/nova/instances/2e621408-a0af-460b-80a2-3446b5f1aadb_del complete
Aug 22 03:06:37 user nova-compute[73469]: INFO nova.compute.manager [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 22 03:06:37 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:06:37 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:06:37 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "0d5a30d1-565c-47c9-8caa-84dab130e117" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:38 user nova-compute[73469]: INFO nova.compute.manager [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Terminating instance
Aug 22 03:06:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:38 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Instance destroyed successfully.
Aug 22 03:06:38 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lazy-loading 'resources' on Instance uuid 0d5a30d1-565c-47c9-8caa-84dab130e117 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:01:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1024498594',display_name='tempest-TestMinimumBasicScenario-server-1024498594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1024498594',id=24,image_ref='908238d7-6d39-4946-b525-79eca001fd9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLeMAhkMiCTlVeNiSKGnMeiGZF7DtDCtveCGKGThb1ILWF+T8zrVS40XXpop4STHl0EaAhKP1lNnjfoN/gqw55hS2X3kwo7ONAtFJOj8siGZDOH71ltEqKnqYUy4TFFcg==',key_name='tempest-TestMinimumBasicScenario-1567802170',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:01:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ec928b9a04840b18974870663be0d44',ramdisk_id='',reservation_id='r-671bs364',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='908238d7-6d39-4946-b525-79eca001fd9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-619227623',owner_user_name='tempest-TestMinimumBasicScenario-619227623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:03:48Z,user_data=None,user_id='f03cf449ec504132b4ea50a033bdf2c0',uuid=0d5a30d1-565c-47c9-8caa-84dab130e117,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "address": "fa:16:3e:1e:69:04", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap147479ad-a9", "ovs_interfaceid": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Converting VIF {"id": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "address": "fa:16:3e:1e:69:04", "network": {"id": "65958e69-1523-4c27-a051-ae2e408c33b9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1337689223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec928b9a04840b18974870663be0d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap147479ad-a9", "ovs_interfaceid": "147479ad-a9fc-4ccf-a900-95e347d1a79e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:69:04,bridge_name='br-int',has_traffic_filtering=True,id=147479ad-a9fc-4ccf-a900-95e347d1a79e,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap147479ad-a9') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG os_vif [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:69:04,bridge_name='br-int',has_traffic_filtering=True,id=147479ad-a9fc-4ccf-a900-95e347d1a79e,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap147479ad-a9') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap147479ad-a9, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:38 user nova-compute[73469]: INFO os_vif [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:69:04,bridge_name='br-int',has_traffic_filtering=True,id=147479ad-a9fc-4ccf-a900-95e347d1a79e,network=Network(65958e69-1523-4c27-a051-ae2e408c33b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap147479ad-a9')
Aug 22 03:06:38 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Deleting instance files /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117_del
Aug 22 03:06:38 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Deletion of /opt/stack/data/nova/instances/0d5a30d1-565c-47c9-8caa-84dab130e117_del complete
Aug 22 03:06:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-5003ae13-d683-4cbd-a6a1-add8b80fa4bd req-9b66858a-7110-4f3b-9474-dbec57520554 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received event network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5003ae13-d683-4cbd-a6a1-add8b80fa4bd req-9b66858a-7110-4f3b-9474-dbec57520554 service nova] Acquiring lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5003ae13-d683-4cbd-a6a1-add8b80fa4bd req-9b66858a-7110-4f3b-9474-dbec57520554 service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5003ae13-d683-4cbd-a6a1-add8b80fa4bd req-9b66858a-7110-4f3b-9474-dbec57520554 service nova] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-5003ae13-d683-4cbd-a6a1-add8b80fa4bd req-9b66858a-7110-4f3b-9474-dbec57520554 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] No waiting events found dispatching network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:06:38 user nova-compute[73469]: WARNING nova.compute.manager [req-5003ae13-d683-4cbd-a6a1-add8b80fa4bd req-9b66858a-7110-4f3b-9474-dbec57520554 service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received unexpected event network-vif-plugged-1b3de561-7dd1-4d48-8932-05c4e4770538 for instance with vm_state active and task_state deleting.
Aug 22 03:06:39 user nova-compute[73469]: INFO nova.compute.manager [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 22 03:06:39 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:06:39 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:06:39 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:06:39 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:06:39 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Took 1.87 seconds to deallocate network for instance.
Aug 22 03:06:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:39 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:06:39 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:06:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:39 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:06:39 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Took 0.62 seconds to deallocate network for instance.
Aug 22 03:06:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-016aa4b4-3180-422a-9a5e-4dbedbb63f48 req-7a026297-ae48-419b-983b-430151a559d7 service nova] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Received event network-vif-deleted-147479ad-a9fc-4ccf-a900-95e347d1a79e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:39 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Deleted allocations for instance 2e621408-a0af-460b-80a2-3446b5f1aadb
Aug 22 03:06:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-8ecab56d-f09a-42c6-8105-5da43c2287de tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "2e621408-a0af-460b-80a2-3446b5f1aadb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.396s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:40 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:06:40 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:06:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:40 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Deleted allocations for instance 0d5a30d1-565c-47c9-8caa-84dab130e117
Aug 22 03:06:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ad392fb8-9f47-43c4-888a-d8f857d9b400 tempest-TestMinimumBasicScenario-619227623 tempest-TestMinimumBasicScenario-619227623-project-member] Lock "0d5a30d1-565c-47c9-8caa-84dab130e117" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.128s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-9e0e3deb-5db0-448b-a747-803f38f8d7df req-22200f40-f10a-4e72-a7b1-97a96911233f service nova] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Received event network-vif-deleted-1b3de561-7dd1-4d48-8932-05c4e4770538 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquiring lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:06:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:42 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:06:42 user nova-compute[73469]: INFO nova.compute.claims [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Claim successful on node user
Aug 22 03:06:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG nova.compute.manager [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG nova.compute.manager [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG nova.network.neutron [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:06:43 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:06:43 user nova-compute[73469]: DEBUG nova.compute.manager [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG nova.policy [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '635f762a1488400fa57a6a9e244ddb42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec2ad0547114410a036090a792d0645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG nova.compute.manager [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:06:43 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Creating image(s)
Aug 22 03:06:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "/opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "/opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.180s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.175s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk 1073741824" returned: 0 in 0.055s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:44 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:06:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:44 user nova-compute[73469]: DEBUG nova.network.neutron [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Successfully created port: 026b74ec-ba11-459e-aa62-77923404317c {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:06:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:44 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Cannot resize image /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:06:44 user nova-compute[73469]: DEBUG nova.objects.instance [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lazy-loading 'migration_context' on Instance uuid a7e95a46-9a75-4b0c-a5c9-42ed521668a5 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:06:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:06:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Ensure instance console log exists: /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:06:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:44 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.network.neutron [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Successfully updated port: 026b74ec-ba11-459e-aa62-77923404317c {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquiring lock "refresh_cache-a7e95a46-9a75-4b0c-a5c9-42ed521668a5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquired lock "refresh_cache-a7e95a46-9a75-4b0c-a5c9-42ed521668a5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.network.neutron [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-2a62b505-9efa-4fbb-9eaa-bf332dd4ebf2 req-bb3bfe02-b251-47c2-9a1c-aca08dad73c1 service nova] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Received event network-changed-026b74ec-ba11-459e-aa62-77923404317c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-2a62b505-9efa-4fbb-9eaa-bf332dd4ebf2 req-bb3bfe02-b251-47c2-9a1c-aca08dad73c1 service nova] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Refreshing instance network info cache due to event network-changed-026b74ec-ba11-459e-aa62-77923404317c. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2a62b505-9efa-4fbb-9eaa-bf332dd4ebf2 req-bb3bfe02-b251-47c2-9a1c-aca08dad73c1 service nova] Acquiring lock "refresh_cache-a7e95a46-9a75-4b0c-a5c9-42ed521668a5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.network.neutron [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673590.3409317, 5984759d-28f1-45e8-bb4c-27bd8df426f4 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:06:45 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] VM Stopped (Lifecycle Event)
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.compute.manager [None req-a25212b9-0d76-4d10-be5b-6d72198bb411 None None] [instance: 5984759d-28f1-45e8-bb4c-27bd8df426f4] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.network.neutron [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Updating instance_info_cache with network_info: [{"id": "026b74ec-ba11-459e-aa62-77923404317c", "address": "fa:16:3e:eb:a5:97", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026b74ec-ba", "ovs_interfaceid": "026b74ec-ba11-459e-aa62-77923404317c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Releasing lock "refresh_cache-a7e95a46-9a75-4b0c-a5c9-42ed521668a5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.compute.manager [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Instance network_info: |[{"id": "026b74ec-ba11-459e-aa62-77923404317c", "address": "fa:16:3e:eb:a5:97", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026b74ec-ba", "ovs_interfaceid": "026b74ec-ba11-459e-aa62-77923404317c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2a62b505-9efa-4fbb-9eaa-bf332dd4ebf2 req-bb3bfe02-b251-47c2-9a1c-aca08dad73c1 service nova] Acquired lock "refresh_cache-a7e95a46-9a75-4b0c-a5c9-42ed521668a5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.network.neutron [req-2a62b505-9efa-4fbb-9eaa-bf332dd4ebf2 req-bb3bfe02-b251-47c2-9a1c-aca08dad73c1 service nova] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Refreshing network info cache for port 026b74ec-ba11-459e-aa62-77923404317c {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Start _get_guest_xml network_info=[{"id": "026b74ec-ba11-459e-aa62-77923404317c", "address": "fa:16:3e:eb:a5:97", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026b74ec-ba", "ovs_interfaceid": "026b74ec-ba11-459e-aa62-77923404317c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:06:45 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:06:45 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1710254852',display_name='tempest-ServersNegativeTestJSON-server-1710254852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1710254852',id=30,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cec2ad0547114410a036090a792d0645',ramdisk_id='',reservation_id='r-feuvqv38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1709480953',owner_user_name='tempest-ServersNegativeTestJSON-1709480953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:06:43Z,user_data=None,user_id='635f762a1488400fa57a6a9e244ddb42',uuid=a7e95a46-9a75-4b0c-a5c9-42ed521668a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "026b74ec-ba11-459e-aa62-77923404317c", "address": "fa:16:3e:eb:a5:97", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026b74ec-ba", "ovs_interfaceid": "026b74ec-ba11-459e-aa62-77923404317c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Converting VIF {"id": "026b74ec-ba11-459e-aa62-77923404317c", "address": "fa:16:3e:eb:a5:97", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026b74ec-ba", "ovs_interfaceid": "026b74ec-ba11-459e-aa62-77923404317c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a5:97,bridge_name='br-int',has_traffic_filtering=True,id=026b74ec-ba11-459e-aa62-77923404317c,network=Network(b1119133-216d-41a0-b227-d1e9e4aed153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026b74ec-ba') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.objects.instance [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lazy-loading 'pci_devices' on Instance uuid a7e95a46-9a75-4b0c-a5c9-42ed521668a5 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:06:45 user nova-compute[73469]:   <uuid>a7e95a46-9a75-4b0c-a5c9-42ed521668a5</uuid>
Aug 22 03:06:45 user nova-compute[73469]:   <name>instance-0000001e</name>
Aug 22 03:06:45 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:06:45 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:06:45 user nova-compute[73469]:   <metadata>
Aug 22 03:06:45 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:06:45 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:06:45 user nova-compute[73469]:       <nova:name>tempest-ServersNegativeTestJSON-server-1710254852</nova:name>
Aug 22 03:06:45 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:06:45</nova:creationTime>
Aug 22 03:06:45 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:06:45 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:06:45 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:06:45 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:06:45 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:06:45 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:06:45 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:06:45 user nova-compute[73469]:       <nova:owner>
Aug 22 03:06:45 user nova-compute[73469]:         <nova:user uuid="635f762a1488400fa57a6a9e244ddb42">tempest-ServersNegativeTestJSON-1709480953-project-member</nova:user>
Aug 22 03:06:45 user nova-compute[73469]:         <nova:project uuid="cec2ad0547114410a036090a792d0645">tempest-ServersNegativeTestJSON-1709480953</nova:project>
Aug 22 03:06:45 user nova-compute[73469]:       </nova:owner>
Aug 22 03:06:45 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:06:45 user nova-compute[73469]:       <nova:ports>
Aug 22 03:06:45 user nova-compute[73469]:         <nova:port uuid="026b74ec-ba11-459e-aa62-77923404317c">
Aug 22 03:06:45 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 22 03:06:45 user nova-compute[73469]:         </nova:port>
Aug 22 03:06:45 user nova-compute[73469]:       </nova:ports>
Aug 22 03:06:45 user nova-compute[73469]:     </nova:instance>
Aug 22 03:06:45 user nova-compute[73469]:   </metadata>
Aug 22 03:06:45 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:06:45 user nova-compute[73469]:     <system>
Aug 22 03:06:45 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:06:45 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:06:45 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:06:45 user nova-compute[73469]:       <entry name="serial">a7e95a46-9a75-4b0c-a5c9-42ed521668a5</entry>
Aug 22 03:06:45 user nova-compute[73469]:       <entry name="uuid">a7e95a46-9a75-4b0c-a5c9-42ed521668a5</entry>
Aug 22 03:06:45 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:06:45 user nova-compute[73469]:     </system>
Aug 22 03:06:45 user nova-compute[73469]:   </sysinfo>
Aug 22 03:06:45 user nova-compute[73469]:   <os>
Aug 22 03:06:45 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:06:45 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:06:45 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:06:45 user nova-compute[73469]:   </os>
Aug 22 03:06:45 user nova-compute[73469]:   <features>
Aug 22 03:06:45 user nova-compute[73469]:     <acpi/>
Aug 22 03:06:45 user nova-compute[73469]:     <apic/>
Aug 22 03:06:45 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:06:45 user nova-compute[73469]:   </features>
Aug 22 03:06:45 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:06:45 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:06:45 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:06:45 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:06:45 user nova-compute[73469]:   </clock>
Aug 22 03:06:45 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:06:45 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:06:45 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:06:45 user nova-compute[73469]:   </cpu>
Aug 22 03:06:45 user nova-compute[73469]:   <devices>
Aug 22 03:06:45 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:06:45 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:06:45 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk"/>
Aug 22 03:06:45 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:06:45 user nova-compute[73469]:     </disk>
Aug 22 03:06:45 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:06:45 user nova-compute[73469]:       <mac address="fa:16:3e:eb:a5:97"/>
Aug 22 03:06:45 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:06:45 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:06:45 user nova-compute[73469]:       <target dev="tap026b74ec-ba"/>
Aug 22 03:06:45 user nova-compute[73469]:     </interface>
Aug 22 03:06:45 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:06:45 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/console.log" append="off"/>
Aug 22 03:06:45 user nova-compute[73469]:     </serial>
Aug 22 03:06:45 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:06:45 user nova-compute[73469]:     <video>
Aug 22 03:06:45 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:06:45 user nova-compute[73469]:     </video>
Aug 22 03:06:45 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:06:45 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:06:45 user nova-compute[73469]:     </rng>
Aug 22 03:06:45 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:06:45 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:06:45 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:06:45 user nova-compute[73469]:     </memballoon>
Aug 22 03:06:45 user nova-compute[73469]:   </devices>
Aug 22 03:06:45 user nova-compute[73469]: </domain>
Aug 22 03:06:45 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1710254852',display_name='tempest-ServersNegativeTestJSON-server-1710254852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1710254852',id=30,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cec2ad0547114410a036090a792d0645',ramdisk_id='',reservation_id='r-feuvqv38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1709480953',owner_user_name='tempest-ServersNegativeTestJSON-1709480953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:06:43Z,user_data=None,user_id='635f762a1488400fa57a6a9e244ddb42',uuid=a7e95a46-9a75-4b0c-a5c9-42ed521668a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "026b74ec-ba11-459e-aa62-77923404317c", "address": "fa:16:3e:eb:a5:97", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026b74ec-ba", "ovs_interfaceid": "026b74ec-ba11-459e-aa62-77923404317c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Converting VIF {"id": "026b74ec-ba11-459e-aa62-77923404317c", "address": "fa:16:3e:eb:a5:97", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026b74ec-ba", "ovs_interfaceid": "026b74ec-ba11-459e-aa62-77923404317c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a5:97,bridge_name='br-int',has_traffic_filtering=True,id=026b74ec-ba11-459e-aa62-77923404317c,network=Network(b1119133-216d-41a0-b227-d1e9e4aed153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026b74ec-ba') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG os_vif [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a5:97,bridge_name='br-int',has_traffic_filtering=True,id=026b74ec-ba11-459e-aa62-77923404317c,network=Network(b1119133-216d-41a0-b227-d1e9e4aed153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026b74ec-ba') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap026b74ec-ba, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap026b74ec-ba, col_values=(('external_ids', {'iface-id': '026b74ec-ba11-459e-aa62-77923404317c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:a5:97', 'vm-uuid': 'a7e95a46-9a75-4b0c-a5c9-42ed521668a5'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:45 user nova-compute[73469]: INFO os_vif [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a5:97,bridge_name='br-int',has_traffic_filtering=True,id=026b74ec-ba11-459e-aa62-77923404317c,network=Network(b1119133-216d-41a0-b227-d1e9e4aed153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026b74ec-ba')
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] No VIF found with MAC fa:16:3e:eb:a5:97, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.network.neutron [req-2a62b505-9efa-4fbb-9eaa-bf332dd4ebf2 req-bb3bfe02-b251-47c2-9a1c-aca08dad73c1 service nova] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Updated VIF entry in instance network info cache for port 026b74ec-ba11-459e-aa62-77923404317c. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG nova.network.neutron [req-2a62b505-9efa-4fbb-9eaa-bf332dd4ebf2 req-bb3bfe02-b251-47c2-9a1c-aca08dad73c1 service nova] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Updating instance_info_cache with network_info: [{"id": "026b74ec-ba11-459e-aa62-77923404317c", "address": "fa:16:3e:eb:a5:97", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026b74ec-ba", "ovs_interfaceid": "026b74ec-ba11-459e-aa62-77923404317c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:06:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2a62b505-9efa-4fbb-9eaa-bf332dd4ebf2 req-bb3bfe02-b251-47c2-9a1c-aca08dad73c1 service nova] Releasing lock "refresh_cache-a7e95a46-9a75-4b0c-a5c9-42ed521668a5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:06:46 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:06:46 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:06:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:06:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:06:46 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:06:46 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673591.752301, 84706228-0050-49ac-886a-70842ce8dd3b => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:06:46 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] VM Stopped (Lifecycle Event)
Aug 22 03:06:46 user nova-compute[73469]: DEBUG nova.compute.manager [None req-2943e6f3-4695-4191-b6f0-f52ac0605200 None None] [instance: 84706228-0050-49ac-886a-70842ce8dd3b] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:06:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG nova.compute.manager [req-cc46f968-8965-4095-a71e-febddbbc2602 req-6ec00644-ced8-492c-a702-b95608d8cc6d service nova] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Received event network-vif-plugged-026b74ec-ba11-459e-aa62-77923404317c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cc46f968-8965-4095-a71e-febddbbc2602 req-6ec00644-ced8-492c-a702-b95608d8cc6d service nova] Acquiring lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cc46f968-8965-4095-a71e-febddbbc2602 req-6ec00644-ced8-492c-a702-b95608d8cc6d service nova] Lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cc46f968-8965-4095-a71e-febddbbc2602 req-6ec00644-ced8-492c-a702-b95608d8cc6d service nova] Lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG nova.compute.manager [req-cc46f968-8965-4095-a71e-febddbbc2602 req-6ec00644-ced8-492c-a702-b95608d8cc6d service nova] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] No waiting events found dispatching network-vif-plugged-026b74ec-ba11-459e-aa62-77923404317c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:06:47 user nova-compute[73469]: WARNING nova.compute.manager [req-cc46f968-8965-4095-a71e-febddbbc2602 req-6ec00644-ced8-492c-a702-b95608d8cc6d service nova] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Received unexpected event network-vif-plugged-026b74ec-ba11-459e-aa62-77923404317c for instance with vm_state building and task_state spawning.
Aug 22 03:06:47 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Updating instance_info_cache with network_info: [{"id": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "address": "fa:16:3e:8e:27:47", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6148435c-1c", "ovs_interfaceid": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-9d0668c0-7a49-4857-9b69-541021f18ab2" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:48 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:06:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673609.0293438, a7e95a46-9a75-4b0c-a5c9-42ed521668a5 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:06:49 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] VM Resumed (Lifecycle Event)
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:06:49 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Instance spawned successfully.
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:06:49 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673609.0314167, a7e95a46-9a75-4b0c-a5c9-42ed521668a5 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:06:49 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] VM Started (Lifecycle Event)
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:06:49 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:06:49 user nova-compute[73469]: INFO nova.compute.manager [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Took 5.68 seconds to spawn the instance on the hypervisor.
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-dc20403a-7fde-4326-b4dd-b6ff41d375e4 req-83453f7c-0b7e-407d-961c-fd9aeee5297b service nova] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Received event network-vif-plugged-026b74ec-ba11-459e-aa62-77923404317c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dc20403a-7fde-4326-b4dd-b6ff41d375e4 req-83453f7c-0b7e-407d-961c-fd9aeee5297b service nova] Acquiring lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dc20403a-7fde-4326-b4dd-b6ff41d375e4 req-83453f7c-0b7e-407d-961c-fd9aeee5297b service nova] Lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dc20403a-7fde-4326-b4dd-b6ff41d375e4 req-83453f7c-0b7e-407d-961c-fd9aeee5297b service nova] Lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-dc20403a-7fde-4326-b4dd-b6ff41d375e4 req-83453f7c-0b7e-407d-961c-fd9aeee5297b service nova] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] No waiting events found dispatching network-vif-plugged-026b74ec-ba11-459e-aa62-77923404317c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:06:49 user nova-compute[73469]: WARNING nova.compute.manager [req-dc20403a-7fde-4326-b4dd-b6ff41d375e4 req-83453f7c-0b7e-407d-961c-fd9aeee5297b service nova] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Received unexpected event network-vif-plugged-026b74ec-ba11-459e-aa62-77923404317c for instance with vm_state building and task_state spawning.
Aug 22 03:06:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:49 user nova-compute[73469]: INFO nova.compute.manager [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Took 6.54 seconds to build instance.
Aug 22 03:06:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-89580d4f-c7f6-473f-b7d0-d37ee4176ec0 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.642s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673597.1085887, 2e621408-a0af-460b-80a2-3446b5f1aadb => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:06:52 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] VM Stopped (Lifecycle Event)
Aug 22 03:06:52 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:06:52 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=7080MB free_disk=24.959552764892578GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.compute.manager [None req-5f6f37a6-b1e5-4b9e-87de-c8def78eb4e4 None None] [instance: 2e621408-a0af-460b-80a2-3446b5f1aadb] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d0668c0-7a49-4857-9b69-541021f18ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance dc3f5545-8ebb-4947-97d0-98a91f67e421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8242cec1-3b35-4d14-9e0b-db8a7e75697d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82e872a7-70b0-4290-9a11-5316765aed01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 20316a2a-2f1f-4008-ab14-551e627bf680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 980e57bf-dec9-46f3-8d69-e20a17603af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance e43158b8-28fc-429c-b329-26be91761d4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 149b34df-3d3c-48fc-99f2-0c3dc4334b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a7e95a46-9a75-4b0c-a5c9-42ed521668a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:06:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "20316a2a-2f1f-4008-ab14-551e627bf680" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "20316a2a-2f1f-4008-ab14-551e627bf680" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:53 user nova-compute[73469]: INFO nova.compute.manager [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Detaching volume a2728c16-00d9-4b9e-9480-7bf8affa6382
Aug 22 03:06:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:53 user nova-compute[73469]: INFO nova.virt.block_device [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Attempting to driver detach volume a2728c16-00d9-4b9e-9480-7bf8affa6382 from mountpoint /dev/vdb
Aug 22 03:06:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Attempting to detach device vdb from instance 20316a2a-2f1f-4008-ab14-551e627bf680 from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:06:53 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:06:53 user nova-compute[73469]:   <source dev="/dev/sde"/>
Aug 22 03:06:53 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:06:53 user nova-compute[73469]:   <serial>a2728c16-00d9-4b9e-9480-7bf8affa6382</serial>
Aug 22 03:06:53 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:06:53 user nova-compute[73469]: </disk>
Aug 22 03:06:53 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:06:53 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Successfully detached device vdb from instance 20316a2a-2f1f-4008-ab14-551e627bf680 from the persistent domain config.
Aug 22 03:06:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 20316a2a-2f1f-4008-ab14-551e627bf680 from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:06:53 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:06:53 user nova-compute[73469]:   <source dev="/dev/sde"/>
Aug 22 03:06:53 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:06:53 user nova-compute[73469]:   <serial>a2728c16-00d9-4b9e-9480-7bf8affa6382</serial>
Aug 22 03:06:53 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:06:53 user nova-compute[73469]: </disk>
Aug 22 03:06:53 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:06:53 user nova-compute[73469]: INFO nova.compute.manager [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Rescuing
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "refresh_cache-e43158b8-28fc-429c-b329-26be91761d4f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquired lock "refresh_cache-e43158b8-28fc-429c-b329-26be91761d4f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692673613.7162435, 20316a2a-2f1f-4008-ab14-551e627bf680 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 20316a2a-2f1f-4008-ab14-551e627bf680 {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:06:53 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Successfully detached device vdb from instance 20316a2a-2f1f-4008-ab14-551e627bf680 from the live domain config.
Aug 22 03:06:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOJmkSsj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:06:53 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:06:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3afde36-7a69-4d25-b5c1-6ec3131b54bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Updating instance_info_cache with network_info: [{"id": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "address": "fa:16:3e:94:d6:2d", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbb3f1b-29", "ovs_interfaceid": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[426a8c34-73aa-478d-8933-ae60caeb6790]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:06:53 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:06:53 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:06:53 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:06:53 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:06:53 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:06:53 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:06:53 user nova-compute[73469]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 (non-flash)
Aug 22 03:06:53 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:06:53 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:06:53 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79beab20e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382'): ({'sde'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Removing single pathed devices sde {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Releasing lock "refresh_cache-e43158b8-28fc-429c-b329-26be91761d4f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d954e1-35ad-4678-aecd-9e1c303db909]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f723e66a-b9f0-438e-a248-a12548df478f]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Flushing IO for device /dev/sde {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[69809b0b-6167-44f3-a661-72295d1312aa]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673598.8926227, 0d5a30d1-565c-47c9-8caa-84dab130e117 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:06:53 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] VM Stopped (Lifecycle Event)
Aug 22 03:06:53 user nova-compute[73469]: DEBUG nova.compute.manager [None req-be3291d3-6cbb-42c4-96e5-0de2235b66f5 None None] [instance: 0d5a30d1-565c-47c9-8caa-84dab130e117] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2e9362-fc2b-485b-b314-1dbad38ca18d]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] SCSI volumes sde have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dedcdc-33e1-49c2-9708-95ffb0b98b11]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbd4a99-2869-43c6-9b32-686a4bc083fc]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382, portal: 172.16.0.220,3260]
Aug 22 03:06:54 user nova-compute[73469]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382, portal: 172.16.0.220,3260] successful.
Aug 22 03:06:54 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2728c16-00d9-4b9e-9480-7bf8affa6382 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4b91c2-2831-4f80-9cef-776abba96234]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] <== disconnect_volume: return (330ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG nova.compute.manager [req-41684fa0-528c-4dab-bd10-9836bcb8c7a9 req-8787f632-3b45-485b-a450-553bc362e08b service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received event network-vif-unplugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-41684fa0-528c-4dab-bd10-9836bcb8c7a9 req-8787f632-3b45-485b-a450-553bc362e08b service nova] Acquiring lock "e43158b8-28fc-429c-b329-26be91761d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-41684fa0-528c-4dab-bd10-9836bcb8c7a9 req-8787f632-3b45-485b-a450-553bc362e08b service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-41684fa0-528c-4dab-bd10-9836bcb8c7a9 req-8787f632-3b45-485b-a450-553bc362e08b service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG nova.compute.manager [req-41684fa0-528c-4dab-bd10-9836bcb8c7a9 req-8787f632-3b45-485b-a450-553bc362e08b service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] No waiting events found dispatching network-vif-unplugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:06:54 user nova-compute[73469]: WARNING nova.compute.manager [req-41684fa0-528c-4dab-bd10-9836bcb8c7a9 req-8787f632-3b45-485b-a450-553bc362e08b service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received unexpected event network-vif-unplugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c for instance with vm_state active and task_state rescuing.
Aug 22 03:06:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Instance destroyed successfully.
Aug 22 03:06:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Attempting a stable device rescue
Aug 22 03:06:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73469) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Instance directory exists: not creating {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 22 03:06:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Creating image(s)
Aug 22 03:06:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "/opt/stack/data/nova/instances/e43158b8-28fc-429c-b329-26be91761d4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "/opt/stack/data/nova/instances/e43158b8-28fc-429c-b329-26be91761d4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "/opt/stack/data/nova/instances/e43158b8-28fc-429c-b329-26be91761d4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG nova.objects.instance [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'trusted_certs' on Instance uuid e43158b8-28fc-429c-b329-26be91761d4f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "34a2e19293ced1a09651fa91b79b7ae3c870548f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "34a2e19293ced1a09651fa91b79b7ae3c870548f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a2e19293ced1a09651fa91b79b7ae3c870548f.part --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:55 user nova-compute[73469]: DEBUG nova.objects.instance [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lazy-loading 'flavor' on Instance uuid 20316a2a-2f1f-4008-ab14-551e627bf680 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:06:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d0936c60-c2b1-4c48-b2b0-4b8ff62a8598 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "20316a2a-2f1f-4008-ab14-551e627bf680" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.629s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a2e19293ced1a09651fa91b79b7ae3c870548f.part --force-share --output=json" returned: 0 in 0.192s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:55 user nova-compute[73469]: DEBUG nova.virt.images [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] 959da663-f724-4993-ba99-347b461b8e37 was qcow2, converting to raw {{(pid=73469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 22 03:06:55 user nova-compute[73469]: DEBUG nova.privsep.utils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 22 03:06:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34a2e19293ced1a09651fa91b79b7ae3c870548f.part /opt/stack/data/nova/instances/_base/34a2e19293ced1a09651fa91b79b7ae3c870548f.converted {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34a2e19293ced1a09651fa91b79b7ae3c870548f.part /opt/stack/data/nova/instances/_base/34a2e19293ced1a09651fa91b79b7ae3c870548f.converted" returned: 0 in 0.304s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a2e19293ced1a09651fa91b79b7ae3c870548f.converted --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.compute.manager [req-5d05b3f3-d333-48c5-bdf6-88781e9f145b req-5952591e-39ec-4fe2-a44b-2eccaaa77ba1 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received event network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5d05b3f3-d333-48c5-bdf6-88781e9f145b req-5952591e-39ec-4fe2-a44b-2eccaaa77ba1 service nova] Acquiring lock "e43158b8-28fc-429c-b329-26be91761d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5d05b3f3-d333-48c5-bdf6-88781e9f145b req-5952591e-39ec-4fe2-a44b-2eccaaa77ba1 service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5d05b3f3-d333-48c5-bdf6-88781e9f145b req-5952591e-39ec-4fe2-a44b-2eccaaa77ba1 service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.compute.manager [req-5d05b3f3-d333-48c5-bdf6-88781e9f145b req-5952591e-39ec-4fe2-a44b-2eccaaa77ba1 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] No waiting events found dispatching network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:06:56 user nova-compute[73469]: WARNING nova.compute.manager [req-5d05b3f3-d333-48c5-bdf6-88781e9f145b req-5952591e-39ec-4fe2-a44b-2eccaaa77ba1 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received unexpected event network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c for instance with vm_state active and task_state rescuing.
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a2e19293ced1a09651fa91b79b7ae3c870548f.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "34a2e19293ced1a09651fa91b79b7ae3c870548f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.680s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "34a2e19293ced1a09651fa91b79b7ae3c870548f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "34a2e19293ced1a09651fa91b79b7ae3c870548f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a2e19293ced1a09651fa91b79b7ae3c870548f --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34a2e19293ced1a09651fa91b79b7ae3c870548f --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34a2e19293ced1a09651fa91b79b7ae3c870548f,backing_fmt=raw /opt/stack/data/nova/instances/e43158b8-28fc-429c-b329-26be91761d4f/disk.rescue {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34a2e19293ced1a09651fa91b79b7ae3c870548f,backing_fmt=raw /opt/stack/data/nova/instances/e43158b8-28fc-429c-b329-26be91761d4f/disk.rescue" returned: 0 in 0.048s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "34a2e19293ced1a09651fa91b79b7ae3c870548f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.objects.instance [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'migration_context' on Instance uuid e43158b8-28fc-429c-b329-26be91761d4f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Start _get_guest_xml network_info=[{"id": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "address": "fa:16:3e:94:d6:2d", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "vif_mac": "fa:16:3e:94:d6:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbb3f1b-29", "ovs_interfaceid": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '959da663-f724-4993-ba99-347b461b8e37', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'fb90a908-76a9-46f9-90c3-0e0fe9132896', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgBPSsQo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'e43158b8-28fc-429c-b329-26be91761d4f', 'attached_at': '', 'detached_at': '', 'volume_id': '3315f119-dcfd-456b-8a2f-a361a5e42193', 'serial': '3315f119-dcfd-456b-8a2f-a361a5e42193'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.objects.instance [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'resources' on Instance uuid e43158b8-28fc-429c-b329-26be91761d4f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.objects.instance [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'numa_topology' on Instance uuid e43158b8-28fc-429c-b329-26be91761d4f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:06:56 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:06:56 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.objects.instance [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'vcpu_model' on Instance uuid e43158b8-28fc-429c-b329-26be91761d4f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgBPSsQo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:06:56 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:06:56 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:06:56 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75d79a8-fd16-4c59-b519-15fe5c74516d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = IgBPSsQo\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 22 03:06:56 user nova-compute[73469]: node.name = iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193
Aug 22 03:06:56 user nova-compute[73469]: node.tpgt = -1
Aug 22 03:06:56 user nova-compute[73469]: node.startup = automatic
Aug 22 03:06:56 user nova-compute[73469]: node.leading_login = No
Aug 22 03:06:56 user nova-compute[73469]: iface.iscsi_ifacename = default
Aug 22 03:06:56 user nova-compute[73469]: iface.net_ifacename = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.ipaddress = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.prefix_len = 0
Aug 22 03:06:56 user nova-compute[73469]: iface.hwaddress = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.transport_name = tcp
Aug 22 03:06:56 user nova-compute[73469]: iface.initiatorname = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.state = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.vlan_id = 0
Aug 22 03:06:56 user nova-compute[73469]: iface.vlan_priority = 0
Aug 22 03:06:56 user nova-compute[73469]: iface.vlan_state = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.iface_num = 0
Aug 22 03:06:56 user nova-compute[73469]: iface.mtu = 0
Aug 22 03:06:56 user nova-compute[73469]: iface.port = 0
Aug 22 03:06:56 user nova-compute[73469]: iface.bootproto = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.subnet_mask = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.gateway = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.dhcp_alt_client_id_state = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.dhcp_alt_client_id = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.dhcp_dns = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.dhcp_learn_iqn = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.dhcp_req_vendor_id_state = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.dhcp_vendor_id_state = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.dhcp_vendor_id = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.dhcp_slp_da = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.fragmentation = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.gratuitous_arp = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.incoming_forwarding = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.tos_state = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.tos = 0
Aug 22 03:06:56 user nova-compute[73469]: iface.ttl = 0
Aug 22 03:06:56 user nova-compute[73469]: iface.delayed_ack = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.tcp_nagle = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.tcp_wsf_state = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.tcp_wsf = 0
Aug 22 03:06:56 user nova-compute[73469]: iface.tcp_timer_scale = 0
Aug 22 03:06:56 user nova-compute[73469]: iface.tcp_timestamp = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.redirect = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.def_task_mgmt_timeout = 0
Aug 22 03:06:56 user nova-compute[73469]: iface.header_digest = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.data_digest = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.immediate_data = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.initial_r2t = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.data_seq_inorder = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.data_pdu_inorder = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.erl = 0
Aug 22 03:06:56 user nova-compute[73469]: iface.max_receive_data_len = 0
Aug 22 03:06:56 user nova-compute[73469]: iface.first_burst_len = 0
Aug 22 03:06:56 user nova-compute[73469]: iface.max_outstanding_r2t = 0
Aug 22 03:06:56 user nova-compute[73469]: iface.max_burst_len = 0
Aug 22 03:06:56 user nova-compute[73469]: iface.chap_auth = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.bidi_chap = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.strict_login_compliance = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.discovery_auth = <empty>
Aug 22 03:06:56 user nova-compute[73469]: iface.discovery_logout = <empty>
Aug 22 03:06:56 user nova-compute[73469]: node.discovery_address = <empty>
Aug 22 03:06:56 user nova-compute[73469]: node.discovery_port = 0
Aug 22 03:06:56 user nova-compute[73469]: node.discovery_type = static
Aug 22 03:06:56 user nova-compute[73469]: node.session.initial_cmdsn = 0
Aug 22 03:06:56 user nova-compute[73469]: node.session.initial_login_retry_max = 8
Aug 22 03:06:56 user nova-compute[73469]: node.session.xmit_thread_priority = -20
Aug 22 03:06:56 user nova-compute[73469]: node.session.cmds_max = 128
Aug 22 03:06:56 user nova-compute[73469]: node.session.queue_depth = 32
Aug 22 03:06:56 user nova-compute[73469]: node.session.nr_sessions = 1
Aug 22 03:06:56 user nova-compute[73469]: node.session.auth.authmethod = CHAP
Aug 22 03:06:56 user nova-compute[73469]: node.session.auth.username = IgBPSsQo
Aug 22 03:06:56 user nova-compute[73469]: node.session.auth.password = ***
Aug 22 03:06:56 user nova-compute[73469]: node.session.auth.username_in = <empty>
Aug 22 03:06:56 user nova-compute[73469]: node.session.auth.password_in = <empty>
Aug 22 03:06:56 user nova-compute[73469]: node.session.auth.chap_algs = MD5
Aug 22 03:06:56 user nova-compute[73469]: node.session.timeo.replacement_timeout = 120
Aug 22 03:06:56 user nova-compute[73469]: node.session.err_timeo.abort_timeout = 15
Aug 22 03:06:56 user nova-compute[73469]: node.session.err_timeo.lu_reset_timeout = 30
Aug 22 03:06:56 user nova-compute[73469]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 22 03:06:56 user nova-compute[73469]: node.session.err_timeo.host_reset_timeout = 60
Aug 22 03:06:56 user nova-compute[73469]: node.session.iscsi.FastAbort = Yes
Aug 22 03:06:56 user nova-compute[73469]: node.session.iscsi.InitialR2T = No
Aug 22 03:06:56 user nova-compute[73469]: node.session.iscsi.ImmediateData = Yes
Aug 22 03:06:56 user nova-compute[73469]: node.session.iscsi.FirstBurstLength = 262144
Aug 22 03:06:56 user nova-compute[73469]: node.session.iscsi.MaxBurstLength = 16776192
Aug 22 03:06:56 user nova-compute[73469]: node.session.iscsi.DefaultTime2Retain = 0
Aug 22 03:06:56 user nova-compute[73469]: node.session.iscsi.DefaultTime2Wait = 2
Aug 22 03:06:56 user nova-compute[73469]: node.session.iscsi.MaxConnections = 1
Aug 22 03:06:56 user nova-compute[73469]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 22 03:06:56 user nova-compute[73469]: node.session.iscsi.ERL = 0
Aug 22 03:06:56 user nova-compute[73469]: node.session.scan = manual
Aug 22 03:06:56 user nova-compute[73469]: node.session.reopen_max = 0
Aug 22 03:06:56 user nova-compute[73469]: node.conn[0].address = 172.16.0.220
Aug 22 03:06:56 user nova-compute[73469]: node.conn[0].port = 3260
Aug 22 03:06:56 user nova-compute[73469]: node.conn[0].startup = manual
Aug 22 03:06:56 user nova-compute[73469]: node.conn[0].tcp.window_size = 524288
Aug 22 03:06:56 user nova-compute[73469]: node.conn[0].tcp.type_of_service = 0
Aug 22 03:06:56 user nova-compute[73469]: node.conn[0].timeo.logout_timeout = 15
Aug 22 03:06:56 user nova-compute[73469]: node.conn[0].timeo.login_timeout = 15
Aug 22 03:06:56 user nova-compute[73469]: node.conn[0].timeo.auth_timeout = 45
Aug 22 03:06:56 user nova-compute[73469]: node.conn[0].timeo.noop_out_interval = 5
Aug 22 03:06:56 user nova-compute[73469]: node.conn[0].timeo.noop_out_timeout = 5
Aug 22 03:06:56 user nova-compute[73469]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 22 03:06:56 user nova-compute[73469]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 22 03:06:56 user nova-compute[73469]: node.conn[0].iscsi.HeaderDigest = None
Aug 22 03:06:56 user nova-compute[73469]: node.conn[0].iscsi.DataDigest = None
Aug 22 03:06:56 user nova-compute[73469]: node.conn[0].iscsi.IFMarker = No
Aug 22 03:06:56 user nova-compute[73469]: node.conn[0].iscsi.OFMarker = No
Aug 22 03:06:56 user nova-compute[73469]: # END RECORD
Aug 22 03:06:56 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e598c3-4590-4468-bad9-db9fe9946b7d]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[845b4343-3da8-4a74-a550-b2cd1871c0e8]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgBPSsQo {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgBPSsQo" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd32cbe-bcfb-4222-8fff-a4e87cf37b34]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IgBPSsQo'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84ba20c-7788-48e2-b7c6-7823a160e451]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae92873-85c2-4071-bf3f-9ca654348961]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:06:56 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:06:56 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:06:56 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:06:56 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:06:56 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:06:56 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:06:56 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:06:56 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.141s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] HCTL ('41', '0', '0', 0) found on session 33 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Scanning host 41 c: 0, t: 0, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7021ce06-6076-4d69-804b-ebac008f7fa0]: (4, ('0 0 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Searching for a device in session 33 and hctl ('41', '0', '0', 0) yield: sdj {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgBPSsQo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.165s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] <== connect_volume: return (166ms) {'type': 'block', 'scsi_wwn': '23937333934663161', 'path': '/dev/sdj'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937333934663161', 'path': '/dev/sdj'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:04:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-159252147',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-159252147',id=28,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:05:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9131cb883044191931dc31e51e94766',ramdisk_id='',reservation_id='r-dm0r0052',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568629509',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:05:04Z,user_data=None,user_id='a7b228f99c9e4d058e128a5a99636b7b',uuid=e43158b8-28fc-429c-b329-26be91761d4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "address": "fa:16:3e:94:d6:2d", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "vif_mac": "fa:16:3e:94:d6:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbb3f1b-29", "ovs_interfaceid": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converting VIF {"id": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "address": "fa:16:3e:94:d6:2d", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "vif_mac": "fa:16:3e:94:d6:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbb3f1b-29", "ovs_interfaceid": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:d6:2d,bridge_name='br-int',has_traffic_filtering=True,id=bbbb3f1b-29b6-4f01-9296-3452d13d0b0c,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbbb3f1b-29') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.objects.instance [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'pci_devices' on Instance uuid e43158b8-28fc-429c-b329-26be91761d4f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:06:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:06:56 user nova-compute[73469]:   <uuid>e43158b8-28fc-429c-b329-26be91761d4f</uuid>
Aug 22 03:06:56 user nova-compute[73469]:   <name>instance-0000001c</name>
Aug 22 03:06:56 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:06:56 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:06:56 user nova-compute[73469]:   <metadata>
Aug 22 03:06:56 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:06:56 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:06:56 user nova-compute[73469]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-159252147</nova:name>
Aug 22 03:06:56 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:06:56</nova:creationTime>
Aug 22 03:06:56 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:06:56 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:06:56 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:06:56 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:06:56 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:06:56 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:06:56 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:06:56 user nova-compute[73469]:       <nova:owner>
Aug 22 03:06:56 user nova-compute[73469]:         <nova:user uuid="a7b228f99c9e4d058e128a5a99636b7b">tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member</nova:user>
Aug 22 03:06:56 user nova-compute[73469]:         <nova:project uuid="c9131cb883044191931dc31e51e94766">tempest-ServerBootFromVolumeStableRescueTest-568629509</nova:project>
Aug 22 03:06:56 user nova-compute[73469]:       </nova:owner>
Aug 22 03:06:56 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:06:56 user nova-compute[73469]:       <nova:ports>
Aug 22 03:06:56 user nova-compute[73469]:         <nova:port uuid="bbbb3f1b-29b6-4f01-9296-3452d13d0b0c">
Aug 22 03:06:56 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 22 03:06:56 user nova-compute[73469]:         </nova:port>
Aug 22 03:06:56 user nova-compute[73469]:       </nova:ports>
Aug 22 03:06:56 user nova-compute[73469]:     </nova:instance>
Aug 22 03:06:56 user nova-compute[73469]:   </metadata>
Aug 22 03:06:56 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:06:56 user nova-compute[73469]:     <system>
Aug 22 03:06:56 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:06:56 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:06:56 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:06:56 user nova-compute[73469]:       <entry name="serial">e43158b8-28fc-429c-b329-26be91761d4f</entry>
Aug 22 03:06:56 user nova-compute[73469]:       <entry name="uuid">e43158b8-28fc-429c-b329-26be91761d4f</entry>
Aug 22 03:06:56 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:06:56 user nova-compute[73469]:     </system>
Aug 22 03:06:56 user nova-compute[73469]:   </sysinfo>
Aug 22 03:06:56 user nova-compute[73469]:   <os>
Aug 22 03:06:56 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:06:56 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:06:56 user nova-compute[73469]:   </os>
Aug 22 03:06:56 user nova-compute[73469]:   <features>
Aug 22 03:06:56 user nova-compute[73469]:     <acpi/>
Aug 22 03:06:56 user nova-compute[73469]:     <apic/>
Aug 22 03:06:56 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:06:56 user nova-compute[73469]:   </features>
Aug 22 03:06:56 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:06:56 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:06:56 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:06:56 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:06:56 user nova-compute[73469]:   </clock>
Aug 22 03:06:56 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:06:56 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:06:56 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:06:56 user nova-compute[73469]:   </cpu>
Aug 22 03:06:56 user nova-compute[73469]:   <devices>
Aug 22 03:06:56 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:06:56 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:06:56 user nova-compute[73469]:       <source dev="/dev/sdj"/>
Aug 22 03:06:56 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:06:56 user nova-compute[73469]:       <serial>3315f119-dcfd-456b-8a2f-a361a5e42193</serial>
Aug 22 03:06:56 user nova-compute[73469]:     </disk>
Aug 22 03:06:56 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:06:56 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:06:56 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/e43158b8-28fc-429c-b329-26be91761d4f/disk.rescue"/>
Aug 22 03:06:56 user nova-compute[73469]:       <target dev="vdb" bus="virtio"/>
Aug 22 03:06:56 user nova-compute[73469]:       <boot order="1"/>
Aug 22 03:06:56 user nova-compute[73469]:     </disk>
Aug 22 03:06:56 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:06:56 user nova-compute[73469]:       <mac address="fa:16:3e:94:d6:2d"/>
Aug 22 03:06:56 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:06:56 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:06:56 user nova-compute[73469]:       <target dev="tapbbbb3f1b-29"/>
Aug 22 03:06:56 user nova-compute[73469]:     </interface>
Aug 22 03:06:56 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:06:56 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/e43158b8-28fc-429c-b329-26be91761d4f/console.log" append="off"/>
Aug 22 03:06:56 user nova-compute[73469]:     </serial>
Aug 22 03:06:56 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:06:56 user nova-compute[73469]:     <video>
Aug 22 03:06:56 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:06:56 user nova-compute[73469]:     </video>
Aug 22 03:06:56 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:06:56 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:06:56 user nova-compute[73469]:     </rng>
Aug 22 03:06:56 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:06:56 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:06:56 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:06:56 user nova-compute[73469]:     </memballoon>
Aug 22 03:06:56 user nova-compute[73469]:   </devices>
Aug 22 03:06:56 user nova-compute[73469]: </domain>
Aug 22 03:06:56 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:06:56 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Instance destroyed successfully.
Aug 22 03:06:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:06:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:06:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] No VIF found with MAC fa:16:3e:94:d6:2d, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:06:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:58 user nova-compute[73469]: DEBUG nova.compute.manager [req-bbeb796d-8558-402f-a5e2-635f821807e5 req-16b5f5f6-8606-4568-a51f-018d1fa22b71 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received event network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:06:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bbeb796d-8558-402f-a5e2-635f821807e5 req-16b5f5f6-8606-4568-a51f-018d1fa22b71 service nova] Acquiring lock "e43158b8-28fc-429c-b329-26be91761d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:06:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bbeb796d-8558-402f-a5e2-635f821807e5 req-16b5f5f6-8606-4568-a51f-018d1fa22b71 service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:06:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bbeb796d-8558-402f-a5e2-635f821807e5 req-16b5f5f6-8606-4568-a51f-018d1fa22b71 service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:06:58 user nova-compute[73469]: DEBUG nova.compute.manager [req-bbeb796d-8558-402f-a5e2-635f821807e5 req-16b5f5f6-8606-4568-a51f-018d1fa22b71 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] No waiting events found dispatching network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:06:58 user nova-compute[73469]: WARNING nova.compute.manager [req-bbeb796d-8558-402f-a5e2-635f821807e5 req-16b5f5f6-8606-4568-a51f-018d1fa22b71 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received unexpected event network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c for instance with vm_state active and task_state rescuing.
Aug 22 03:06:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:06:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Removed pending event for e43158b8-28fc-429c-b329-26be91761d4f due to event {{(pid=73469) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 22 03:07:00 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673620.54658, e43158b8-28fc-429c-b329-26be91761d4f => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:07:00 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] VM Resumed (Lifecycle Event)
Aug 22 03:07:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4b363c03-607f-48af-bf50-0a91e4b45350 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:07:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:07:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:07:00 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 22 03:07:00 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673620.5505173, e43158b8-28fc-429c-b329-26be91761d4f => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:07:00 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] VM Started (Lifecycle Event)
Aug 22 03:07:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:07:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:07:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:00 user nova-compute[73469]: DEBUG nova.compute.manager [req-a680b9bc-cfca-44b8-9f9f-25ea269cd090 req-097891d3-4843-4d81-8661-bdacbf8762f1 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received event network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:07:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a680b9bc-cfca-44b8-9f9f-25ea269cd090 req-097891d3-4843-4d81-8661-bdacbf8762f1 service nova] Acquiring lock "e43158b8-28fc-429c-b329-26be91761d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a680b9bc-cfca-44b8-9f9f-25ea269cd090 req-097891d3-4843-4d81-8661-bdacbf8762f1 service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a680b9bc-cfca-44b8-9f9f-25ea269cd090 req-097891d3-4843-4d81-8661-bdacbf8762f1 service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:00 user nova-compute[73469]: DEBUG nova.compute.manager [req-a680b9bc-cfca-44b8-9f9f-25ea269cd090 req-097891d3-4843-4d81-8661-bdacbf8762f1 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] No waiting events found dispatching network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:07:00 user nova-compute[73469]: WARNING nova.compute.manager [req-a680b9bc-cfca-44b8-9f9f-25ea269cd090 req-097891d3-4843-4d81-8661-bdacbf8762f1 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received unexpected event network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c for instance with vm_state rescued and task_state None.
Aug 22 03:07:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:05 user nova-compute[73469]: DEBUG nova.compute.manager [req-c938b8da-1686-4139-b1a6-ce85be9a0055 req-c9371484-0af9-461b-aa07-b3699b811253 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received event network-changed-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:07:05 user nova-compute[73469]: DEBUG nova.compute.manager [req-c938b8da-1686-4139-b1a6-ce85be9a0055 req-c9371484-0af9-461b-aa07-b3699b811253 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Refreshing instance network info cache due to event network-changed-a64e4e29-61af-465a-8dc2-b8851274e0d9. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:07:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c938b8da-1686-4139-b1a6-ce85be9a0055 req-c9371484-0af9-461b-aa07-b3699b811253 service nova] Acquiring lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:07:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c938b8da-1686-4139-b1a6-ce85be9a0055 req-c9371484-0af9-461b-aa07-b3699b811253 service nova] Acquired lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:07:05 user nova-compute[73469]: DEBUG nova.network.neutron [req-c938b8da-1686-4139-b1a6-ce85be9a0055 req-c9371484-0af9-461b-aa07-b3699b811253 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Refreshing network info cache for port a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:07:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:05 user nova-compute[73469]: INFO nova.compute.manager [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Detaching volume f057580b-77c4-4835-99ac-6fc720392834
Aug 22 03:07:05 user nova-compute[73469]: DEBUG nova.network.neutron [req-c938b8da-1686-4139-b1a6-ce85be9a0055 req-c9371484-0af9-461b-aa07-b3699b811253 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Updated VIF entry in instance network info cache for port a64e4e29-61af-465a-8dc2-b8851274e0d9. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:07:05 user nova-compute[73469]: DEBUG nova.network.neutron [req-c938b8da-1686-4139-b1a6-ce85be9a0055 req-c9371484-0af9-461b-aa07-b3699b811253 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Updating instance_info_cache with network_info: [{"id": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "address": "fa:16:3e:63:38:91", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e4e29-61", "ovs_interfaceid": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:07:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c938b8da-1686-4139-b1a6-ce85be9a0055 req-c9371484-0af9-461b-aa07-b3699b811253 service nova] Releasing lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:07:06 user nova-compute[73469]: INFO nova.virt.block_device [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Attempting to driver detach volume f057580b-77c4-4835-99ac-6fc720392834 from mountpoint /dev/vdb
Aug 22 03:07:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Attempting to detach device vdb from instance f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:07:06 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:07:06 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:07:06 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:07:06 user nova-compute[73469]:   <serial>f057580b-77c4-4835-99ac-6fc720392834</serial>
Aug 22 03:07:06 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:07:06 user nova-compute[73469]: </disk>
Aug 22 03:07:06 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:07:06 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Successfully detached device vdb from instance f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 from the persistent domain config.
Aug 22 03:07:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:07:06 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:07:06 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:07:06 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:07:06 user nova-compute[73469]:   <serial>f057580b-77c4-4835-99ac-6fc720392834</serial>
Aug 22 03:07:06 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:07:06 user nova-compute[73469]: </disk>
Aug 22 03:07:06 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692673626.6569407, f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:07:06 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Successfully detached device vdb from instance f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 from the live domain config.
Aug 22 03:07:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCnATKjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:07:06 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:07:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f362c71-0bfc-4862-82cf-b3f795354144]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8642cd70-bcf2-4a41-b29b-bdf4adbf0e56]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:07:06 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:07:06 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:07:06 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:07:06 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:07:06 user nova-compute[73469]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 (non-flash)
Aug 22 03:07:06 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:07:06 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:07:06 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a41ce320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b06a6bf-4ddf-4a02-9005-7bed280522b5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa5edf5-9e4c-4996-8c07-f952619a604b]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ab987f-21f0-4acc-86c9-4b25e43e60f0]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0692fd7-faf6-40eb-be9f-4fc30a0125c3]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0e8cb3-94ed-4809-991e-a6062555e3c1]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f5182a-e17a-404e-a9ce-d9ac42c44766]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834, portal: 172.16.0.220,3260]
Aug 22 03:07:06 user nova-compute[73469]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834, portal: 172.16.0.220,3260] successful.
Aug 22 03:07:06 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:07:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f057580b-77c4-4835-99ac-6fc720392834 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7503ab1f-a5e2-4161-b4ee-653308dc9662]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:07:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:07:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:07:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] <== disconnect_volume: return (333ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:07:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:07:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-57ace853-687d-4236-8a9d-62293eec2871 req-94edac19-f6d6-4d68-9c8d-f1caa9092507 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received event network-changed-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:07:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-57ace853-687d-4236-8a9d-62293eec2871 req-94edac19-f6d6-4d68-9c8d-f1caa9092507 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Refreshing instance network info cache due to event network-changed-a64e4e29-61af-465a-8dc2-b8851274e0d9. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:07:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-57ace853-687d-4236-8a9d-62293eec2871 req-94edac19-f6d6-4d68-9c8d-f1caa9092507 service nova] Acquiring lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:07:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-57ace853-687d-4236-8a9d-62293eec2871 req-94edac19-f6d6-4d68-9c8d-f1caa9092507 service nova] Acquired lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:07:07 user nova-compute[73469]: DEBUG nova.network.neutron [req-57ace853-687d-4236-8a9d-62293eec2871 req-94edac19-f6d6-4d68-9c8d-f1caa9092507 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Refreshing network info cache for port a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:07:07 user nova-compute[73469]: DEBUG nova.objects.instance [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'flavor' on Instance uuid f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:07:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0100a702-4bea-4178-8c47-f8ed8cd35ef2 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.986s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:07 user nova-compute[73469]: DEBUG nova.network.neutron [req-57ace853-687d-4236-8a9d-62293eec2871 req-94edac19-f6d6-4d68-9c8d-f1caa9092507 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Updated VIF entry in instance network info cache for port a64e4e29-61af-465a-8dc2-b8851274e0d9. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:07:07 user nova-compute[73469]: DEBUG nova.network.neutron [req-57ace853-687d-4236-8a9d-62293eec2871 req-94edac19-f6d6-4d68-9c8d-f1caa9092507 service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Updating instance_info_cache with network_info: [{"id": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "address": "fa:16:3e:63:38:91", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e4e29-61", "ovs_interfaceid": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:07:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-57ace853-687d-4236-8a9d-62293eec2871 req-94edac19-f6d6-4d68-9c8d-f1caa9092507 service nova] Releasing lock "refresh_cache-f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:07:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:07:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:31 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:07:31 user nova-compute[73469]: INFO nova.compute.claims [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Claim successful on node user
Aug 22 03:07:32 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:07:32 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:07:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.664s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:07:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:07:32 user nova-compute[73469]: DEBUG nova.network.neutron [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:07:32 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:07:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:07:32 user nova-compute[73469]: DEBUG nova.policy [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e62d25dff554a629a7e0af1406d97a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49e405f5aca432097b7ba854fd3055b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:07:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:07:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:07:32 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Creating image(s)
Aug 22 03:07:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "/opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "/opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.236s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.203s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk 1073741824" returned: 0 in 0.061s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.205s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:33 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:07:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:33 user nova-compute[73469]: DEBUG nova.network.neutron [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Successfully created port: 135c6c26-00c9-4174-8b5d-51002185def1 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:07:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:33 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Cannot resize image /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:07:33 user nova-compute[73469]: DEBUG nova.objects.instance [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'migration_context' on Instance uuid a0a019bd-fadd-46cb-ac48-d47bfc263b0c {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:07:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:07:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Ensure instance console log exists: /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:07:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:35 user nova-compute[73469]: DEBUG nova.network.neutron [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Successfully updated port: 135c6c26-00c9-4174-8b5d-51002185def1 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:07:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "refresh_cache-a0a019bd-fadd-46cb-ac48-d47bfc263b0c" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:07:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquired lock "refresh_cache-a0a019bd-fadd-46cb-ac48-d47bfc263b0c" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:07:35 user nova-compute[73469]: DEBUG nova.network.neutron [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:07:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-0d6b759f-d2a8-4ec1-aa0c-4a0ce5288a75 req-74ca7120-1557-4b3d-9942-1f145b05594c service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Received event network-changed-135c6c26-00c9-4174-8b5d-51002185def1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:07:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-0d6b759f-d2a8-4ec1-aa0c-4a0ce5288a75 req-74ca7120-1557-4b3d-9942-1f145b05594c service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Refreshing instance network info cache due to event network-changed-135c6c26-00c9-4174-8b5d-51002185def1. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:07:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0d6b759f-d2a8-4ec1-aa0c-4a0ce5288a75 req-74ca7120-1557-4b3d-9942-1f145b05594c service nova] Acquiring lock "refresh_cache-a0a019bd-fadd-46cb-ac48-d47bfc263b0c" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:07:35 user nova-compute[73469]: DEBUG nova.network.neutron [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:07:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.network.neutron [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Updating instance_info_cache with network_info: [{"id": "135c6c26-00c9-4174-8b5d-51002185def1", "address": "fa:16:3e:df:6e:f3", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c6c26-00", "ovs_interfaceid": "135c6c26-00c9-4174-8b5d-51002185def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Releasing lock "refresh_cache-a0a019bd-fadd-46cb-ac48-d47bfc263b0c" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Instance network_info: |[{"id": "135c6c26-00c9-4174-8b5d-51002185def1", "address": "fa:16:3e:df:6e:f3", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c6c26-00", "ovs_interfaceid": "135c6c26-00c9-4174-8b5d-51002185def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0d6b759f-d2a8-4ec1-aa0c-4a0ce5288a75 req-74ca7120-1557-4b3d-9942-1f145b05594c service nova] Acquired lock "refresh_cache-a0a019bd-fadd-46cb-ac48-d47bfc263b0c" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.network.neutron [req-0d6b759f-d2a8-4ec1-aa0c-4a0ce5288a75 req-74ca7120-1557-4b3d-9942-1f145b05594c service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Refreshing network info cache for port 135c6c26-00c9-4174-8b5d-51002185def1 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Start _get_guest_xml network_info=[{"id": "135c6c26-00c9-4174-8b5d-51002185def1", "address": "fa:16:3e:df:6e:f3", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c6c26-00", "ovs_interfaceid": "135c6c26-00c9-4174-8b5d-51002185def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:07:36 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:07:36 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-790075097',display_name='tempest-AttachVolumeTestJSON-server-790075097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-790075097',id=31,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIANewk1ubOhUIMRi5IAPT+T3QpuYOFlznIx9x7Joo0Nk2oKfelUbpFBqljS4d8T6YH02em6RHostSLYkwHzrvmRd4PYZ+jeZZdAFSrf7cP7wp9BdSAU4KrDdd+Cah3y0A==',key_name='tempest-keypair-1715971158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e49e405f5aca432097b7ba854fd3055b',ramdisk_id='',reservation_id='r-m9qao35k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-356928747',owner_user_name='tempest-AttachVolumeTestJSON-356928747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:07:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e62d25dff554a629a7e0af1406d97a9',uuid=a0a019bd-fadd-46cb-ac48-d47bfc263b0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "135c6c26-00c9-4174-8b5d-51002185def1", "address": "fa:16:3e:df:6e:f3", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c6c26-00", "ovs_interfaceid": "135c6c26-00c9-4174-8b5d-51002185def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converting VIF {"id": "135c6c26-00c9-4174-8b5d-51002185def1", "address": "fa:16:3e:df:6e:f3", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c6c26-00", "ovs_interfaceid": "135c6c26-00c9-4174-8b5d-51002185def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:6e:f3,bridge_name='br-int',has_traffic_filtering=True,id=135c6c26-00c9-4174-8b5d-51002185def1,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135c6c26-00') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.objects.instance [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'pci_devices' on Instance uuid a0a019bd-fadd-46cb-ac48-d47bfc263b0c {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:07:36 user nova-compute[73469]:   <uuid>a0a019bd-fadd-46cb-ac48-d47bfc263b0c</uuid>
Aug 22 03:07:36 user nova-compute[73469]:   <name>instance-0000001f</name>
Aug 22 03:07:36 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:07:36 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:07:36 user nova-compute[73469]:   <metadata>
Aug 22 03:07:36 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:07:36 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:07:36 user nova-compute[73469]:       <nova:name>tempest-AttachVolumeTestJSON-server-790075097</nova:name>
Aug 22 03:07:36 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:07:36</nova:creationTime>
Aug 22 03:07:36 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:07:36 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:07:36 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:07:36 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:07:36 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:07:36 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:07:36 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:07:36 user nova-compute[73469]:       <nova:owner>
Aug 22 03:07:36 user nova-compute[73469]:         <nova:user uuid="0e62d25dff554a629a7e0af1406d97a9">tempest-AttachVolumeTestJSON-356928747-project-member</nova:user>
Aug 22 03:07:36 user nova-compute[73469]:         <nova:project uuid="e49e405f5aca432097b7ba854fd3055b">tempest-AttachVolumeTestJSON-356928747</nova:project>
Aug 22 03:07:36 user nova-compute[73469]:       </nova:owner>
Aug 22 03:07:36 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:07:36 user nova-compute[73469]:       <nova:ports>
Aug 22 03:07:36 user nova-compute[73469]:         <nova:port uuid="135c6c26-00c9-4174-8b5d-51002185def1">
Aug 22 03:07:36 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 22 03:07:36 user nova-compute[73469]:         </nova:port>
Aug 22 03:07:36 user nova-compute[73469]:       </nova:ports>
Aug 22 03:07:36 user nova-compute[73469]:     </nova:instance>
Aug 22 03:07:36 user nova-compute[73469]:   </metadata>
Aug 22 03:07:36 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:07:36 user nova-compute[73469]:     <system>
Aug 22 03:07:36 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:07:36 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:07:36 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:07:36 user nova-compute[73469]:       <entry name="serial">a0a019bd-fadd-46cb-ac48-d47bfc263b0c</entry>
Aug 22 03:07:36 user nova-compute[73469]:       <entry name="uuid">a0a019bd-fadd-46cb-ac48-d47bfc263b0c</entry>
Aug 22 03:07:36 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:07:36 user nova-compute[73469]:     </system>
Aug 22 03:07:36 user nova-compute[73469]:   </sysinfo>
Aug 22 03:07:36 user nova-compute[73469]:   <os>
Aug 22 03:07:36 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:07:36 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:07:36 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:07:36 user nova-compute[73469]:   </os>
Aug 22 03:07:36 user nova-compute[73469]:   <features>
Aug 22 03:07:36 user nova-compute[73469]:     <acpi/>
Aug 22 03:07:36 user nova-compute[73469]:     <apic/>
Aug 22 03:07:36 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:07:36 user nova-compute[73469]:   </features>
Aug 22 03:07:36 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:07:36 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:07:36 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:07:36 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:07:36 user nova-compute[73469]:   </clock>
Aug 22 03:07:36 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:07:36 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:07:36 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:07:36 user nova-compute[73469]:   </cpu>
Aug 22 03:07:36 user nova-compute[73469]:   <devices>
Aug 22 03:07:36 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:07:36 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:07:36 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk"/>
Aug 22 03:07:36 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:07:36 user nova-compute[73469]:     </disk>
Aug 22 03:07:36 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:07:36 user nova-compute[73469]:       <mac address="fa:16:3e:df:6e:f3"/>
Aug 22 03:07:36 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:07:36 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:07:36 user nova-compute[73469]:       <target dev="tap135c6c26-00"/>
Aug 22 03:07:36 user nova-compute[73469]:     </interface>
Aug 22 03:07:36 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:07:36 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/console.log" append="off"/>
Aug 22 03:07:36 user nova-compute[73469]:     </serial>
Aug 22 03:07:36 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:07:36 user nova-compute[73469]:     <video>
Aug 22 03:07:36 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:07:36 user nova-compute[73469]:     </video>
Aug 22 03:07:36 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:07:36 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:07:36 user nova-compute[73469]:     </rng>
Aug 22 03:07:36 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:07:36 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:07:36 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:07:36 user nova-compute[73469]:     </memballoon>
Aug 22 03:07:36 user nova-compute[73469]:   </devices>
Aug 22 03:07:36 user nova-compute[73469]: </domain>
Aug 22 03:07:36 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-790075097',display_name='tempest-AttachVolumeTestJSON-server-790075097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-790075097',id=31,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIANewk1ubOhUIMRi5IAPT+T3QpuYOFlznIx9x7Joo0Nk2oKfelUbpFBqljS4d8T6YH02em6RHostSLYkwHzrvmRd4PYZ+jeZZdAFSrf7cP7wp9BdSAU4KrDdd+Cah3y0A==',key_name='tempest-keypair-1715971158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e49e405f5aca432097b7ba854fd3055b',ramdisk_id='',reservation_id='r-m9qao35k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-356928747',owner_user_name='tempest-AttachVolumeTestJSON-356928747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:07:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e62d25dff554a629a7e0af1406d97a9',uuid=a0a019bd-fadd-46cb-ac48-d47bfc263b0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "135c6c26-00c9-4174-8b5d-51002185def1", "address": "fa:16:3e:df:6e:f3", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c6c26-00", "ovs_interfaceid": "135c6c26-00c9-4174-8b5d-51002185def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converting VIF {"id": "135c6c26-00c9-4174-8b5d-51002185def1", "address": "fa:16:3e:df:6e:f3", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c6c26-00", "ovs_interfaceid": "135c6c26-00c9-4174-8b5d-51002185def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:6e:f3,bridge_name='br-int',has_traffic_filtering=True,id=135c6c26-00c9-4174-8b5d-51002185def1,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135c6c26-00') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG os_vif [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:6e:f3,bridge_name='br-int',has_traffic_filtering=True,id=135c6c26-00c9-4174-8b5d-51002185def1,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135c6c26-00') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap135c6c26-00, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap135c6c26-00, col_values=(('external_ids', {'iface-id': '135c6c26-00c9-4174-8b5d-51002185def1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:6e:f3', 'vm-uuid': 'a0a019bd-fadd-46cb-ac48-d47bfc263b0c'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:36 user nova-compute[73469]: INFO os_vif [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:6e:f3,bridge_name='br-int',has_traffic_filtering=True,id=135c6c26-00c9-4174-8b5d-51002185def1,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135c6c26-00')
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] No VIF found with MAC fa:16:3e:df:6e:f3, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.network.neutron [req-0d6b759f-d2a8-4ec1-aa0c-4a0ce5288a75 req-74ca7120-1557-4b3d-9942-1f145b05594c service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Updated VIF entry in instance network info cache for port 135c6c26-00c9-4174-8b5d-51002185def1. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG nova.network.neutron [req-0d6b759f-d2a8-4ec1-aa0c-4a0ce5288a75 req-74ca7120-1557-4b3d-9942-1f145b05594c service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Updating instance_info_cache with network_info: [{"id": "135c6c26-00c9-4174-8b5d-51002185def1", "address": "fa:16:3e:df:6e:f3", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c6c26-00", "ovs_interfaceid": "135c6c26-00c9-4174-8b5d-51002185def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:07:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0d6b759f-d2a8-4ec1-aa0c-4a0ce5288a75 req-74ca7120-1557-4b3d-9942-1f145b05594c service nova] Releasing lock "refresh_cache-a0a019bd-fadd-46cb-ac48-d47bfc263b0c" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:07:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-13e102d7-ecbc-4bc8-8a8c-fbbd0d2a8d6c req-a44a3f2b-c45d-4d2e-817e-92fa619a958e service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Received event network-vif-plugged-135c6c26-00c9-4174-8b5d-51002185def1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:07:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-13e102d7-ecbc-4bc8-8a8c-fbbd0d2a8d6c req-a44a3f2b-c45d-4d2e-817e-92fa619a958e service nova] Acquiring lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-13e102d7-ecbc-4bc8-8a8c-fbbd0d2a8d6c req-a44a3f2b-c45d-4d2e-817e-92fa619a958e service nova] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-13e102d7-ecbc-4bc8-8a8c-fbbd0d2a8d6c req-a44a3f2b-c45d-4d2e-817e-92fa619a958e service nova] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-13e102d7-ecbc-4bc8-8a8c-fbbd0d2a8d6c req-a44a3f2b-c45d-4d2e-817e-92fa619a958e service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] No waiting events found dispatching network-vif-plugged-135c6c26-00c9-4174-8b5d-51002185def1 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:07:38 user nova-compute[73469]: WARNING nova.compute.manager [req-13e102d7-ecbc-4bc8-8a8c-fbbd0d2a8d6c req-a44a3f2b-c45d-4d2e-817e-92fa619a958e service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Received unexpected event network-vif-plugged-135c6c26-00c9-4174-8b5d-51002185def1 for instance with vm_state building and task_state spawning.
Aug 22 03:07:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:40 user nova-compute[73469]: DEBUG nova.compute.manager [req-d65b7e1f-1f4f-4420-a7f7-fa22ae937949 req-e86ecacd-62f9-4556-b7b3-700d1ac46957 service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Received event network-vif-plugged-135c6c26-00c9-4174-8b5d-51002185def1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:07:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d65b7e1f-1f4f-4420-a7f7-fa22ae937949 req-e86ecacd-62f9-4556-b7b3-700d1ac46957 service nova] Acquiring lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d65b7e1f-1f4f-4420-a7f7-fa22ae937949 req-e86ecacd-62f9-4556-b7b3-700d1ac46957 service nova] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d65b7e1f-1f4f-4420-a7f7-fa22ae937949 req-e86ecacd-62f9-4556-b7b3-700d1ac46957 service nova] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:40 user nova-compute[73469]: DEBUG nova.compute.manager [req-d65b7e1f-1f4f-4420-a7f7-fa22ae937949 req-e86ecacd-62f9-4556-b7b3-700d1ac46957 service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] No waiting events found dispatching network-vif-plugged-135c6c26-00c9-4174-8b5d-51002185def1 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:07:40 user nova-compute[73469]: WARNING nova.compute.manager [req-d65b7e1f-1f4f-4420-a7f7-fa22ae937949 req-e86ecacd-62f9-4556-b7b3-700d1ac46957 service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Received unexpected event network-vif-plugged-135c6c26-00c9-4174-8b5d-51002185def1 for instance with vm_state building and task_state spawning.
Aug 22 03:07:40 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673660.2885718, a0a019bd-fadd-46cb-ac48-d47bfc263b0c => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:07:40 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] VM Resumed (Lifecycle Event)
Aug 22 03:07:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:07:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:07:40 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Instance spawned successfully.
Aug 22 03:07:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:07:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:07:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:07:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:07:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:07:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:07:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:07:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:07:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:07:40 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:07:40 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673660.2933586, a0a019bd-fadd-46cb-ac48-d47bfc263b0c => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:07:40 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] VM Started (Lifecycle Event)
Aug 22 03:07:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:07:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:07:40 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:07:40 user nova-compute[73469]: INFO nova.compute.manager [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Took 7.95 seconds to spawn the instance on the hypervisor.
Aug 22 03:07:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:07:40 user nova-compute[73469]: INFO nova.compute.manager [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Took 9.12 seconds to build instance.
Aug 22 03:07:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dec09e32-9d26-458b-b82e-ff5ac6ac90e1 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.224s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:43 user nova-compute[73469]: INFO nova.compute.manager [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Detaching volume 1072e618-4680-4f68-9c2e-dd56519d5661
Aug 22 03:07:43 user nova-compute[73469]: INFO nova.virt.block_device [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Attempting to driver detach volume 1072e618-4680-4f68-9c2e-dd56519d5661 from mountpoint /dev/vdb
Aug 22 03:07:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Attempting to detach device vdb from instance 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:07:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:07:43 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:07:43 user nova-compute[73469]:   <source dev="/dev/sdf"/>
Aug 22 03:07:43 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:07:43 user nova-compute[73469]:   <serial>1072e618-4680-4f68-9c2e-dd56519d5661</serial>
Aug 22 03:07:43 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 22 03:07:43 user nova-compute[73469]: </disk>
Aug 22 03:07:43 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:07:43 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Successfully detached device vdb from instance 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 from the persistent domain config.
Aug 22 03:07:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:07:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:07:43 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:07:43 user nova-compute[73469]:   <source dev="/dev/sdf"/>
Aug 22 03:07:43 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:07:43 user nova-compute[73469]:   <serial>1072e618-4680-4f68-9c2e-dd56519d5661</serial>
Aug 22 03:07:43 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 22 03:07:43 user nova-compute[73469]: </disk>
Aug 22 03:07:43 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:07:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "20316a2a-2f1f-4008-ab14-551e627bf680" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "20316a2a-2f1f-4008-ab14-551e627bf680" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:43 user nova-compute[73469]: INFO nova.compute.manager [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Terminating instance
Aug 22 03:07:43 user nova-compute[73469]: DEBUG nova.compute.manager [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692673664.249701, 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:07:44 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Successfully detached device vdb from instance 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 from the live domain config.
Aug 22 03:07:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qaAvDBNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:07:44 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:07:44 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e93a44-9f51-4563-82fc-5b0307d3540a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa898a9-a3a7-4e8c-bfb5-a6e5e0250a97]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:07:44 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:07:44 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:07:44 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:07:44 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:07:44 user nova-compute[73469]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 (non-flash)
Aug 22 03:07:44 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79806a4a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661'): ({'sdf'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Removing single pathed devices sdf {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8dc23c-6ec8-4442-beec-da8b25f6f484]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d44416e-8937-471b-b9e2-d2fdf61e068d]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Flushing IO for device /dev/sdf {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6761e9f3-fb72-4188-b9c4-e207452d1aa7]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG nova.compute.manager [req-9f83cb2f-1850-4b91-a925-b82729201a4c req-9aa47f7b-1b17-49f2-95b5-b38a0a5eb5cc service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received event network-vif-unplugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9f83cb2f-1850-4b91-a925-b82729201a4c req-9aa47f7b-1b17-49f2-95b5-b38a0a5eb5cc service nova] Acquiring lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9f83cb2f-1850-4b91-a925-b82729201a4c req-9aa47f7b-1b17-49f2-95b5-b38a0a5eb5cc service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9f83cb2f-1850-4b91-a925-b82729201a4c req-9aa47f7b-1b17-49f2-95b5-b38a0a5eb5cc service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG nova.compute.manager [req-9f83cb2f-1850-4b91-a925-b82729201a4c req-9aa47f7b-1b17-49f2-95b5-b38a0a5eb5cc service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] No waiting events found dispatching network-vif-unplugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG nova.compute.manager [req-9f83cb2f-1850-4b91-a925-b82729201a4c req-9aa47f7b-1b17-49f2-95b5-b38a0a5eb5cc service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received event network-vif-unplugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9e930a-f7b0-4cd6-b1fd-5dc3f7d58add]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] SCSI volumes sdf have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c5d1e5-a4c5-47c4-825a-3065d2805c6b]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d7c903-a197-4ce7-8d7a-217717cc6c1f]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661, portal: 172.16.0.220,3260]
Aug 22 03:07:44 user nova-compute[73469]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661, portal: 172.16.0.220,3260] successful.
Aug 22 03:07:44 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072e618-4680-4f68-9c2e-dd56519d5661 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ab4e96-7e94-457d-8631-2c68a35e7f2a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] <== disconnect_volume: return (358ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:44 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Instance destroyed successfully.
Aug 22 03:07:44 user nova-compute[73469]: DEBUG nova.objects.instance [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lazy-loading 'resources' on Instance uuid 20316a2a-2f1f-4008-ab14-551e627bf680 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1727070642',display_name='tempest-ServerStableDeviceRescueTest-server-1727070642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1727070642',id=21,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiFlw3K8uDuM14/olen5zZ3xxURmyCaloygS00hJxnTba04UwFxEPmyd3pqvFzE5IMeLVX+Gz0VhQsbsX4+RX+wUL04HnKgIab7U3aNj441PRpAzk5Ih/odplWzrEC+Lg==',key_name='tempest-keypair-1439006082',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:04:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ab77793ce9a4b85b90e3b7469daf58b',ramdisk_id='',reservation_id='r-68qh01zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-71202601',owner_user_name='tempest-ServerStableDeviceRescueTest-71202601-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab41a6128d3c49e89e5a2b3710eeea95',uuid=20316a2a-2f1f-4008-ab14-551e627bf680,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "address": "fa:16:3e:cf:fb:77", "network": {"id": "48051bc9-cc7d-4248-8077-3bd59a1cb474", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab77793ce9a4b85b90e3b7469daf58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3d6f3d-12", "ovs_interfaceid": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Converting VIF {"id": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "address": "fa:16:3e:cf:fb:77", "network": {"id": "48051bc9-cc7d-4248-8077-3bd59a1cb474", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1816877173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab77793ce9a4b85b90e3b7469daf58b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3d6f3d-12", "ovs_interfaceid": "8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:fb:77,bridge_name='br-int',has_traffic_filtering=True,id=8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8,network=Network(48051bc9-cc7d-4248-8077-3bd59a1cb474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a3d6f3d-12') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG os_vif [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:fb:77,bridge_name='br-int',has_traffic_filtering=True,id=8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8,network=Network(48051bc9-cc7d-4248-8077-3bd59a1cb474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a3d6f3d-12') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a3d6f3d-12, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:44 user nova-compute[73469]: INFO os_vif [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:fb:77,bridge_name='br-int',has_traffic_filtering=True,id=8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8,network=Network(48051bc9-cc7d-4248-8077-3bd59a1cb474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a3d6f3d-12')
Aug 22 03:07:44 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Deleting instance files /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680_del
Aug 22 03:07:44 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Deletion of /opt/stack/data/nova/instances/20316a2a-2f1f-4008-ab14-551e627bf680_del complete
Aug 22 03:07:44 user nova-compute[73469]: INFO nova.compute.manager [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 22 03:07:44 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:07:44 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:07:45 user nova-compute[73469]: DEBUG nova.objects.instance [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'flavor' on Instance uuid 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:07:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9a841192-91f5-4cd5-b31b-ca6a83dbc730 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.979s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:45 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:07:45 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Took 0.81 seconds to deallocate network for instance.
Aug 22 03:07:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-c0474b1d-74ee-4b73-a1c6-e8af848ea1d6 req-7e998de9-10bd-460a-a5c9-200dc22149e2 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received event network-vif-deleted-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:07:45 user nova-compute[73469]: INFO nova.compute.manager [req-c0474b1d-74ee-4b73-a1c6-e8af848ea1d6 req-7e998de9-10bd-460a-a5c9-200dc22149e2 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Neutron deleted interface 8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8; detaching it from the instance and deleting it from the info cache
Aug 22 03:07:45 user nova-compute[73469]: DEBUG nova.network.neutron [req-c0474b1d-74ee-4b73-a1c6-e8af848ea1d6 req-7e998de9-10bd-460a-a5c9-200dc22149e2 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:07:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-c0474b1d-74ee-4b73-a1c6-e8af848ea1d6 req-7e998de9-10bd-460a-a5c9-200dc22149e2 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Detach interface failed, port_id=8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8, reason: Instance 20316a2a-2f1f-4008-ab14-551e627bf680 could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 03:07:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:46 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:07:46 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:07:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:46 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Deleted allocations for instance 20316a2a-2f1f-4008-ab14-551e627bf680
Aug 22 03:07:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-687ef011-171c-46a2-ad93-be86c48f9d75 tempest-ServerStableDeviceRescueTest-71202601 tempest-ServerStableDeviceRescueTest-71202601-project-member] Lock "20316a2a-2f1f-4008-ab14-551e627bf680" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.361s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:46 user nova-compute[73469]: DEBUG nova.compute.manager [req-fe4fbf13-dd8a-4f40-9c7b-95ffb2ad9bb4 req-b0f11f38-99e8-4925-bbdd-1419219ee983 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received event network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:07:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fe4fbf13-dd8a-4f40-9c7b-95ffb2ad9bb4 req-b0f11f38-99e8-4925-bbdd-1419219ee983 service nova] Acquiring lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fe4fbf13-dd8a-4f40-9c7b-95ffb2ad9bb4 req-b0f11f38-99e8-4925-bbdd-1419219ee983 service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fe4fbf13-dd8a-4f40-9c7b-95ffb2ad9bb4 req-b0f11f38-99e8-4925-bbdd-1419219ee983 service nova] Lock "20316a2a-2f1f-4008-ab14-551e627bf680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:46 user nova-compute[73469]: DEBUG nova.compute.manager [req-fe4fbf13-dd8a-4f40-9c7b-95ffb2ad9bb4 req-b0f11f38-99e8-4925-bbdd-1419219ee983 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] No waiting events found dispatching network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:07:46 user nova-compute[73469]: WARNING nova.compute.manager [req-fe4fbf13-dd8a-4f40-9c7b-95ffb2ad9bb4 req-b0f11f38-99e8-4925-bbdd-1419219ee983 service nova] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Received unexpected event network-vif-plugged-8a3d6f3d-12eb-4721-b8a5-48c5e2d479c8 for instance with vm_state deleted and task_state None.
Aug 22 03:07:46 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:07:46 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:07:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "228b721b-c7c4-4994-b1be-28234ea6a4fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:46 user nova-compute[73469]: DEBUG nova.compute.manager [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:07:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:46 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:07:46 user nova-compute[73469]: INFO nova.compute.claims [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Claim successful on node user
Aug 22 03:07:47 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:07:47 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:07:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:07:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:07:47 user nova-compute[73469]: DEBUG nova.network.neutron [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:07:47 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:07:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:07:47 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:07:47 user nova-compute[73469]: DEBUG nova.policy [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25b830ec1451440f911d6578c8c55f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab150042073d4977b15414a3062d82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:07:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:07:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:07:47 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Creating image(s)
Aug 22 03:07:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "/opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "/opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "/opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.198s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.192s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk 1073741824" returned: 0 in 0.050s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.183s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Checking if we can resize image /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Cannot resize image /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG nova.objects.instance [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'migration_context' on Instance uuid 228b721b-c7c4-4994-b1be-28234ea6a4fd {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Ensure instance console log exists: /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-dc3f5545-8ebb-4947-97d0-98a91f67e421" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-dc3f5545-8ebb-4947-97d0-98a91f67e421" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:07:48 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:07:49 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Updating instance_info_cache with network_info: [{"id": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "address": "fa:16:3e:89:d7:b7", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ef805d-a4", "ovs_interfaceid": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:07:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-dc3f5545-8ebb-4947-97d0-98a91f67e421" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:07:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:07:49 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:07:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:49 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:07:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:07:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e43158b8-28fc-429c-b329-26be91761d4f/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e43158b8-28fc-429c-b329-26be91761d4f/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e43158b8-28fc-429c-b329-26be91761d4f/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e43158b8-28fc-429c-b329-26be91761d4f/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG nova.compute.manager [req-44266c71-feef-45ac-a1ae-d8d05dc93592 req-30131477-afbc-4fad-9b98-788db68ee9ab service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received event network-changed-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG nova.compute.manager [req-44266c71-feef-45ac-a1ae-d8d05dc93592 req-30131477-afbc-4fad-9b98-788db68ee9ab service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Refreshing instance network info cache due to event network-changed-866b90b8-9ca8-4235-9f79-45d13fc5f929. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-44266c71-feef-45ac-a1ae-d8d05dc93592 req-30131477-afbc-4fad-9b98-788db68ee9ab service nova] Acquiring lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-44266c71-feef-45ac-a1ae-d8d05dc93592 req-30131477-afbc-4fad-9b98-788db68ee9ab service nova] Acquired lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG nova.network.neutron [req-44266c71-feef-45ac-a1ae-d8d05dc93592 req-30131477-afbc-4fad-9b98-788db68ee9ab service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Refreshing network info cache for port 866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG nova.network.neutron [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Successfully created port: 3f62a12a-6902-4a55-986f-728b46db9fb7 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG nova.network.neutron [req-44266c71-feef-45ac-a1ae-d8d05dc93592 req-30131477-afbc-4fad-9b98-788db68ee9ab service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Updated VIF entry in instance network info cache for port 866b90b8-9ca8-4235-9f79-45d13fc5f929. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG nova.network.neutron [req-44266c71-feef-45ac-a1ae-d8d05dc93592 req-30131477-afbc-4fad-9b98-788db68ee9ab service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Updating instance_info_cache with network_info: [{"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-44266c71-feef-45ac-a1ae-d8d05dc93592 req-30131477-afbc-4fad-9b98-788db68ee9ab service nova] Releasing lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG nova.network.neutron [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Successfully updated port: 3f62a12a-6902-4a55-986f-728b46db9fb7 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:07:50 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "refresh_cache-228b721b-c7c4-4994-b1be-28234ea6a4fd" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquired lock "refresh_cache-228b721b-c7c4-4994-b1be-28234ea6a4fd" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.network.neutron [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.network.neutron [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.network.neutron [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Updating instance_info_cache with network_info: [{"id": "3f62a12a-6902-4a55-986f-728b46db9fb7", "address": "fa:16:3e:de:94:8a", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f62a12a-69", "ovs_interfaceid": "3f62a12a-6902-4a55-986f-728b46db9fb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Releasing lock "refresh_cache-228b721b-c7c4-4994-b1be-28234ea6a4fd" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.compute.manager [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Instance network_info: |[{"id": "3f62a12a-6902-4a55-986f-728b46db9fb7", "address": "fa:16:3e:de:94:8a", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f62a12a-69", "ovs_interfaceid": "3f62a12a-6902-4a55-986f-728b46db9fb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Start _get_guest_xml network_info=[{"id": "3f62a12a-6902-4a55-986f-728b46db9fb7", "address": "fa:16:3e:de:94:8a", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f62a12a-69", "ovs_interfaceid": "3f62a12a-6902-4a55-986f-728b46db9fb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:07:51 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:07:51 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1784410935',display_name='tempest-AttachVolumeNegativeTest-server-1784410935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1784410935',id=32,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbDdTYLqgIDj5qdnoVp64T6l6UgZkGmzuOJatV+bzm+O/Qd3dLAgzzy3ThnPfbcpJNAmvN0QBxTVXnO9i7z8hK/LV1zO2rBmqahIX5FXxkNTotOYk2mci8ENWvZxXcDcw==',key_name='tempest-keypair-615365274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab150042073d4977b15414a3062d82fd',ramdisk_id='',reservation_id='r-q18miie2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-356032718',owner_user_name='tempest-AttachVolumeNegativeTest-356032718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25b830ec1451440f911d6578c8c55f3d',uuid=228b721b-c7c4-4994-b1be-28234ea6a4fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f62a12a-6902-4a55-986f-728b46db9fb7", "address": "fa:16:3e:de:94:8a", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f62a12a-69", "ovs_interfaceid": "3f62a12a-6902-4a55-986f-728b46db9fb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converting VIF {"id": "3f62a12a-6902-4a55-986f-728b46db9fb7", "address": "fa:16:3e:de:94:8a", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f62a12a-69", "ovs_interfaceid": "3f62a12a-6902-4a55-986f-728b46db9fb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:94:8a,bridge_name='br-int',has_traffic_filtering=True,id=3f62a12a-6902-4a55-986f-728b46db9fb7,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f62a12a-69') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.objects.instance [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'pci_devices' on Instance uuid 228b721b-c7c4-4994-b1be-28234ea6a4fd {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:07:51 user nova-compute[73469]:   <uuid>228b721b-c7c4-4994-b1be-28234ea6a4fd</uuid>
Aug 22 03:07:51 user nova-compute[73469]:   <name>instance-00000020</name>
Aug 22 03:07:51 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:07:51 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:07:51 user nova-compute[73469]:   <metadata>
Aug 22 03:07:51 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:07:51 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:07:51 user nova-compute[73469]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1784410935</nova:name>
Aug 22 03:07:51 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:07:51</nova:creationTime>
Aug 22 03:07:51 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:07:51 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:07:51 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:07:51 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:07:51 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:07:51 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:07:51 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:07:51 user nova-compute[73469]:       <nova:owner>
Aug 22 03:07:51 user nova-compute[73469]:         <nova:user uuid="25b830ec1451440f911d6578c8c55f3d">tempest-AttachVolumeNegativeTest-356032718-project-member</nova:user>
Aug 22 03:07:51 user nova-compute[73469]:         <nova:project uuid="ab150042073d4977b15414a3062d82fd">tempest-AttachVolumeNegativeTest-356032718</nova:project>
Aug 22 03:07:51 user nova-compute[73469]:       </nova:owner>
Aug 22 03:07:51 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:07:51 user nova-compute[73469]:       <nova:ports>
Aug 22 03:07:51 user nova-compute[73469]:         <nova:port uuid="3f62a12a-6902-4a55-986f-728b46db9fb7">
Aug 22 03:07:51 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 22 03:07:51 user nova-compute[73469]:         </nova:port>
Aug 22 03:07:51 user nova-compute[73469]:       </nova:ports>
Aug 22 03:07:51 user nova-compute[73469]:     </nova:instance>
Aug 22 03:07:51 user nova-compute[73469]:   </metadata>
Aug 22 03:07:51 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:07:51 user nova-compute[73469]:     <system>
Aug 22 03:07:51 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:07:51 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:07:51 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:07:51 user nova-compute[73469]:       <entry name="serial">228b721b-c7c4-4994-b1be-28234ea6a4fd</entry>
Aug 22 03:07:51 user nova-compute[73469]:       <entry name="uuid">228b721b-c7c4-4994-b1be-28234ea6a4fd</entry>
Aug 22 03:07:51 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:07:51 user nova-compute[73469]:     </system>
Aug 22 03:07:51 user nova-compute[73469]:   </sysinfo>
Aug 22 03:07:51 user nova-compute[73469]:   <os>
Aug 22 03:07:51 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:07:51 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:07:51 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:07:51 user nova-compute[73469]:   </os>
Aug 22 03:07:51 user nova-compute[73469]:   <features>
Aug 22 03:07:51 user nova-compute[73469]:     <acpi/>
Aug 22 03:07:51 user nova-compute[73469]:     <apic/>
Aug 22 03:07:51 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:07:51 user nova-compute[73469]:   </features>
Aug 22 03:07:51 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:07:51 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:07:51 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:07:51 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:07:51 user nova-compute[73469]:   </clock>
Aug 22 03:07:51 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:07:51 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:07:51 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:07:51 user nova-compute[73469]:   </cpu>
Aug 22 03:07:51 user nova-compute[73469]:   <devices>
Aug 22 03:07:51 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:07:51 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:07:51 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk"/>
Aug 22 03:07:51 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:07:51 user nova-compute[73469]:     </disk>
Aug 22 03:07:51 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:07:51 user nova-compute[73469]:       <mac address="fa:16:3e:de:94:8a"/>
Aug 22 03:07:51 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:07:51 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:07:51 user nova-compute[73469]:       <target dev="tap3f62a12a-69"/>
Aug 22 03:07:51 user nova-compute[73469]:     </interface>
Aug 22 03:07:51 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:07:51 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/console.log" append="off"/>
Aug 22 03:07:51 user nova-compute[73469]:     </serial>
Aug 22 03:07:51 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:07:51 user nova-compute[73469]:     <video>
Aug 22 03:07:51 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:07:51 user nova-compute[73469]:     </video>
Aug 22 03:07:51 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:07:51 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:07:51 user nova-compute[73469]:     </rng>
Aug 22 03:07:51 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:07:51 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:07:51 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:07:51 user nova-compute[73469]:     </memballoon>
Aug 22 03:07:51 user nova-compute[73469]:   </devices>
Aug 22 03:07:51 user nova-compute[73469]: </domain>
Aug 22 03:07:51 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1784410935',display_name='tempest-AttachVolumeNegativeTest-server-1784410935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1784410935',id=32,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbDdTYLqgIDj5qdnoVp64T6l6UgZkGmzuOJatV+bzm+O/Qd3dLAgzzy3ThnPfbcpJNAmvN0QBxTVXnO9i7z8hK/LV1zO2rBmqahIX5FXxkNTotOYk2mci8ENWvZxXcDcw==',key_name='tempest-keypair-615365274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab150042073d4977b15414a3062d82fd',ramdisk_id='',reservation_id='r-q18miie2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-356032718',owner_user_name='tempest-AttachVolumeNegativeTest-356032718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25b830ec1451440f911d6578c8c55f3d',uuid=228b721b-c7c4-4994-b1be-28234ea6a4fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f62a12a-6902-4a55-986f-728b46db9fb7", "address": "fa:16:3e:de:94:8a", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f62a12a-69", "ovs_interfaceid": "3f62a12a-6902-4a55-986f-728b46db9fb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converting VIF {"id": "3f62a12a-6902-4a55-986f-728b46db9fb7", "address": "fa:16:3e:de:94:8a", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f62a12a-69", "ovs_interfaceid": "3f62a12a-6902-4a55-986f-728b46db9fb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:94:8a,bridge_name='br-int',has_traffic_filtering=True,id=3f62a12a-6902-4a55-986f-728b46db9fb7,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f62a12a-69') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG os_vif [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:94:8a,bridge_name='br-int',has_traffic_filtering=True,id=3f62a12a-6902-4a55-986f-728b46db9fb7,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f62a12a-69') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f62a12a-69, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3f62a12a-69, col_values=(('external_ids', {'iface-id': '3f62a12a-6902-4a55-986f-728b46db9fb7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:94:8a', 'vm-uuid': '228b721b-c7c4-4994-b1be-28234ea6a4fd'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:51 user nova-compute[73469]: INFO os_vif [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:94:8a,bridge_name='br-int',has_traffic_filtering=True,id=3f62a12a-6902-4a55-986f-728b46db9fb7,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f62a12a-69')
Aug 22 03:07:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] No VIF found with MAC fa:16:3e:de:94:8a, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:52 user nova-compute[73469]: DEBUG nova.compute.manager [req-d45d493d-3f93-4c2b-9bfd-db074565aa60 req-a2ad2d0f-6542-4881-b1e6-eba4012644ba service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Received event network-changed-3f62a12a-6902-4a55-986f-728b46db9fb7 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:07:52 user nova-compute[73469]: DEBUG nova.compute.manager [req-d45d493d-3f93-4c2b-9bfd-db074565aa60 req-a2ad2d0f-6542-4881-b1e6-eba4012644ba service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Refreshing instance network info cache due to event network-changed-3f62a12a-6902-4a55-986f-728b46db9fb7. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:07:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d45d493d-3f93-4c2b-9bfd-db074565aa60 req-a2ad2d0f-6542-4881-b1e6-eba4012644ba service nova] Acquiring lock "refresh_cache-228b721b-c7c4-4994-b1be-28234ea6a4fd" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:07:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d45d493d-3f93-4c2b-9bfd-db074565aa60 req-a2ad2d0f-6542-4881-b1e6-eba4012644ba service nova] Acquired lock "refresh_cache-228b721b-c7c4-4994-b1be-28234ea6a4fd" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:07:52 user nova-compute[73469]: DEBUG nova.network.neutron [req-d45d493d-3f93-4c2b-9bfd-db074565aa60 req-a2ad2d0f-6542-4881-b1e6-eba4012644ba service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Refreshing network info cache for port 3f62a12a-6902-4a55-986f-728b46db9fb7 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:07:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:52 user nova-compute[73469]: DEBUG nova.network.neutron [req-d45d493d-3f93-4c2b-9bfd-db074565aa60 req-a2ad2d0f-6542-4881-b1e6-eba4012644ba service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Updated VIF entry in instance network info cache for port 3f62a12a-6902-4a55-986f-728b46db9fb7. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:07:52 user nova-compute[73469]: DEBUG nova.network.neutron [req-d45d493d-3f93-4c2b-9bfd-db074565aa60 req-a2ad2d0f-6542-4881-b1e6-eba4012644ba service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Updating instance_info_cache with network_info: [{"id": "3f62a12a-6902-4a55-986f-728b46db9fb7", "address": "fa:16:3e:de:94:8a", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f62a12a-69", "ovs_interfaceid": "3f62a12a-6902-4a55-986f-728b46db9fb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:07:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d45d493d-3f93-4c2b-9bfd-db074565aa60 req-a2ad2d0f-6542-4881-b1e6-eba4012644ba service nova] Releasing lock "refresh_cache-228b721b-c7c4-4994-b1be-28234ea6a4fd" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:07:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:53 user nova-compute[73469]: DEBUG nova.compute.manager [req-43674523-671d-4e5e-83e9-c97dc68511ed req-38d07f1d-7bae-4e60-a65e-48c120af8da4 service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Received event network-vif-plugged-3f62a12a-6902-4a55-986f-728b46db9fb7 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:07:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-43674523-671d-4e5e-83e9-c97dc68511ed req-38d07f1d-7bae-4e60-a65e-48c120af8da4 service nova] Acquiring lock "228b721b-c7c4-4994-b1be-28234ea6a4fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-43674523-671d-4e5e-83e9-c97dc68511ed req-38d07f1d-7bae-4e60-a65e-48c120af8da4 service nova] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-43674523-671d-4e5e-83e9-c97dc68511ed req-38d07f1d-7bae-4e60-a65e-48c120af8da4 service nova] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:53 user nova-compute[73469]: DEBUG nova.compute.manager [req-43674523-671d-4e5e-83e9-c97dc68511ed req-38d07f1d-7bae-4e60-a65e-48c120af8da4 service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] No waiting events found dispatching network-vif-plugged-3f62a12a-6902-4a55-986f-728b46db9fb7 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:07:53 user nova-compute[73469]: WARNING nova.compute.manager [req-43674523-671d-4e5e-83e9-c97dc68511ed req-38d07f1d-7bae-4e60-a65e-48c120af8da4 service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Received unexpected event network-vif-plugged-3f62a12a-6902-4a55-986f-728b46db9fb7 for instance with vm_state building and task_state spawning.
Aug 22 03:07:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:55 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673675.597397, 228b721b-c7c4-4994-b1be-28234ea6a4fd => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:07:55 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] VM Resumed (Lifecycle Event)
Aug 22 03:07:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-77fa7f80-e175-445b-811f-58dc6686c728 req-6ca3a812-88d0-451c-b863-325354f5ce3b service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Received event network-vif-plugged-3f62a12a-6902-4a55-986f-728b46db9fb7 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:07:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-77fa7f80-e175-445b-811f-58dc6686c728 req-6ca3a812-88d0-451c-b863-325354f5ce3b service nova] Acquiring lock "228b721b-c7c4-4994-b1be-28234ea6a4fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-77fa7f80-e175-445b-811f-58dc6686c728 req-6ca3a812-88d0-451c-b863-325354f5ce3b service nova] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-77fa7f80-e175-445b-811f-58dc6686c728 req-6ca3a812-88d0-451c-b863-325354f5ce3b service nova] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-77fa7f80-e175-445b-811f-58dc6686c728 req-6ca3a812-88d0-451c-b863-325354f5ce3b service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] No waiting events found dispatching network-vif-plugged-3f62a12a-6902-4a55-986f-728b46db9fb7 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:07:55 user nova-compute[73469]: WARNING nova.compute.manager [req-77fa7f80-e175-445b-811f-58dc6686c728 req-6ca3a812-88d0-451c-b863-325354f5ce3b service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Received unexpected event network-vif-plugged-3f62a12a-6902-4a55-986f-728b46db9fb7 for instance with vm_state building and task_state spawning.
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:56 user nova-compute[73469]: INFO nova.compute.manager [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Shelving
Aug 22 03:07:56 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Instance spawned successfully.
Aug 22 03:07:56 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:07:56 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=7026MB free_disk=24.98700714111328GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:07:56 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673675.5987961, 228b721b-c7c4-4994-b1be-28234ea6a4fd => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:07:56 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] VM Started (Lifecycle Event)
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:56 user nova-compute[73469]: INFO nova.compute.manager [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Took 8.58 seconds to spawn the instance on the hypervisor.
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:56 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:07:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:56 user nova-compute[73469]: INFO nova.compute.manager [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Terminating instance
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:56 user nova-compute[73469]: INFO nova.compute.manager [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Took 9.41 seconds to build instance.
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d0668c0-7a49-4857-9b69-541021f18ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance dc3f5545-8ebb-4947-97d0-98a91f67e421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8242cec1-3b35-4d14-9e0b-db8a7e75697d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82e872a7-70b0-4290-9a11-5316765aed01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 980e57bf-dec9-46f3-8d69-e20a17603af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance e43158b8-28fc-429c-b329-26be91761d4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 149b34df-3d3c-48fc-99f2-0c3dc4334b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a7e95a46-9a75-4b0c-a5c9-42ed521668a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a0a019bd-fadd-46cb-ac48-d47bfc263b0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 228b721b-c7c4-4994-b1be-28234ea6a4fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-7309308b-1e9f-4a65-b1a2-4141fa9ec04c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.557s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.manager [req-e1bf1a8f-d0c8-421b-906d-b89c4edc70a6 req-343c8b43-a9f0-4df5-bb07-e4a8676badbb service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received event network-vif-unplugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e1bf1a8f-d0c8-421b-906d-b89c4edc70a6 req-343c8b43-a9f0-4df5-bb07-e4a8676badbb service nova] Acquiring lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e1bf1a8f-d0c8-421b-906d-b89c4edc70a6 req-343c8b43-a9f0-4df5-bb07-e4a8676badbb service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e1bf1a8f-d0c8-421b-906d-b89c4edc70a6 req-343c8b43-a9f0-4df5-bb07-e4a8676badbb service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.manager [req-e1bf1a8f-d0c8-421b-906d-b89c4edc70a6 req-343c8b43-a9f0-4df5-bb07-e4a8676badbb service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] No waiting events found dispatching network-vif-unplugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.manager [req-e1bf1a8f-d0c8-421b-906d-b89c4edc70a6 req-343c8b43-a9f0-4df5-bb07-e4a8676badbb service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received event network-vif-unplugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.807s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:57 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Instance destroyed successfully.
Aug 22 03:07:57 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Instance destroyed successfully.
Aug 22 03:07:57 user nova-compute[73469]: DEBUG nova.objects.instance [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'resources' on Instance uuid f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1462217807',display_name='tempest-ServerRescueNegativeTestJSON-server-1462217807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1462217807',id=23,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXw+HABhLBLO82NaXM+wYITZ8kjjO4fDBfHrNaHircMbmq0ESPsalj62yNCub693ZB2AUl++bx/zlIxp/KOGwsJTgZa2DcddLoD4LicVmrTqVCS4jc8imCsGBLvay+cPA==',key_name='tempest-keypair-188206931',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:03:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46cd52eb0f2642bc95dbf216ae280e12',ramdisk_id='',reservation_id='r-3dwgg99t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2020570120',owner_user_name='tempest-ServerRescueNegativeTestJSON-2020570120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64b023ffba814ac5b6a3bc4666107767',uuid=f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "address": "fa:16:3e:63:38:91", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e4e29-61", "ovs_interfaceid": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converting VIF {"id": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "address": "fa:16:3e:63:38:91", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e4e29-61", "ovs_interfaceid": "a64e4e29-61af-465a-8dc2-b8851274e0d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:38:91,bridge_name='br-int',has_traffic_filtering=True,id=a64e4e29-61af-465a-8dc2-b8851274e0d9,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64e4e29-61') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG os_vif [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:38:91,bridge_name='br-int',has_traffic_filtering=True,id=a64e4e29-61af-465a-8dc2-b8851274e0d9,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64e4e29-61') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa64e4e29-61, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:57 user nova-compute[73469]: INFO os_vif [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:38:91,bridge_name='br-int',has_traffic_filtering=True,id=a64e4e29-61af-465a-8dc2-b8851274e0d9,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64e4e29-61')
Aug 22 03:07:57 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Deleting instance files /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76_del
Aug 22 03:07:57 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Deletion of /opt/stack/data/nova/instances/f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76_del complete
Aug 22 03:07:57 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Beginning cold snapshot process
Aug 22 03:07:57 user nova-compute[73469]: DEBUG nova.compute.manager [req-6ebce535-d202-449c-89e4-94f79fffb89f req-28b03406-ea53-442e-a4e2-ac1f656fc793 service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received event network-vif-unplugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6ebce535-d202-449c-89e4-94f79fffb89f req-28b03406-ea53-442e-a4e2-ac1f656fc793 service nova] Acquiring lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6ebce535-d202-449c-89e4-94f79fffb89f req-28b03406-ea53-442e-a4e2-ac1f656fc793 service nova] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6ebce535-d202-449c-89e4-94f79fffb89f req-28b03406-ea53-442e-a4e2-ac1f656fc793 service nova] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG nova.compute.manager [req-6ebce535-d202-449c-89e4-94f79fffb89f req-28b03406-ea53-442e-a4e2-ac1f656fc793 service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] No waiting events found dispatching network-vif-unplugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:07:57 user nova-compute[73469]: WARNING nova.compute.manager [req-6ebce535-d202-449c-89e4-94f79fffb89f req-28b03406-ea53-442e-a4e2-ac1f656fc793 service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received unexpected event network-vif-unplugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 for instance with vm_state active and task_state shelving.
Aug 22 03:07:57 user nova-compute[73469]: DEBUG nova.compute.manager [req-6ebce535-d202-449c-89e4-94f79fffb89f req-28b03406-ea53-442e-a4e2-ac1f656fc793 service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received event network-vif-plugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6ebce535-d202-449c-89e4-94f79fffb89f req-28b03406-ea53-442e-a4e2-ac1f656fc793 service nova] Acquiring lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6ebce535-d202-449c-89e4-94f79fffb89f req-28b03406-ea53-442e-a4e2-ac1f656fc793 service nova] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6ebce535-d202-449c-89e4-94f79fffb89f req-28b03406-ea53-442e-a4e2-ac1f656fc793 service nova] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG nova.compute.manager [req-6ebce535-d202-449c-89e4-94f79fffb89f req-28b03406-ea53-442e-a4e2-ac1f656fc793 service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] No waiting events found dispatching network-vif-plugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:07:57 user nova-compute[73469]: WARNING nova.compute.manager [req-6ebce535-d202-449c-89e4-94f79fffb89f req-28b03406-ea53-442e-a4e2-ac1f656fc793 service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received unexpected event network-vif-plugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 for instance with vm_state active and task_state shelving.
Aug 22 03:07:57 user nova-compute[73469]: INFO nova.compute.manager [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 22 03:07:57 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG nova.privsep.utils [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk /opt/stack/data/nova/instances/snapshots/tmpo4n28cbq/0752a76f803046938f9b1f18a192572f {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:07:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:07:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:07:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk /opt/stack/data/nova/instances/snapshots/tmpo4n28cbq/0752a76f803046938f9b1f18a192572f" returned: 0 in 1.017s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:07:58 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Snapshot extracted, beginning image upload
Aug 22 03:07:58 user nova-compute[73469]: DEBUG nova.compute.manager [req-d553f274-3016-4031-aea3-c5a9f9335c4c req-1d912009-219c-41a1-bff6-d3d543976ecd service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received event network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:07:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d553f274-3016-4031-aea3-c5a9f9335c4c req-1d912009-219c-41a1-bff6-d3d543976ecd service nova] Acquiring lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d553f274-3016-4031-aea3-c5a9f9335c4c req-1d912009-219c-41a1-bff6-d3d543976ecd service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d553f274-3016-4031-aea3-c5a9f9335c4c req-1d912009-219c-41a1-bff6-d3d543976ecd service nova] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:58 user nova-compute[73469]: DEBUG nova.compute.manager [req-d553f274-3016-4031-aea3-c5a9f9335c4c req-1d912009-219c-41a1-bff6-d3d543976ecd service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] No waiting events found dispatching network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:07:58 user nova-compute[73469]: WARNING nova.compute.manager [req-d553f274-3016-4031-aea3-c5a9f9335c4c req-1d912009-219c-41a1-bff6-d3d543976ecd service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received unexpected event network-vif-plugged-a64e4e29-61af-465a-8dc2-b8851274e0d9 for instance with vm_state active and task_state deleting.
Aug 22 03:07:58 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:07:58 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Took 1.45 seconds to deallocate network for instance.
Aug 22 03:07:58 user nova-compute[73469]: DEBUG nova.compute.manager [req-298e4f2b-47a7-473c-aac2-407fdcf3327a req-cf0b80a5-2dae-4f03-b2b2-763073e9211f service nova] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Received event network-vif-deleted-a64e4e29-61af-465a-8dc2-b8851274e0d9 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:07:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:07:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:07:59 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:07:59 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:07:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.550s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:59 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Deleted allocations for instance f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76
Aug 22 03:07:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-efbe1b60-b5ca-41c4-aee5-09e890f3f599 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.385s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:07:59 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673664.7348077, 20316a2a-2f1f-4008-ab14-551e627bf680 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:07:59 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] VM Stopped (Lifecycle Event)
Aug 22 03:07:59 user nova-compute[73469]: DEBUG nova.compute.manager [None req-a4e3d554-bb10-439a-b805-77226d2fee7e None None] [instance: 20316a2a-2f1f-4008-ab14-551e627bf680] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:08:01 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Snapshot image upload complete
Aug 22 03:08:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:08:01 user nova-compute[73469]: INFO nova.compute.manager [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Shelve offloading
Aug 22 03:08:01 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Instance destroyed successfully.
Aug 22 03:08:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:08:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:08:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquired lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:08:01 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:08:01 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Updating instance_info_cache with network_info: [{"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:08:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Releasing lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:08:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:02 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Instance destroyed successfully.
Aug 22 03:08:02 user nova-compute[73469]: DEBUG nova.objects.instance [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'resources' on Instance uuid 149b34df-3d3c-48fc-99f2-0c3dc4334b1b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:08:02 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-497177608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-497177608',id=29,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI0YlC0MdxkVUSO81PLfgms40a6G6QD6YfZDORCvcGREtqMCzN/af47ygJmaqeEDyH5JKafVWBVdlK5rvd3tumDct1g36YoiSCIhWA6MhiAMlbCo9hRSMDY7Uq4rNNh/w==',key_name='tempest-keypair-884872358',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:06:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ca3e1f2f72c7497ca3ad923a4b9459dc',ramdisk_id='',reservation_id='r-rzj24vpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-774227889',owner_user_name='tempest-AttachVolumeShelveTestJSON-774227889-project-member',shelved_at='2023-08-22T03:08:01.295211',shelved_host='user',shelved_image_id='1fc40bce-0ff4-4757-b125-885091ae7955'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41e697cd5e5f422f8ac90f7496f60936',uuid=149b34df-3d3c-48fc-99f2-0c3dc4334b1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:08:02 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converting VIF {"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:08:02 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:58,bridge_name='br-int',has_traffic_filtering=True,id=866b90b8-9ca8-4235-9f79-45d13fc5f929,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b90b8-9c') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:08:02 user nova-compute[73469]: DEBUG os_vif [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:58,bridge_name='br-int',has_traffic_filtering=True,id=866b90b8-9ca8-4235-9f79-45d13fc5f929,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b90b8-9c') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:08:02 user nova-compute[73469]: DEBUG nova.compute.manager [req-114d7b87-a75d-49fd-919c-f72149f9a28b req-b5606472-3ceb-41c5-870b-ab1243ece346 service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received event network-changed-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:08:02 user nova-compute[73469]: DEBUG nova.compute.manager [req-114d7b87-a75d-49fd-919c-f72149f9a28b req-b5606472-3ceb-41c5-870b-ab1243ece346 service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Refreshing instance network info cache due to event network-changed-866b90b8-9ca8-4235-9f79-45d13fc5f929. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:08:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-114d7b87-a75d-49fd-919c-f72149f9a28b req-b5606472-3ceb-41c5-870b-ab1243ece346 service nova] Acquiring lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:08:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-114d7b87-a75d-49fd-919c-f72149f9a28b req-b5606472-3ceb-41c5-870b-ab1243ece346 service nova] Acquired lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:08:02 user nova-compute[73469]: DEBUG nova.network.neutron [req-114d7b87-a75d-49fd-919c-f72149f9a28b req-b5606472-3ceb-41c5-870b-ab1243ece346 service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Refreshing network info cache for port 866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:08:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap866b90b8-9c, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:08:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:08:02 user nova-compute[73469]: INFO os_vif [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:58,bridge_name='br-int',has_traffic_filtering=True,id=866b90b8-9ca8-4235-9f79-45d13fc5f929,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b90b8-9c')
Aug 22 03:08:02 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Deleting instance files /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b_del
Aug 22 03:08:02 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Deletion of /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b_del complete
Aug 22 03:08:02 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Deleted allocations for instance 149b34df-3d3c-48fc-99f2-0c3dc4334b1b
Aug 22 03:08:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:08:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:08:02 user nova-compute[73469]: DEBUG nova.objects.instance [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'numa_topology' on Instance uuid 149b34df-3d3c-48fc-99f2-0c3dc4334b1b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:08:03 user nova-compute[73469]: DEBUG nova.network.neutron [req-114d7b87-a75d-49fd-919c-f72149f9a28b req-b5606472-3ceb-41c5-870b-ab1243ece346 service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Updated VIF entry in instance network info cache for port 866b90b8-9ca8-4235-9f79-45d13fc5f929. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:08:03 user nova-compute[73469]: DEBUG nova.network.neutron [req-114d7b87-a75d-49fd-919c-f72149f9a28b req-b5606472-3ceb-41c5-870b-ab1243ece346 service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Updating instance_info_cache with network_info: [{"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap866b90b8-9c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:08:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-114d7b87-a75d-49fd-919c-f72149f9a28b req-b5606472-3ceb-41c5-870b-ab1243ece346 service nova] Releasing lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:08:03 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:08:03 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:08:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6278bdb4-8b33-47d7-aaff-7e7b3ded127c tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.429s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:12 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673677.2639253, 149b34df-3d3c-48fc-99f2-0c3dc4334b1b => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:08:12 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] VM Stopped (Lifecycle Event)
Aug 22 03:08:12 user nova-compute[73469]: DEBUG nova.compute.manager [None req-3391d834-facf-413c-b478-4c63ddb8aa2f None None] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:08:12 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673677.3023958, f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:08:12 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] VM Stopped (Lifecycle Event)
Aug 22 03:08:12 user nova-compute[73469]: DEBUG nova.compute.manager [None req-856fec8f-ad30-49b1-bfb7-98441e7d5bc9 None None] [instance: f1955c3d-e7c4-4d14-8457-d9e2ab3cbe76] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:08:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquiring lock "b5525c10-e097-4214-ad4f-7b3afcf53483" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:08:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "b5525c10-e097-4214-ad4f-7b3afcf53483" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:08:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:08:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:08:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:08:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:08:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:33 user nova-compute[73469]: INFO nova.compute.manager [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Terminating instance
Aug 22 03:08:33 user nova-compute[73469]: DEBUG nova.compute.manager [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:08:33 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:08:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:08:34 user nova-compute[73469]: INFO nova.compute.claims [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Claim successful on node user
Aug 22 03:08:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-9a5ddc1f-5116-488e-ad45-f964250c24c5 req-966ad892-6ac7-4dce-945c-97810e258daa service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Received event network-vif-unplugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9a5ddc1f-5116-488e-ad45-f964250c24c5 req-966ad892-6ac7-4dce-945c-97810e258daa service nova] Acquiring lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9a5ddc1f-5116-488e-ad45-f964250c24c5 req-966ad892-6ac7-4dce-945c-97810e258daa service nova] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9a5ddc1f-5116-488e-ad45-f964250c24c5 req-966ad892-6ac7-4dce-945c-97810e258daa service nova] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-9a5ddc1f-5116-488e-ad45-f964250c24c5 req-966ad892-6ac7-4dce-945c-97810e258daa service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] No waiting events found dispatching network-vif-unplugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-9a5ddc1f-5116-488e-ad45-f964250c24c5 req-966ad892-6ac7-4dce-945c-97810e258daa service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Received event network-vif-unplugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:08:34 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Instance destroyed successfully.
Aug 22 03:08:34 user nova-compute[73469]: DEBUG nova.objects.instance [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'resources' on Instance uuid 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-22T03:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-390626074',display_name='tempest-ServerActionsTestOtherA-server-1950378600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-390626074',id=26,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzECYecqxKAclQ13djaYo4aP+GCuiMQsT7a2vxvloQrNEucWhpndrbmJM02phQQyzEVLxT8xdS0cQ40404Hf+pU7LkGlE/TIncY5ZMIWkzlf47Mxz0eWcSZbF35ZQNuTQ==',key_name='tempest-keypair-1030511610',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d1c312e979e47558b06d4fa70bc103a',ramdisk_id='',reservation_id='r-iptnxvlr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1751677379',owner_user_name='tempest-ServerActionsTestOtherA-1751677379-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:05:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b47d6cefd0d4949bf4c3c0fc72a9cd5',uuid=8a34f0c2-c0b0-4ba7-b9e4-673350a81646,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "address": "fa:16:3e:ea:7d:48", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f995853-c3", "ovs_interfaceid": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converting VIF {"id": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "address": "fa:16:3e:ea:7d:48", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f995853-c3", "ovs_interfaceid": "1f995853-c3f9-41c7-a27b-bf970a21b2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=1f995853-c3f9-41c7-a27b-bf970a21b2b1,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f995853-c3') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG os_vif [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=1f995853-c3f9-41c7-a27b-bf970a21b2b1,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f995853-c3') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f995853-c3, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:08:34 user nova-compute[73469]: INFO os_vif [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:7d:48,bridge_name='br-int',has_traffic_filtering=True,id=1f995853-c3f9-41c7-a27b-bf970a21b2b1,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f995853-c3')
Aug 22 03:08:34 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Deleting instance files /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646_del
Aug 22 03:08:34 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Deletion of /opt/stack/data/nova/instances/8a34f0c2-c0b0-4ba7-b9e4-673350a81646_del complete
Aug 22 03:08:34 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:08:34 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:08:34 user nova-compute[73469]: INFO nova.compute.manager [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 22 03:08:34 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG nova.policy [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '635f762a1488400fa57a6a9e244ddb42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec2ad0547114410a036090a792d0645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:08:34 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Creating image(s)
Aug 22 03:08:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "/opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "/opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.172s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:08:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.179s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/disk 1073741824" returned: 0 in 0.054s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.179s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:08:35 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Took 0.86 seconds to deallocate network for instance.
Aug 22 03:08:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-29f641f8-1f44-4ff7-832d-1a7eebb92cbf req-f4a62ada-081a-4e42-a89a-bf5f97cbcda1 service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Received event network-vif-deleted-1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Cannot resize image /opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG nova.objects.instance [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lazy-loading 'migration_context' on Instance uuid b5525c10-e097-4214-ad4f-7b3afcf53483 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Ensure instance console log exists: /opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Successfully created port: 143adaa4-b7f9-4648-9224-1eb631e8120b {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:08:35 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:08:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:36 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Deleted allocations for instance 8a34f0c2-c0b0-4ba7-b9e4-673350a81646
Aug 22 03:08:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-35cf4918-a235-47ad-97a0-8f50f869a601 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.233s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-e73b7180-7acd-4829-8106-8a8dd4034d6b req-33670f4b-3b64-4067-b939-e3407da57cd3 service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Received event network-vif-plugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:08:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e73b7180-7acd-4829-8106-8a8dd4034d6b req-33670f4b-3b64-4067-b939-e3407da57cd3 service nova] Acquiring lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:08:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e73b7180-7acd-4829-8106-8a8dd4034d6b req-33670f4b-3b64-4067-b939-e3407da57cd3 service nova] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:08:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e73b7180-7acd-4829-8106-8a8dd4034d6b req-33670f4b-3b64-4067-b939-e3407da57cd3 service nova] Lock "8a34f0c2-c0b0-4ba7-b9e4-673350a81646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-e73b7180-7acd-4829-8106-8a8dd4034d6b req-33670f4b-3b64-4067-b939-e3407da57cd3 service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] No waiting events found dispatching network-vif-plugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:08:36 user nova-compute[73469]: WARNING nova.compute.manager [req-e73b7180-7acd-4829-8106-8a8dd4034d6b req-33670f4b-3b64-4067-b939-e3407da57cd3 service nova] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Received unexpected event network-vif-plugged-1f995853-c3f9-41c7-a27b-bf970a21b2b1 for instance with vm_state deleted and task_state None.
Aug 22 03:08:36 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Successfully updated port: 143adaa4-b7f9-4648-9224-1eb631e8120b {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:08:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquiring lock "refresh_cache-b5525c10-e097-4214-ad4f-7b3afcf53483" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:08:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquired lock "refresh_cache-b5525c10-e097-4214-ad4f-7b3afcf53483" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:08:36 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:08:36 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Updating instance_info_cache with network_info: [{"id": "143adaa4-b7f9-4648-9224-1eb631e8120b", "address": "fa:16:3e:a4:3c:33", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143adaa4-b7", "ovs_interfaceid": "143adaa4-b7f9-4648-9224-1eb631e8120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Releasing lock "refresh_cache-b5525c10-e097-4214-ad4f-7b3afcf53483" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Instance network_info: |[{"id": "143adaa4-b7f9-4648-9224-1eb631e8120b", "address": "fa:16:3e:a4:3c:33", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143adaa4-b7", "ovs_interfaceid": "143adaa4-b7f9-4648-9224-1eb631e8120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Start _get_guest_xml network_info=[{"id": "143adaa4-b7f9-4648-9224-1eb631e8120b", "address": "fa:16:3e:a4:3c:33", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143adaa4-b7", "ovs_interfaceid": "143adaa4-b7f9-4648-9224-1eb631e8120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:08:37 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:08:37 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:08:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1653739734',display_name='tempest-ServersNegativeTestJSON-server-1653739734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1653739734',id=33,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cec2ad0547114410a036090a792d0645',ramdisk_id='',reservation_id='r-wk1j4f64',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1709480953',owner_user_name='tempest-ServersNegativeTestJSON-1709480953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:08:35Z,user_data=None,user_id='635f762a1488400fa57a6a9e244ddb42',uuid=b5525c10-e097-4214-ad4f-7b3afcf53483,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "143adaa4-b7f9-4648-9224-1eb631e8120b", "address": "fa:16:3e:a4:3c:33", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143adaa4-b7", "ovs_interfaceid": "143adaa4-b7f9-4648-9224-1eb631e8120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Converting VIF {"id": "143adaa4-b7f9-4648-9224-1eb631e8120b", "address": "fa:16:3e:a4:3c:33", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143adaa4-b7", "ovs_interfaceid": "143adaa4-b7f9-4648-9224-1eb631e8120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3c:33,bridge_name='br-int',has_traffic_filtering=True,id=143adaa4-b7f9-4648-9224-1eb631e8120b,network=Network(b1119133-216d-41a0-b227-d1e9e4aed153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143adaa4-b7') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.objects.instance [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lazy-loading 'pci_devices' on Instance uuid b5525c10-e097-4214-ad4f-7b3afcf53483 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:08:37 user nova-compute[73469]:   <uuid>b5525c10-e097-4214-ad4f-7b3afcf53483</uuid>
Aug 22 03:08:37 user nova-compute[73469]:   <name>instance-00000021</name>
Aug 22 03:08:37 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:08:37 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:08:37 user nova-compute[73469]:   <metadata>
Aug 22 03:08:37 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:08:37 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:08:37 user nova-compute[73469]:       <nova:name>tempest-ServersNegativeTestJSON-server-1653739734</nova:name>
Aug 22 03:08:37 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:08:37</nova:creationTime>
Aug 22 03:08:37 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:08:37 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:08:37 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:08:37 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:08:37 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:08:37 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:08:37 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:08:37 user nova-compute[73469]:       <nova:owner>
Aug 22 03:08:37 user nova-compute[73469]:         <nova:user uuid="635f762a1488400fa57a6a9e244ddb42">tempest-ServersNegativeTestJSON-1709480953-project-member</nova:user>
Aug 22 03:08:37 user nova-compute[73469]:         <nova:project uuid="cec2ad0547114410a036090a792d0645">tempest-ServersNegativeTestJSON-1709480953</nova:project>
Aug 22 03:08:37 user nova-compute[73469]:       </nova:owner>
Aug 22 03:08:37 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:08:37 user nova-compute[73469]:       <nova:ports>
Aug 22 03:08:37 user nova-compute[73469]:         <nova:port uuid="143adaa4-b7f9-4648-9224-1eb631e8120b">
Aug 22 03:08:37 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 22 03:08:37 user nova-compute[73469]:         </nova:port>
Aug 22 03:08:37 user nova-compute[73469]:       </nova:ports>
Aug 22 03:08:37 user nova-compute[73469]:     </nova:instance>
Aug 22 03:08:37 user nova-compute[73469]:   </metadata>
Aug 22 03:08:37 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:08:37 user nova-compute[73469]:     <system>
Aug 22 03:08:37 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:08:37 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:08:37 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:08:37 user nova-compute[73469]:       <entry name="serial">b5525c10-e097-4214-ad4f-7b3afcf53483</entry>
Aug 22 03:08:37 user nova-compute[73469]:       <entry name="uuid">b5525c10-e097-4214-ad4f-7b3afcf53483</entry>
Aug 22 03:08:37 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:08:37 user nova-compute[73469]:     </system>
Aug 22 03:08:37 user nova-compute[73469]:   </sysinfo>
Aug 22 03:08:37 user nova-compute[73469]:   <os>
Aug 22 03:08:37 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:08:37 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:08:37 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:08:37 user nova-compute[73469]:   </os>
Aug 22 03:08:37 user nova-compute[73469]:   <features>
Aug 22 03:08:37 user nova-compute[73469]:     <acpi/>
Aug 22 03:08:37 user nova-compute[73469]:     <apic/>
Aug 22 03:08:37 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:08:37 user nova-compute[73469]:   </features>
Aug 22 03:08:37 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:08:37 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:08:37 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:08:37 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:08:37 user nova-compute[73469]:   </clock>
Aug 22 03:08:37 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:08:37 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:08:37 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:08:37 user nova-compute[73469]:   </cpu>
Aug 22 03:08:37 user nova-compute[73469]:   <devices>
Aug 22 03:08:37 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:08:37 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:08:37 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/disk"/>
Aug 22 03:08:37 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:08:37 user nova-compute[73469]:     </disk>
Aug 22 03:08:37 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:08:37 user nova-compute[73469]:       <mac address="fa:16:3e:a4:3c:33"/>
Aug 22 03:08:37 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:08:37 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:08:37 user nova-compute[73469]:       <target dev="tap143adaa4-b7"/>
Aug 22 03:08:37 user nova-compute[73469]:     </interface>
Aug 22 03:08:37 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:08:37 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/console.log" append="off"/>
Aug 22 03:08:37 user nova-compute[73469]:     </serial>
Aug 22 03:08:37 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:08:37 user nova-compute[73469]:     <video>
Aug 22 03:08:37 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:08:37 user nova-compute[73469]:     </video>
Aug 22 03:08:37 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:08:37 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:08:37 user nova-compute[73469]:     </rng>
Aug 22 03:08:37 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:08:37 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:08:37 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:08:37 user nova-compute[73469]:     </memballoon>
Aug 22 03:08:37 user nova-compute[73469]:   </devices>
Aug 22 03:08:37 user nova-compute[73469]: </domain>
Aug 22 03:08:37 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:08:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1653739734',display_name='tempest-ServersNegativeTestJSON-server-1653739734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1653739734',id=33,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cec2ad0547114410a036090a792d0645',ramdisk_id='',reservation_id='r-wk1j4f64',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1709480953',owner_user_name='tempest-ServersNegativeTestJSON-1709480953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:08:35Z,user_data=None,user_id='635f762a1488400fa57a6a9e244ddb42',uuid=b5525c10-e097-4214-ad4f-7b3afcf53483,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "143adaa4-b7f9-4648-9224-1eb631e8120b", "address": "fa:16:3e:a4:3c:33", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143adaa4-b7", "ovs_interfaceid": "143adaa4-b7f9-4648-9224-1eb631e8120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Converting VIF {"id": "143adaa4-b7f9-4648-9224-1eb631e8120b", "address": "fa:16:3e:a4:3c:33", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143adaa4-b7", "ovs_interfaceid": "143adaa4-b7f9-4648-9224-1eb631e8120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3c:33,bridge_name='br-int',has_traffic_filtering=True,id=143adaa4-b7f9-4648-9224-1eb631e8120b,network=Network(b1119133-216d-41a0-b227-d1e9e4aed153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143adaa4-b7') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG os_vif [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3c:33,bridge_name='br-int',has_traffic_filtering=True,id=143adaa4-b7f9-4648-9224-1eb631e8120b,network=Network(b1119133-216d-41a0-b227-d1e9e4aed153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143adaa4-b7') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap143adaa4-b7, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap143adaa4-b7, col_values=(('external_ids', {'iface-id': '143adaa4-b7f9-4648-9224-1eb631e8120b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:3c:33', 'vm-uuid': 'b5525c10-e097-4214-ad4f-7b3afcf53483'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:37 user nova-compute[73469]: INFO os_vif [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3c:33,bridge_name='br-int',has_traffic_filtering=True,id=143adaa4-b7f9-4648-9224-1eb631e8120b,network=Network(b1119133-216d-41a0-b227-d1e9e4aed153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143adaa4-b7')
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] No VIF found with MAC fa:16:3e:a4:3c:33, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:08:37 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:08:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-ee71567c-9652-44d7-b7f0-dfd2f77707e3 req-5383af1b-e7bf-48fe-a2a5-d205ede978f7 service nova] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Received event network-changed-143adaa4-b7f9-4648-9224-1eb631e8120b {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:08:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-ee71567c-9652-44d7-b7f0-dfd2f77707e3 req-5383af1b-e7bf-48fe-a2a5-d205ede978f7 service nova] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Refreshing instance network info cache due to event network-changed-143adaa4-b7f9-4648-9224-1eb631e8120b. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:08:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ee71567c-9652-44d7-b7f0-dfd2f77707e3 req-5383af1b-e7bf-48fe-a2a5-d205ede978f7 service nova] Acquiring lock "refresh_cache-b5525c10-e097-4214-ad4f-7b3afcf53483" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:08:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ee71567c-9652-44d7-b7f0-dfd2f77707e3 req-5383af1b-e7bf-48fe-a2a5-d205ede978f7 service nova] Acquired lock "refresh_cache-b5525c10-e097-4214-ad4f-7b3afcf53483" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:08:38 user nova-compute[73469]: DEBUG nova.network.neutron [req-ee71567c-9652-44d7-b7f0-dfd2f77707e3 req-5383af1b-e7bf-48fe-a2a5-d205ede978f7 service nova] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Refreshing network info cache for port 143adaa4-b7f9-4648-9224-1eb631e8120b {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:08:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-382c5fda-9250-47e9-bfbb-5d6cebbd2d5b req-cb23b09a-5a32-4254-aa61-e3b2d5e68fbe service nova] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Received event network-vif-plugged-143adaa4-b7f9-4648-9224-1eb631e8120b {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:08:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-382c5fda-9250-47e9-bfbb-5d6cebbd2d5b req-cb23b09a-5a32-4254-aa61-e3b2d5e68fbe service nova] Acquiring lock "b5525c10-e097-4214-ad4f-7b3afcf53483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:08:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-382c5fda-9250-47e9-bfbb-5d6cebbd2d5b req-cb23b09a-5a32-4254-aa61-e3b2d5e68fbe service nova] Lock "b5525c10-e097-4214-ad4f-7b3afcf53483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:08:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-382c5fda-9250-47e9-bfbb-5d6cebbd2d5b req-cb23b09a-5a32-4254-aa61-e3b2d5e68fbe service nova] Lock "b5525c10-e097-4214-ad4f-7b3afcf53483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-382c5fda-9250-47e9-bfbb-5d6cebbd2d5b req-cb23b09a-5a32-4254-aa61-e3b2d5e68fbe service nova] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] No waiting events found dispatching network-vif-plugged-143adaa4-b7f9-4648-9224-1eb631e8120b {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:08:39 user nova-compute[73469]: WARNING nova.compute.manager [req-382c5fda-9250-47e9-bfbb-5d6cebbd2d5b req-cb23b09a-5a32-4254-aa61-e3b2d5e68fbe service nova] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Received unexpected event network-vif-plugged-143adaa4-b7f9-4648-9224-1eb631e8120b for instance with vm_state building and task_state spawning.
Aug 22 03:08:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:39 user nova-compute[73469]: DEBUG nova.network.neutron [req-ee71567c-9652-44d7-b7f0-dfd2f77707e3 req-5383af1b-e7bf-48fe-a2a5-d205ede978f7 service nova] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Updated VIF entry in instance network info cache for port 143adaa4-b7f9-4648-9224-1eb631e8120b. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:08:39 user nova-compute[73469]: DEBUG nova.network.neutron [req-ee71567c-9652-44d7-b7f0-dfd2f77707e3 req-5383af1b-e7bf-48fe-a2a5-d205ede978f7 service nova] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Updating instance_info_cache with network_info: [{"id": "143adaa4-b7f9-4648-9224-1eb631e8120b", "address": "fa:16:3e:a4:3c:33", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143adaa4-b7", "ovs_interfaceid": "143adaa4-b7f9-4648-9224-1eb631e8120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:08:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ee71567c-9652-44d7-b7f0-dfd2f77707e3 req-5383af1b-e7bf-48fe-a2a5-d205ede978f7 service nova] Releasing lock "refresh_cache-b5525c10-e097-4214-ad4f-7b3afcf53483" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:08:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-fe2bc086-651a-4a29-bba2-be6c6ace8d79 req-60b0c01b-38ca-42c9-bc50-2b21fbd7965e service nova] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Received event network-vif-plugged-143adaa4-b7f9-4648-9224-1eb631e8120b {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:08:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fe2bc086-651a-4a29-bba2-be6c6ace8d79 req-60b0c01b-38ca-42c9-bc50-2b21fbd7965e service nova] Acquiring lock "b5525c10-e097-4214-ad4f-7b3afcf53483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:08:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fe2bc086-651a-4a29-bba2-be6c6ace8d79 req-60b0c01b-38ca-42c9-bc50-2b21fbd7965e service nova] Lock "b5525c10-e097-4214-ad4f-7b3afcf53483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:08:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fe2bc086-651a-4a29-bba2-be6c6ace8d79 req-60b0c01b-38ca-42c9-bc50-2b21fbd7965e service nova] Lock "b5525c10-e097-4214-ad4f-7b3afcf53483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-fe2bc086-651a-4a29-bba2-be6c6ace8d79 req-60b0c01b-38ca-42c9-bc50-2b21fbd7965e service nova] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] No waiting events found dispatching network-vif-plugged-143adaa4-b7f9-4648-9224-1eb631e8120b {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:08:41 user nova-compute[73469]: WARNING nova.compute.manager [req-fe2bc086-651a-4a29-bba2-be6c6ace8d79 req-60b0c01b-38ca-42c9-bc50-2b21fbd7965e service nova] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Received unexpected event network-vif-plugged-143adaa4-b7f9-4648-9224-1eb631e8120b for instance with vm_state building and task_state spawning.
Aug 22 03:08:41 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673721.1799345, b5525c10-e097-4214-ad4f-7b3afcf53483 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:08:41 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] VM Resumed (Lifecycle Event)
Aug 22 03:08:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:08:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:08:41 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Instance spawned successfully.
Aug 22 03:08:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:08:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:08:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:08:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:08:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:08:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:08:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:08:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:08:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:08:41 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:08:41 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673721.1880875, b5525c10-e097-4214-ad4f-7b3afcf53483 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:08:41 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] VM Started (Lifecycle Event)
Aug 22 03:08:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:08:41 user nova-compute[73469]: INFO nova.compute.manager [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Took 6.61 seconds to spawn the instance on the hypervisor.
Aug 22 03:08:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:08:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:08:41 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:08:41 user nova-compute[73469]: INFO nova.compute.manager [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Took 7.53 seconds to build instance.
Aug 22 03:08:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cf700cfa-226c-4328-aecb-915aa118ff4a tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "b5525c10-e097-4214-ad4f-7b3afcf53483" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.647s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:44 user nova-compute[73469]: INFO nova.compute.manager [None req-1c65e8c7-5d9d-4ef5-b27d-14cd11db640f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Unrescuing
Aug 22 03:08:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1c65e8c7-5d9d-4ef5-b27d-14cd11db640f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "refresh_cache-e43158b8-28fc-429c-b329-26be91761d4f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:08:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1c65e8c7-5d9d-4ef5-b27d-14cd11db640f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquired lock "refresh_cache-e43158b8-28fc-429c-b329-26be91761d4f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:08:44 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1c65e8c7-5d9d-4ef5-b27d-14cd11db640f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:08:44 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:08:44 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1c65e8c7-5d9d-4ef5-b27d-14cd11db640f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Updating instance_info_cache with network_info: [{"id": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "address": "fa:16:3e:94:d6:2d", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbb3f1b-29", "ovs_interfaceid": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:08:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1c65e8c7-5d9d-4ef5-b27d-14cd11db640f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Releasing lock "refresh_cache-e43158b8-28fc-429c-b329-26be91761d4f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:08:44 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1c65e8c7-5d9d-4ef5-b27d-14cd11db640f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'flavor' on Instance uuid e43158b8-28fc-429c-b329-26be91761d4f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:08:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-24d6625a-b08c-485b-b142-38912d9afd8f req-7b795b6b-63fd-4f03-ab95-75e821ce231c service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received event network-vif-unplugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:08:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-24d6625a-b08c-485b-b142-38912d9afd8f req-7b795b6b-63fd-4f03-ab95-75e821ce231c service nova] Acquiring lock "e43158b8-28fc-429c-b329-26be91761d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:08:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-24d6625a-b08c-485b-b142-38912d9afd8f req-7b795b6b-63fd-4f03-ab95-75e821ce231c service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:08:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-24d6625a-b08c-485b-b142-38912d9afd8f req-7b795b6b-63fd-4f03-ab95-75e821ce231c service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-24d6625a-b08c-485b-b142-38912d9afd8f req-7b795b6b-63fd-4f03-ab95-75e821ce231c service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] No waiting events found dispatching network-vif-unplugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:08:45 user nova-compute[73469]: WARNING nova.compute.manager [req-24d6625a-b08c-485b-b142-38912d9afd8f req-7b795b6b-63fd-4f03-ab95-75e821ce231c service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received unexpected event network-vif-unplugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c for instance with vm_state rescued and task_state unrescuing.
Aug 22 03:08:45 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:08:45 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Instance destroyed successfully.
Aug 22 03:08:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:47 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:08:47 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:08:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 22 03:08:47 user nova-compute[73469]: DEBUG nova.compute.manager [req-48e4fb10-d996-42ad-bcbe-ea5a6733cd36 req-ef7ae096-b3a0-4721-bf14-3dd7cd928edd service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received event network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:08:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-48e4fb10-d996-42ad-bcbe-ea5a6733cd36 req-ef7ae096-b3a0-4721-bf14-3dd7cd928edd service nova] Acquiring lock "e43158b8-28fc-429c-b329-26be91761d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:08:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-48e4fb10-d996-42ad-bcbe-ea5a6733cd36 req-ef7ae096-b3a0-4721-bf14-3dd7cd928edd service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:08:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-48e4fb10-d996-42ad-bcbe-ea5a6733cd36 req-ef7ae096-b3a0-4721-bf14-3dd7cd928edd service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:47 user nova-compute[73469]: DEBUG nova.compute.manager [req-48e4fb10-d996-42ad-bcbe-ea5a6733cd36 req-ef7ae096-b3a0-4721-bf14-3dd7cd928edd service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] No waiting events found dispatching network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:08:47 user nova-compute[73469]: WARNING nova.compute.manager [req-48e4fb10-d996-42ad-bcbe-ea5a6733cd36 req-ef7ae096-b3a0-4721-bf14-3dd7cd928edd service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received unexpected event network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c for instance with vm_state rescued and task_state unrescuing.
Aug 22 03:08:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] There are 0 instances to clean {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 22 03:08:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:48 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:08:48 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:08:49 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673714.4846356, 8a34f0c2-c0b0-4ba7-b9e4-673350a81646 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:08:49 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] VM Stopped (Lifecycle Event)
Aug 22 03:08:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-fcf77ffd-834c-45ec-ade4-a1055fd58196 None None] [instance: 8a34f0c2-c0b0-4ba7-b9e4-673350a81646] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:08:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-6abdaf99-82a9-4c30-88bd-9ec0270b73c2 req-57a128df-37ea-42b8-9757-ab06dc0d4063 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received event network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:08:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6abdaf99-82a9-4c30-88bd-9ec0270b73c2 req-57a128df-37ea-42b8-9757-ab06dc0d4063 service nova] Acquiring lock "e43158b8-28fc-429c-b329-26be91761d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:08:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6abdaf99-82a9-4c30-88bd-9ec0270b73c2 req-57a128df-37ea-42b8-9757-ab06dc0d4063 service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:08:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6abdaf99-82a9-4c30-88bd-9ec0270b73c2 req-57a128df-37ea-42b8-9757-ab06dc0d4063 service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-6abdaf99-82a9-4c30-88bd-9ec0270b73c2 req-57a128df-37ea-42b8-9757-ab06dc0d4063 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] No waiting events found dispatching network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:08:49 user nova-compute[73469]: WARNING nova.compute.manager [req-6abdaf99-82a9-4c30-88bd-9ec0270b73c2 req-57a128df-37ea-42b8-9757-ab06dc0d4063 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received unexpected event network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c for instance with vm_state rescued and task_state unrescuing.
Aug 22 03:08:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-6abdaf99-82a9-4c30-88bd-9ec0270b73c2 req-57a128df-37ea-42b8-9757-ab06dc0d4063 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received event network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:08:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6abdaf99-82a9-4c30-88bd-9ec0270b73c2 req-57a128df-37ea-42b8-9757-ab06dc0d4063 service nova] Acquiring lock "e43158b8-28fc-429c-b329-26be91761d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:08:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6abdaf99-82a9-4c30-88bd-9ec0270b73c2 req-57a128df-37ea-42b8-9757-ab06dc0d4063 service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:08:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6abdaf99-82a9-4c30-88bd-9ec0270b73c2 req-57a128df-37ea-42b8-9757-ab06dc0d4063 service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-6abdaf99-82a9-4c30-88bd-9ec0270b73c2 req-57a128df-37ea-42b8-9757-ab06dc0d4063 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] No waiting events found dispatching network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:08:49 user nova-compute[73469]: WARNING nova.compute.manager [req-6abdaf99-82a9-4c30-88bd-9ec0270b73c2 req-57a128df-37ea-42b8-9757-ab06dc0d4063 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received unexpected event network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c for instance with vm_state rescued and task_state unrescuing.
Aug 22 03:08:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Removed pending event for e43158b8-28fc-429c-b329-26be91761d4f due to event {{(pid=73469) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 22 03:08:49 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673729.9140496, e43158b8-28fc-429c-b329-26be91761d4f => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:08:49 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] VM Resumed (Lifecycle Event)
Aug 22 03:08:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1c65e8c7-5d9d-4ef5-b27d-14cd11db640f tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:08:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:08:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:08:49 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 22 03:08:49 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673729.9161835, e43158b8-28fc-429c-b329-26be91761d4f => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:08:49 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] VM Started (Lifecycle Event)
Aug 22 03:08:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:08:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:08:50 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:08:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:08:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-8242cec1-3b35-4d14-9e0b-db8a7e75697d" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:08:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-8242cec1-3b35-4d14-9e0b-db8a7e75697d" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:08:50 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:08:51 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Updating instance_info_cache with network_info: [{"id": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "address": "fa:16:3e:4f:6e:44", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec640a77-a1", "ovs_interfaceid": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:08:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-8242cec1-3b35-4d14-9e0b-db8a7e75697d" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:08:51 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:08:51 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:08:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:08:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:08:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:51 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:08:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:08:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:08:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:08:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:08:56 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:08:56 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:08:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=7370MB free_disk=24.95461654663086GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:08:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:08:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:08:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:08:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d0668c0-7a49-4857-9b69-541021f18ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:08:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance dc3f5545-8ebb-4947-97d0-98a91f67e421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:08:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8242cec1-3b35-4d14-9e0b-db8a7e75697d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:08:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82e872a7-70b0-4290-9a11-5316765aed01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:08:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 980e57bf-dec9-46f3-8d69-e20a17603af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:08:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance e43158b8-28fc-429c-b329-26be91761d4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:08:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a7e95a46-9a75-4b0c-a5c9-42ed521668a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:08:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a0a019bd-fadd-46cb-ac48-d47bfc263b0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:08:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 228b721b-c7c4-4994-b1be-28234ea6a4fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:08:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance b5525c10-e097-4214-ad4f-7b3afcf53483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:08:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:08:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:08:56 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:08:57 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:08:57 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:08:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:08:57 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:08:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 22 03:08:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:08:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:08:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:08:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:08:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:08:58 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:08:58 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:08:58 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:08:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:08:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "dc3f5545-8ebb-4947-97d0-98a91f67e421" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:02 user nova-compute[73469]: INFO nova.compute.manager [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Terminating instance
Aug 22 03:09:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:09:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG nova.compute.manager [req-9d4acd3c-ed88-4dd3-92c9-92fa3d962093 req-7f86a862-a2ca-4e66-a301-efda05943f53 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Received event network-vif-unplugged-85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9d4acd3c-ed88-4dd3-92c9-92fa3d962093 req-7f86a862-a2ca-4e66-a301-efda05943f53 service nova] Acquiring lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9d4acd3c-ed88-4dd3-92c9-92fa3d962093 req-7f86a862-a2ca-4e66-a301-efda05943f53 service nova] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9d4acd3c-ed88-4dd3-92c9-92fa3d962093 req-7f86a862-a2ca-4e66-a301-efda05943f53 service nova] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG nova.compute.manager [req-9d4acd3c-ed88-4dd3-92c9-92fa3d962093 req-7f86a862-a2ca-4e66-a301-efda05943f53 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] No waiting events found dispatching network-vif-unplugged-85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG nova.compute.manager [req-9d4acd3c-ed88-4dd3-92c9-92fa3d962093 req-7f86a862-a2ca-4e66-a301-efda05943f53 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Received event network-vif-unplugged-85ef805d-a41f-4146-bbed-a2feed61c8bb for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:03 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Instance destroyed successfully.
Aug 22 03:09:03 user nova-compute[73469]: DEBUG nova.objects.instance [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'resources' on Instance uuid dc3f5545-8ebb-4947-97d0-98a91f67e421 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:52:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-393165444',display_name='tempest-ServerRescueNegativeTestJSON-server-393165444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-393165444',id=3,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:54:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46cd52eb0f2642bc95dbf216ae280e12',ramdisk_id='',reservation_id='r-odxnfkyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2020570120',owner_user_name='tempest-ServerRescueNegativeTestJSON-2020570120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:54:36Z,user_data=None,user_id='64b023ffba814ac5b6a3bc4666107767',uuid=dc3f5545-8ebb-4947-97d0-98a91f67e421,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "address": "fa:16:3e:89:d7:b7", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ef805d-a4", "ovs_interfaceid": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converting VIF {"id": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "address": "fa:16:3e:89:d7:b7", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ef805d-a4", "ovs_interfaceid": "85ef805d-a41f-4146-bbed-a2feed61c8bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:d7:b7,bridge_name='br-int',has_traffic_filtering=True,id=85ef805d-a41f-4146-bbed-a2feed61c8bb,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ef805d-a4') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG os_vif [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:d7:b7,bridge_name='br-int',has_traffic_filtering=True,id=85ef805d-a41f-4146-bbed-a2feed61c8bb,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ef805d-a4') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85ef805d-a4, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:03 user nova-compute[73469]: INFO os_vif [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:d7:b7,bridge_name='br-int',has_traffic_filtering=True,id=85ef805d-a41f-4146-bbed-a2feed61c8bb,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ef805d-a4')
Aug 22 03:09:03 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Deleting instance files /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421_del
Aug 22 03:09:03 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Deletion of /opt/stack/data/nova/instances/dc3f5545-8ebb-4947-97d0-98a91f67e421_del complete
Aug 22 03:09:03 user nova-compute[73469]: INFO nova.compute.manager [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 22 03:09:03 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:09:03 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:09:04 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:09:04 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Took 0.65 seconds to deallocate network for instance.
Aug 22 03:09:04 user nova-compute[73469]: DEBUG nova.compute.manager [req-d1f9d344-79a5-411a-8263-cd9b0a0c2d13 req-d50cb507-b702-42ee-a9b5-a6b9586100e7 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Received event network-vif-deleted-85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:09:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:04 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:09:04 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:09:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:04 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Deleted allocations for instance dc3f5545-8ebb-4947-97d0-98a91f67e421
Aug 22 03:09:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-26ce1f26-5f16-4251-9091-80a3d458eb63 tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.309s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:05 user nova-compute[73469]: DEBUG nova.compute.manager [req-8bf6fa1b-940e-4241-9f3e-b351a9d105f2 req-3e2a5892-90e2-497e-8599-49c73185fbb4 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Received event network-vif-plugged-85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:09:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8bf6fa1b-940e-4241-9f3e-b351a9d105f2 req-3e2a5892-90e2-497e-8599-49c73185fbb4 service nova] Acquiring lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8bf6fa1b-940e-4241-9f3e-b351a9d105f2 req-3e2a5892-90e2-497e-8599-49c73185fbb4 service nova] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8bf6fa1b-940e-4241-9f3e-b351a9d105f2 req-3e2a5892-90e2-497e-8599-49c73185fbb4 service nova] Lock "dc3f5545-8ebb-4947-97d0-98a91f67e421-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:05 user nova-compute[73469]: DEBUG nova.compute.manager [req-8bf6fa1b-940e-4241-9f3e-b351a9d105f2 req-3e2a5892-90e2-497e-8599-49c73185fbb4 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] No waiting events found dispatching network-vif-plugged-85ef805d-a41f-4146-bbed-a2feed61c8bb {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:09:05 user nova-compute[73469]: WARNING nova.compute.manager [req-8bf6fa1b-940e-4241-9f3e-b351a9d105f2 req-3e2a5892-90e2-497e-8599-49c73185fbb4 service nova] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Received unexpected event network-vif-plugged-85ef805d-a41f-4146-bbed-a2feed61c8bb for instance with vm_state deleted and task_state None.
Aug 22 03:09:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid bda33a54-edf0-4809-9469-f1774fdc5b12 {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid 9d0668c0-7a49-4857-9b69-541021f18ab2 {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid 8242cec1-3b35-4d14-9e0b-db8a7e75697d {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid 82e872a7-70b0-4290-9a11-5316765aed01 {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid 980e57bf-dec9-46f3-8d69-e20a17603af8 {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid e43158b8-28fc-429c-b329-26be91761d4f {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid a7e95a46-9a75-4b0c-a5c9-42ed521668a5 {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid a0a019bd-fadd-46cb-ac48-d47bfc263b0c {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid 228b721b-c7c4-4994-b1be-28234ea6a4fd {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid b5525c10-e097-4214-ad4f-7b3afcf53483 {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "bda33a54-edf0-4809-9469-f1774fdc5b12" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "bda33a54-edf0-4809-9469-f1774fdc5b12" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "9d0668c0-7a49-4857-9b69-541021f18ab2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "82e872a7-70b0-4290-9a11-5316765aed01" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "82e872a7-70b0-4290-9a11-5316765aed01" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "980e57bf-dec9-46f3-8d69-e20a17603af8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "980e57bf-dec9-46f3-8d69-e20a17603af8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "e43158b8-28fc-429c-b329-26be91761d4f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "e43158b8-28fc-429c-b329-26be91761d4f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "228b721b-c7c4-4994-b1be-28234ea6a4fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "b5525c10-e097-4214-ad4f-7b3afcf53483" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "b5525c10-e097-4214-ad4f-7b3afcf53483" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "bda33a54-edf0-4809-9469-f1774fdc5b12" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "980e57bf-dec9-46f3-8d69-e20a17603af8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "e43158b8-28fc-429c-b329-26be91761d4f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "82e872a7-70b0-4290-9a11-5316765aed01" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "b5525c10-e097-4214-ad4f-7b3afcf53483" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:18 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673743.6480315, dc3f5545-8ebb-4947-97d0-98a91f67e421 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:09:18 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] VM Stopped (Lifecycle Event)
Aug 22 03:09:18 user nova-compute[73469]: DEBUG nova.compute.manager [None req-34a8c729-db2c-4ada-8443-e8bfd1cd7489 None None] [instance: dc3f5545-8ebb-4947-97d0-98a91f67e421] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:09:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:22 user nova-compute[73469]: DEBUG nova.compute.manager [req-875dd32e-2531-47bd-b986-5fd58ee0a43a req-9476761e-1009-4f9c-9200-de06a50274bc service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Received event network-changed-135c6c26-00c9-4174-8b5d-51002185def1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:09:22 user nova-compute[73469]: DEBUG nova.compute.manager [req-875dd32e-2531-47bd-b986-5fd58ee0a43a req-9476761e-1009-4f9c-9200-de06a50274bc service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Refreshing instance network info cache due to event network-changed-135c6c26-00c9-4174-8b5d-51002185def1. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:09:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-875dd32e-2531-47bd-b986-5fd58ee0a43a req-9476761e-1009-4f9c-9200-de06a50274bc service nova] Acquiring lock "refresh_cache-a0a019bd-fadd-46cb-ac48-d47bfc263b0c" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:09:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-875dd32e-2531-47bd-b986-5fd58ee0a43a req-9476761e-1009-4f9c-9200-de06a50274bc service nova] Acquired lock "refresh_cache-a0a019bd-fadd-46cb-ac48-d47bfc263b0c" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:09:22 user nova-compute[73469]: DEBUG nova.network.neutron [req-875dd32e-2531-47bd-b986-5fd58ee0a43a req-9476761e-1009-4f9c-9200-de06a50274bc service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Refreshing network info cache for port 135c6c26-00c9-4174-8b5d-51002185def1 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:09:23 user nova-compute[73469]: DEBUG nova.network.neutron [req-875dd32e-2531-47bd-b986-5fd58ee0a43a req-9476761e-1009-4f9c-9200-de06a50274bc service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Updated VIF entry in instance network info cache for port 135c6c26-00c9-4174-8b5d-51002185def1. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:09:23 user nova-compute[73469]: DEBUG nova.network.neutron [req-875dd32e-2531-47bd-b986-5fd58ee0a43a req-9476761e-1009-4f9c-9200-de06a50274bc service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Updating instance_info_cache with network_info: [{"id": "135c6c26-00c9-4174-8b5d-51002185def1", "address": "fa:16:3e:df:6e:f3", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c6c26-00", "ovs_interfaceid": "135c6c26-00c9-4174-8b5d-51002185def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:09:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-875dd32e-2531-47bd-b986-5fd58ee0a43a req-9476761e-1009-4f9c-9200-de06a50274bc service nova] Releasing lock "refresh_cache-a0a019bd-fadd-46cb-ac48-d47bfc263b0c" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:09:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG nova.objects.instance [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'flavor' on Instance uuid a0a019bd-fadd-46cb-ac48-d47bfc263b0c {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:26 user nova-compute[73469]: INFO nova.compute.manager [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Attaching volume 5c1c2e12-d98c-41d6-a037-a1401a998c3a to /dev/vdb
Aug 22 03:09:26 user nova-compute[73469]: DEBUG os_brick.utils [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd9aedb-b565-4a00-aa66-e5f4bcdc9d67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92a1112-f1ec-4275-a69f-cae620ea1f71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5e75e1-bd0f-4aef-bd8d-4d9221844ab0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d329d1-0603-4935-8d66-93ddf4310fe4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:09:26 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:09:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae08ecba-c13b-4046-8670-83fd6423e9e8]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG os_brick.utils [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:09:26 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Updating existing volume attachment record: ee176e00-a113-4759-88f2-997538c7b0ad {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:09:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-cab08361-4b8f-469e-8be4-a524a8782c3c req-2b3ca4c8-d430-4318-b826-c6c145025795 service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Received event network-changed-3f62a12a-6902-4a55-986f-728b46db9fb7 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:09:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-cab08361-4b8f-469e-8be4-a524a8782c3c req-2b3ca4c8-d430-4318-b826-c6c145025795 service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Refreshing instance network info cache due to event network-changed-3f62a12a-6902-4a55-986f-728b46db9fb7. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:09:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cab08361-4b8f-469e-8be4-a524a8782c3c req-2b3ca4c8-d430-4318-b826-c6c145025795 service nova] Acquiring lock "refresh_cache-228b721b-c7c4-4994-b1be-28234ea6a4fd" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:09:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cab08361-4b8f-469e-8be4-a524a8782c3c req-2b3ca4c8-d430-4318-b826-c6c145025795 service nova] Acquired lock "refresh_cache-228b721b-c7c4-4994-b1be-28234ea6a4fd" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:09:38 user nova-compute[73469]: DEBUG nova.network.neutron [req-cab08361-4b8f-469e-8be4-a524a8782c3c req-2b3ca4c8-d430-4318-b826-c6c145025795 service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Refreshing network info cache for port 3f62a12a-6902-4a55-986f-728b46db9fb7 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:09:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:38 user nova-compute[73469]: DEBUG nova.network.neutron [req-cab08361-4b8f-469e-8be4-a524a8782c3c req-2b3ca4c8-d430-4318-b826-c6c145025795 service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Updated VIF entry in instance network info cache for port 3f62a12a-6902-4a55-986f-728b46db9fb7. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:09:38 user nova-compute[73469]: DEBUG nova.network.neutron [req-cab08361-4b8f-469e-8be4-a524a8782c3c req-2b3ca4c8-d430-4318-b826-c6c145025795 service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Updating instance_info_cache with network_info: [{"id": "3f62a12a-6902-4a55-986f-728b46db9fb7", "address": "fa:16:3e:de:94:8a", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f62a12a-69", "ovs_interfaceid": "3f62a12a-6902-4a55-986f-728b46db9fb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:09:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cab08361-4b8f-469e-8be4-a524a8782c3c req-2b3ca4c8-d430-4318-b826-c6c145025795 service nova] Releasing lock "refresh_cache-228b721b-c7c4-4994-b1be-28234ea6a4fd" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "228b721b-c7c4-4994-b1be-28234ea6a4fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG nova.objects.instance [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'flavor' on Instance uuid 228b721b-c7c4-4994-b1be-28234ea6a4fd {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "228b721b-c7c4-4994-b1be-28234ea6a4fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:43 user nova-compute[73469]: INFO nova.compute.manager [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Attaching volume f59d6e5b-0893-4146-9943-1e46c59fa6d0 to /dev/vdb
Aug 22 03:09:43 user nova-compute[73469]: DEBUG os_brick.utils [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a47b88-b8ec-47b6-9806-4c11c83a6e6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[33760691-efdb-419d-9f41-26b09c4164fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0679be-f0c7-4931-b887-a7c42ae28231]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db16189-da02-4d58-bf79-768fb57b8b4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:09:43 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:09:43 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[947572fb-fcfd-45b3-8ccd-6355f29f90f2]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG os_brick.utils [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Updating existing volume attachment record: c8ae0fc2-1fd3-43de-81b9-208949fdf00e {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:09:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:44 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMKsnJDZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:09:45 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:09:45 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:09:45 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[052ad59d-6c17-4aed-a1cc-0d990c42420c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:09:45 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d3b3dd-dad3-425d-9919-9f07890d5cb3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a] added
Aug 22 03:09:45 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab5eddb-583d-4e4f-8f12-e2cd7906282e]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9561319b-81d4-4640-a82d-5957d0a01857]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pMKsnJDZ {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pMKsnJDZ" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[36563ec5-1c92-44cb-a7ad-8e645a16d6ba]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pMKsnJDZ'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f7f50b-174a-4cdb-8473-3e924f3c91e1]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[08574215-577c-416a-bd6c-145c3e3ef06f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:09:45 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:09:45 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:09:45 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:09:45 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ff2f19-488e-4057-9cc4-303bd37e9f37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a, portal: 172.16.0.220,3260]
Aug 22 03:09:45 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a, portal: 172.16.0.220,3260] successful.
Aug 22 03:09:45 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eac8a5-f31e-4069-8fa9-16b7f991db56]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d50e69e-fa47-47ae-b417-5300b961501e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:09:45 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:09:45 user nova-compute[73469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a (non-flash)
Aug 22 03:09:45 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:09:45 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:09:45 user nova-compute[73469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a (non-flash)
Aug 22 03:09:45 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2911b90d-d6f9-4874-b367-0b595ee38965]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:45 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:09:46 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:09:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMKsnJDZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:09:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:09:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23363313334333365', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:09:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363313334333365', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:09:46 user nova-compute[73469]: DEBUG nova.objects.instance [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'flavor' on Instance uuid a0a019bd-fadd-46cb-ac48-d47bfc263b0c {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:09:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:09:46 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:09:46 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:09:46 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:09:46 user nova-compute[73469]:   <serial>5c1c2e12-d98c-41d6-a037-a1401a998c3a</serial>
Aug 22 03:09:46 user nova-compute[73469]: </disk>
Aug 22 03:09:46 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:09:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:09:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:09:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] No VIF found with MAC fa:16:3e:df:6e:f3, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:09:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0021ab05-246c-453b-bf6e-f4bd1d10ce95 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.598s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:47 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:09:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:48 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:09:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:49 user nova-compute[73469]: INFO nova.compute.manager [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Unshelving
Aug 22 03:09:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:49 user nova-compute[73469]: DEBUG nova.objects.instance [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'pci_requests' on Instance uuid 149b34df-3d3c-48fc-99f2-0c3dc4334b1b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:09:49 user nova-compute[73469]: DEBUG nova.objects.instance [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'numa_topology' on Instance uuid 149b34df-3d3c-48fc-99f2-0c3dc4334b1b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:09:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:09:49 user nova-compute[73469]: INFO nova.compute.claims [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Claim successful on node user
Aug 22 03:09:49 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Refreshing inventories for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 22 03:09:49 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Updating ProviderTree inventory for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 22 03:09:49 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Updating inventory in ProviderTree for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 22 03:09:49 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Refreshing aggregate associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, aggregates: None {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 22 03:09:49 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Refreshing trait associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 22 03:09:50 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:09:50 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:09:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.665s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:50 user nova-compute[73469]: INFO nova.network.neutron [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Updating port 866b90b8-9ca8-4235-9f79-45d13fc5f929 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 22 03:09:50 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:09:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:09:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquired lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:09:51 user nova-compute[73469]: DEBUG nova.network.neutron [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:09:51 user nova-compute[73469]: DEBUG nova.compute.manager [req-17b91e32-3cf0-42d0-ad31-5ace319c4d3a req-3272e427-f072-43c0-a39c-6dd0f570dffc service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received event network-changed-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:09:51 user nova-compute[73469]: DEBUG nova.compute.manager [req-17b91e32-3cf0-42d0-ad31-5ace319c4d3a req-3272e427-f072-43c0-a39c-6dd0f570dffc service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Refreshing instance network info cache due to event network-changed-866b90b8-9ca8-4235-9f79-45d13fc5f929. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:09:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-17b91e32-3cf0-42d0-ad31-5ace319c4d3a req-3272e427-f072-43c0-a39c-6dd0f570dffc service nova] Acquiring lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:09:51 user nova-compute[73469]: DEBUG nova.network.neutron [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Updating instance_info_cache with network_info: [{"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:09:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Releasing lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:09:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:09:51 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Creating image(s)
Aug 22 03:09:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "/opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "/opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "/opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:51 user nova-compute[73469]: DEBUG nova.objects.instance [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'trusted_certs' on Instance uuid 149b34df-3d3c-48fc-99f2-0c3dc4334b1b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:09:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-17b91e32-3cf0-42d0-ad31-5ace319c4d3a req-3272e427-f072-43c0-a39c-6dd0f570dffc service nova] Acquired lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:09:51 user nova-compute[73469]: DEBUG nova.network.neutron [req-17b91e32-3cf0-42d0-ad31-5ace319c4d3a req-3272e427-f072-43c0-a39c-6dd0f570dffc service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Refreshing network info cache for port 866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:09:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "c1d13c2dfe30a89c5c60755e449836585222ceff" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "c1d13c2dfe30a89c5c60755e449836585222ceff" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:52 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d13c2dfe30a89c5c60755e449836585222ceff.part --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:52 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:09:52 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:09:52 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:09:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:52 user nova-compute[73469]: DEBUG nova.objects.instance [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'flavor' on Instance uuid a0a019bd-fadd-46cb-ac48-d47bfc263b0c {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:09:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d13c2dfe30a89c5c60755e449836585222ceff.part --force-share --output=json" returned: 0 in 0.224s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG nova.virt.images [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] 1fc40bce-0ff4-4757-b125-885091ae7955 was qcow2, converting to raw {{(pid=73469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG nova.privsep.utils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1d13c2dfe30a89c5c60755e449836585222ceff.part /opt/stack/data/nova/instances/_base/c1d13c2dfe30a89c5c60755e449836585222ceff.converted {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:53 user nova-compute[73469]: INFO nova.compute.manager [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Attaching volume 1344efaf-e3fd-46a7-88ed-e471f3e9f36b to /dev/vdc
Aug 22 03:09:53 user nova-compute[73469]: DEBUG os_brick.utils [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a248f67e-585e-4a83-9e6e-629ef36402aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b688494b-d4f8-4770-938e-6cc23008074f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96a06e6-df42-431b-89fd-e7969f370f00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG nova.network.neutron [req-17b91e32-3cf0-42d0-ad31-5ace319c4d3a req-3272e427-f072-43c0-a39c-6dd0f570dffc service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Updated VIF entry in instance network info cache for port 866b90b8-9ca8-4235-9f79-45d13fc5f929. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG nova.network.neutron [req-17b91e32-3cf0-42d0-ad31-5ace319c4d3a req-3272e427-f072-43c0-a39c-6dd0f570dffc service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Updating instance_info_cache with network_info: [{"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1e926f-1895-4652-a8bc-422d25fecaac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1d13c2dfe30a89c5c60755e449836585222ceff.part /opt/stack/data/nova/instances/_base/c1d13c2dfe30a89c5c60755e449836585222ceff.converted" returned: 0 in 0.401s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-17b91e32-3cf0-42d0-ad31-5ace319c4d3a req-3272e427-f072-43c0-a39c-6dd0f570dffc service nova] Releasing lock "refresh_cache-149b34df-3d3c-48fc-99f2-0c3dc4334b1b" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d13c2dfe30a89c5c60755e449836585222ceff.converted --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:09:53 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8bb765-3146-459b-8bb0-b235f5605e49]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG os_brick.utils [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] <== get_connector_properties: return (292ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Updating existing volume attachment record: 11778506-ac34-4ae4-8845-5a3cb89cc68b {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "9d0668c0-7a49-4857-9b69-541021f18ab2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:53 user nova-compute[73469]: INFO nova.compute.manager [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Terminating instance
Aug 22 03:09:53 user nova-compute[73469]: DEBUG nova.compute.manager [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d13c2dfe30a89c5c60755e449836585222ceff.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "c1d13c2dfe30a89c5c60755e449836585222ceff" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.968s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d13c2dfe30a89c5c60755e449836585222ceff --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG nova.compute.manager [req-e1ee3d0d-8948-4fef-b60e-298bd74664da req-3f14c10b-db77-44c3-a783-1f92c0276136 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received event network-vif-unplugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e1ee3d0d-8948-4fef-b60e-298bd74664da req-3f14c10b-db77-44c3-a783-1f92c0276136 service nova] Acquiring lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e1ee3d0d-8948-4fef-b60e-298bd74664da req-3f14c10b-db77-44c3-a783-1f92c0276136 service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e1ee3d0d-8948-4fef-b60e-298bd74664da req-3f14c10b-db77-44c3-a783-1f92c0276136 service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG nova.compute.manager [req-e1ee3d0d-8948-4fef-b60e-298bd74664da req-3f14c10b-db77-44c3-a783-1f92c0276136 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] No waiting events found dispatching network-vif-unplugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG nova.compute.manager [req-e1ee3d0d-8948-4fef-b60e-298bd74664da req-3f14c10b-db77-44c3-a783-1f92c0276136 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received event network-vif-unplugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d13c2dfe30a89c5c60755e449836585222ceff --force-share --output=json" returned: 0 in 0.205s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "c1d13c2dfe30a89c5c60755e449836585222ceff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "c1d13c2dfe30a89c5c60755e449836585222ceff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:53 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d13c2dfe30a89c5c60755e449836585222ceff --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d13c2dfe30a89c5c60755e449836585222ceff --force-share --output=json" returned: 0 in 0.214s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d13c2dfe30a89c5c60755e449836585222ceff,backing_fmt=raw /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d13c2dfe30a89c5c60755e449836585222ceff,backing_fmt=raw /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk 1073741824" returned: 0 in 0.057s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "c1d13c2dfe30a89c5c60755e449836585222ceff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d13c2dfe30a89c5c60755e449836585222ceff --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Instance destroyed successfully.
Aug 22 03:09:54 user nova-compute[73469]: DEBUG nova.objects.instance [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lazy-loading 'resources' on Instance uuid 9d0668c0-7a49-4857-9b69-541021f18ab2 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d13c2dfe30a89c5c60755e449836585222ceff --force-share --output=json" returned: 0 in 0.193s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG nova.objects.instance [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'migration_context' on Instance uuid 149b34df-3d3c-48fc-99f2-0c3dc4334b1b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1254960621',display_name='tempest-ServerRescueNegativeTestJSON-server-1254960621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1254960621',id=2,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:57:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46cd52eb0f2642bc95dbf216ae280e12',ramdisk_id='',reservation_id='r-ijl84rjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2020570120',owner_user_name='tempest-ServerRescueNegativeTestJSON-2020570120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:59:22Z,user_data=None,user_id='64b023ffba814ac5b6a3bc4666107767',uuid=9d0668c0-7a49-4857-9b69-541021f18ab2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "address": "fa:16:3e:8e:27:47", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6148435c-1c", "ovs_interfaceid": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converting VIF {"id": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "address": "fa:16:3e:8e:27:47", "network": {"id": "dd500079-e9ed-4ed9-9c73-9e45f35fbd46", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1014104207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46cd52eb0f2642bc95dbf216ae280e12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6148435c-1c", "ovs_interfaceid": "6148435c-1cc6-4d56-baa1-4cfb2b3924f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:27:47,bridge_name='br-int',has_traffic_filtering=True,id=6148435c-1cc6-4d56-baa1-4cfb2b3924f6,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6148435c-1c') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG os_vif [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:27:47,bridge_name='br-int',has_traffic_filtering=True,id=6148435c-1cc6-4d56-baa1-4cfb2b3924f6,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6148435c-1c') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:09:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Rebasing disk image.
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6148435c-1c, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Updating instance_info_cache with network_info: [{"id": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "address": "fa:16:3e:0d:d7:78", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ca747b-f8", "ovs_interfaceid": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:09:54 user nova-compute[73469]: INFO os_vif [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:27:47,bridge_name='br-int',has_traffic_filtering=True,id=6148435c-1cc6-4d56-baa1-4cfb2b3924f6,network=Network(dd500079-e9ed-4ed9-9c73-9e45f35fbd46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6148435c-1c')
Aug 22 03:09:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Deleting instance files /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2_del
Aug 22 03:09:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Deletion of /opt/stack/data/nova/instances/9d0668c0-7a49-4857-9b69-541021f18ab2_del complete
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:09:54 user nova-compute[73469]: INFO nova.compute.manager [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.195s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc -F raw /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGAWgOoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:09:55 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:09:55 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:09:55 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[96122ceb-e742-44d5-b79a-a2316fa3e669]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:09:55 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[320f3aea-c881-4cf7-81b2-93b977f93647]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0] added
Aug 22 03:09:55 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:55 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Took 0.58 seconds to deallocate network for instance.
Aug 22 03:09:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-3628fad0-48a0-4268-8163-27f1eac669e0 req-dd780284-e5d2-429d-8147-dffc277f082f service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received event network-vif-deleted-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:09:55 user nova-compute[73469]: INFO nova.compute.manager [req-3628fad0-48a0-4268-8163-27f1eac669e0 req-dd780284-e5d2-429d-8147-dffc277f082f service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Neutron deleted interface 6148435c-1cc6-4d56-baa1-4cfb2b3924f6; detaching it from the instance and deleting it from the info cache
Aug 22 03:09:55 user nova-compute[73469]: DEBUG nova.network.neutron [req-3628fad0-48a0-4268-8163-27f1eac669e0 req-dd780284-e5d2-429d-8147-dffc277f082f service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.042s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a52e1e0-8723-4ff5-aaec-5ffaba175806]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5852dde8-a42d-4fb6-b661-36d6c7a6fd72]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UGAWgOoH {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-3628fad0-48a0-4268-8163-27f1eac669e0 req-dd780284-e5d2-429d-8147-dffc277f082f service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Detach interface failed, port_id=6148435c-1cc6-4d56-baa1-4cfb2b3924f6, reason: Instance 9d0668c0-7a49-4857-9b69-541021f18ab2 could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UGAWgOoH" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8b5c8f-a915-4fad-9d8c-76a3ee093916]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UGAWgOoH'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[02940c5f-5628-4029-ba53-6a8e4f77061e]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[315a4108-6628-43f9-933c-926cd3bcee56]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:09:55 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:09:55 user nova-compute[73469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a (non-flash)
Aug 22 03:09:55 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:09:55 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:09:55 user nova-compute[73469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a (non-flash)
Aug 22 03:09:55 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb5afb8-d2ec-4346-87b5-b82b6d22fa74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0, portal: 172.16.0.220,3260]
Aug 22 03:09:55 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0, portal: 172.16.0.220,3260] successful.
Aug 22 03:09:55 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e75aca-897d-49fd-b434-a0428f8192a4]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f055803-ad4b-4e52-9c09-12f06013fb06]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:09:55 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:09:55 user nova-compute[73469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a (non-flash)
Aug 22 03:09:55 user nova-compute[73469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:09:55 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:09:55 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:09:55 user nova-compute[73469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a (non-flash)
Aug 22 03:09:55 user nova-compute[73469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:09:55 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.438s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f40328c-9f8f-43b8-a517-94afd644fe96]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGAWgOoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:55 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Deleted allocations for instance 9d0668c0-7a49-4857-9b69-541021f18ab2
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-30f1ef4e-0401-4d41-9691-dae33993cb1e tempest-ServerRescueNegativeTestJSON-2020570120 tempest-ServerRescueNegativeTestJSON-2020570120-project-member] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.423s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.compute.manager [req-de1b1424-21b2-4870-b77b-ca7bd4f13277 req-91c7e5ee-7965-4686-9928-55d06a3ec941 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received event network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-de1b1424-21b2-4870-b77b-ca7bd4f13277 req-91c7e5ee-7965-4686-9928-55d06a3ec941 service nova] Acquiring lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-de1b1424-21b2-4870-b77b-ca7bd4f13277 req-91c7e5ee-7965-4686-9928-55d06a3ec941 service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-de1b1424-21b2-4870-b77b-ca7bd4f13277 req-91c7e5ee-7965-4686-9928-55d06a3ec941 service nova] Lock "9d0668c0-7a49-4857-9b69-541021f18ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.compute.manager [req-de1b1424-21b2-4870-b77b-ca7bd4f13277 req-91c7e5ee-7965-4686-9928-55d06a3ec941 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] No waiting events found dispatching network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:09:56 user nova-compute[73469]: WARNING nova.compute.manager [req-de1b1424-21b2-4870-b77b-ca7bd4f13277 req-91c7e5ee-7965-4686-9928-55d06a3ec941 service nova] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Received unexpected event network-vif-plugged-6148435c-1cc6-4d56-baa1-4cfb2b3924f6 for instance with vm_state deleted and task_state None.
Aug 22 03:09:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] <== connect_volume: return (1481ms) {'type': 'block', 'scsi_wwn': '26636346438646230', 'path': '/dev/sdd'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636346438646230', 'path': '/dev/sdd'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.objects.instance [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'flavor' on Instance uuid 228b721b-c7c4-4994-b1be-28234ea6a4fd {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:09:56 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:09:56 user nova-compute[73469]:   <source dev="/dev/sdd"/>
Aug 22 03:09:56 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:09:56 user nova-compute[73469]:   <serial>f59d6e5b-0893-4146-9943-1e46c59fa6d0</serial>
Aug 22 03:09:56 user nova-compute[73469]: </disk>
Aug 22 03:09:56 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc -F raw /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk" returned: 0 in 2.141s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Ensure instance console log exists: /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Start _get_guest_xml network_info=[{"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ab6f8607f9b895406b15bfbd4ba46f30',container_format='bare',created_at=2023-08-22T03:07:56Z,direct_url=<?>,disk_format='qcow2',id=1fc40bce-0ff4-4757-b125-885091ae7955,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-497177608-shelved',owner='ca3e1f2f72c7497ca3ad923a4b9459dc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-22T03:08:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:09:56 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:09:56 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ab6f8607f9b895406b15bfbd4ba46f30',container_format='bare',created_at=2023-08-22T03:07:56Z,direct_url=<?>,disk_format='qcow2',id=1fc40bce-0ff4-4757-b125-885091ae7955,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-497177608-shelved',owner='ca3e1f2f72c7497ca3ad923a4b9459dc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-22T03:08:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.objects.instance [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'vcpu_model' on Instance uuid 149b34df-3d3c-48fc-99f2-0c3dc4334b1b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-22T03:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-497177608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-497177608',id=29,image_ref='1fc40bce-0ff4-4757-b125-885091ae7955',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-884872358',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:06:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ca3e1f2f72c7497ca3ad923a4b9459dc',ramdisk_id='',reservation_id='r-rzj24vpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-774227889',owner_user_name='tempest-AttachVolumeShelveTestJSON-774227889-project-member',shelved_at='2023-08-22T03:08:01.295211',shelved_host='user',shelved_image_id='1fc40bce-0ff4-4757-b125-885091ae7955'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41e697cd5e5f422f8ac90f7496f60936',uuid=149b34df-3d3c-48fc-99f2-0c3dc4334b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converting VIF {"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:58,bridge_name='br-int',has_traffic_filtering=True,id=866b90b8-9ca8-4235-9f79-45d13fc5f929,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b90b8-9c') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.objects.instance [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'pci_devices' on Instance uuid 149b34df-3d3c-48fc-99f2-0c3dc4334b1b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:09:56 user nova-compute[73469]:   <uuid>149b34df-3d3c-48fc-99f2-0c3dc4334b1b</uuid>
Aug 22 03:09:56 user nova-compute[73469]:   <name>instance-0000001d</name>
Aug 22 03:09:56 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:09:56 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:09:56 user nova-compute[73469]:   <metadata>
Aug 22 03:09:56 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:09:56 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:09:56 user nova-compute[73469]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-497177608</nova:name>
Aug 22 03:09:56 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:09:56</nova:creationTime>
Aug 22 03:09:56 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:09:56 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:09:56 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:09:56 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:09:56 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:09:56 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:09:56 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:09:56 user nova-compute[73469]:       <nova:owner>
Aug 22 03:09:56 user nova-compute[73469]:         <nova:user uuid="41e697cd5e5f422f8ac90f7496f60936">tempest-AttachVolumeShelveTestJSON-774227889-project-member</nova:user>
Aug 22 03:09:56 user nova-compute[73469]:         <nova:project uuid="ca3e1f2f72c7497ca3ad923a4b9459dc">tempest-AttachVolumeShelveTestJSON-774227889</nova:project>
Aug 22 03:09:56 user nova-compute[73469]:       </nova:owner>
Aug 22 03:09:56 user nova-compute[73469]:       <nova:root type="image" uuid="1fc40bce-0ff4-4757-b125-885091ae7955"/>
Aug 22 03:09:56 user nova-compute[73469]:       <nova:ports>
Aug 22 03:09:56 user nova-compute[73469]:         <nova:port uuid="866b90b8-9ca8-4235-9f79-45d13fc5f929">
Aug 22 03:09:56 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 22 03:09:56 user nova-compute[73469]:         </nova:port>
Aug 22 03:09:56 user nova-compute[73469]:       </nova:ports>
Aug 22 03:09:56 user nova-compute[73469]:     </nova:instance>
Aug 22 03:09:56 user nova-compute[73469]:   </metadata>
Aug 22 03:09:56 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:09:56 user nova-compute[73469]:     <system>
Aug 22 03:09:56 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:09:56 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:09:56 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:09:56 user nova-compute[73469]:       <entry name="serial">149b34df-3d3c-48fc-99f2-0c3dc4334b1b</entry>
Aug 22 03:09:56 user nova-compute[73469]:       <entry name="uuid">149b34df-3d3c-48fc-99f2-0c3dc4334b1b</entry>
Aug 22 03:09:56 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:09:56 user nova-compute[73469]:     </system>
Aug 22 03:09:56 user nova-compute[73469]:   </sysinfo>
Aug 22 03:09:56 user nova-compute[73469]:   <os>
Aug 22 03:09:56 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:09:56 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:09:56 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:09:56 user nova-compute[73469]:   </os>
Aug 22 03:09:56 user nova-compute[73469]:   <features>
Aug 22 03:09:56 user nova-compute[73469]:     <acpi/>
Aug 22 03:09:56 user nova-compute[73469]:     <apic/>
Aug 22 03:09:56 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:09:56 user nova-compute[73469]:   </features>
Aug 22 03:09:56 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:09:56 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:09:56 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:09:56 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:09:56 user nova-compute[73469]:   </clock>
Aug 22 03:09:56 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:09:56 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:09:56 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:09:56 user nova-compute[73469]:   </cpu>
Aug 22 03:09:56 user nova-compute[73469]:   <devices>
Aug 22 03:09:56 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:09:56 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:09:56 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk"/>
Aug 22 03:09:56 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:09:56 user nova-compute[73469]:     </disk>
Aug 22 03:09:56 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:09:56 user nova-compute[73469]:       <mac address="fa:16:3e:a4:7b:58"/>
Aug 22 03:09:56 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:09:56 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:09:56 user nova-compute[73469]:       <target dev="tap866b90b8-9c"/>
Aug 22 03:09:56 user nova-compute[73469]:     </interface>
Aug 22 03:09:56 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:09:56 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/console.log" append="off"/>
Aug 22 03:09:56 user nova-compute[73469]:     </serial>
Aug 22 03:09:56 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:09:56 user nova-compute[73469]:     <video>
Aug 22 03:09:56 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:09:56 user nova-compute[73469]:     </video>
Aug 22 03:09:56 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:09:56 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:09:56 user nova-compute[73469]:     </rng>
Aug 22 03:09:56 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:09:56 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:09:56 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:09:56 user nova-compute[73469]:     </memballoon>
Aug 22 03:09:56 user nova-compute[73469]:   </devices>
Aug 22 03:09:56 user nova-compute[73469]: </domain>
Aug 22 03:09:56 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-22T03:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-497177608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-497177608',id=29,image_ref='1fc40bce-0ff4-4757-b125-885091ae7955',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-884872358',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:06:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ca3e1f2f72c7497ca3ad923a4b9459dc',ramdisk_id='',reservation_id='r-rzj24vpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-774227889',owner_user_name='tempest-AttachVolumeShelveTestJSON-774227889-project-member',shelved_at='2023-08-22T03:08:01.295211',shelved_host='user',shelved_image_id='1fc40bce-0ff4-4757-b125-885091ae7955'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41e697cd5e5f422f8ac90f7496f60936',uuid=149b34df-3d3c-48fc-99f2-0c3dc4334b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converting VIF {"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:58,bridge_name='br-int',has_traffic_filtering=True,id=866b90b8-9ca8-4235-9f79-45d13fc5f929,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b90b8-9c') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG os_vif [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:58,bridge_name='br-int',has_traffic_filtering=True,id=866b90b8-9ca8-4235-9f79-45d13fc5f929,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b90b8-9c') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap866b90b8-9c, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap866b90b8-9c, col_values=(('external_ids', {'iface-id': '866b90b8-9ca8-4235-9f79-45d13fc5f929', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:7b:58', 'vm-uuid': '149b34df-3d3c-48fc-99f2-0c3dc4334b1b'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:09:56 user nova-compute[73469]: INFO os_vif [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:58,bridge_name='br-int',has_traffic_filtering=True,id=866b90b8-9ca8-4235-9f79-45d13fc5f929,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b90b8-9c')
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] No VIF found with MAC fa:16:3e:a4:7b:58, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:09:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] No VIF found with MAC fa:16:3e:de:94:8a, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:09:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d34146aa-5ddd-41ab-8303-8ed3e3a5bb46 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.928s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:09:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:09:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:09:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673800.9860513, 149b34df-3d3c-48fc-99f2-0c3dc4334b1b => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:10:01 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] VM Resumed (Lifecycle Event)
Aug 22 03:10:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.manager [req-059634c2-4498-41db-89d1-353031080cf4 req-ecea393b-75ff-4926-8fc9-378ca71623ed service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received event network-vif-plugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-059634c2-4498-41db-89d1-353031080cf4 req-ecea393b-75ff-4926-8fc9-378ca71623ed service nova] Acquiring lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-059634c2-4498-41db-89d1-353031080cf4 req-ecea393b-75ff-4926-8fc9-378ca71623ed service nova] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-059634c2-4498-41db-89d1-353031080cf4 req-ecea393b-75ff-4926-8fc9-378ca71623ed service nova] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.manager [req-059634c2-4498-41db-89d1-353031080cf4 req-ecea393b-75ff-4926-8fc9-378ca71623ed service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] No waiting events found dispatching network-vif-plugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:10:01 user nova-compute[73469]: WARNING nova.compute.manager [req-059634c2-4498-41db-89d1-353031080cf4 req-ecea393b-75ff-4926-8fc9-378ca71623ed service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received unexpected event network-vif-plugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.manager [req-99b8249b-5d3b-40b0-9ef4-f7e028583299 req-03f7958b-b8b1-4833-ac91-9fd86f4c39c0 service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received event network-vif-plugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-99b8249b-5d3b-40b0-9ef4-f7e028583299 req-03f7958b-b8b1-4833-ac91-9fd86f4c39c0 service nova] Acquiring lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-99b8249b-5d3b-40b0-9ef4-f7e028583299 req-03f7958b-b8b1-4833-ac91-9fd86f4c39c0 service nova] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-99b8249b-5d3b-40b0-9ef4-f7e028583299 req-03f7958b-b8b1-4833-ac91-9fd86f4c39c0 service nova] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.manager [req-99b8249b-5d3b-40b0-9ef4-f7e028583299 req-03f7958b-b8b1-4833-ac91-9fd86f4c39c0 service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] No waiting events found dispatching network-vif-plugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:10:01 user nova-compute[73469]: WARNING nova.compute.manager [req-99b8249b-5d3b-40b0-9ef4-f7e028583299 req-03f7958b-b8b1-4833-ac91-9fd86f4c39c0 service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received unexpected event network-vif-plugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "475d431b-3b50-43ff-9bbb-14b3621a9f44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "475d431b-3b50-43ff-9bbb-14b3621a9f44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:10:01 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:10:01 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=7516MB free_disk=24.884944915771484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:01 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Instance spawned successfully.
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:10:01 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673800.98673, 149b34df-3d3c-48fc-99f2-0c3dc4334b1b => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:10:01 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] VM Started (Lifecycle Event)
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:01 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8242cec1-3b35-4d14-9e0b-db8a7e75697d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82e872a7-70b0-4290-9a11-5316765aed01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 980e57bf-dec9-46f3-8d69-e20a17603af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance e43158b8-28fc-429c-b329-26be91761d4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a7e95a46-9a75-4b0c-a5c9-42ed521668a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a0a019bd-fadd-46cb-ac48-d47bfc263b0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 228b721b-c7c4-4994-b1be-28234ea6a4fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance b5525c10-e097-4214-ad4f-7b3afcf53483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 475d431b-3b50-43ff-9bbb-14b3621a9f44 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0b0b7bd3-5ed7-4db9-9855-e9c2d09b9881 tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.310s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:02 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:10:02 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:10:02 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:10:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.669s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.520s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:02 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:10:02 user nova-compute[73469]: INFO nova.compute.claims [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Claim successful on node user
Aug 22 03:10:02 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:10:02 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:10:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:10:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:10:02 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:10:02 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:10:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:10:02 user nova-compute[73469]: DEBUG nova.policy [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25b830ec1451440f911d6578c8c55f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab150042073d4977b15414a3062d82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:10:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:10:02 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:10:02 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Creating image(s)
Aug 22 03:10:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "/opt/stack/data/nova/instances/475d431b-3b50-43ff-9bbb-14b3621a9f44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "/opt/stack/data/nova/instances/475d431b-3b50-43ff-9bbb-14b3621a9f44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "/opt/stack/data/nova/instances/475d431b-3b50-43ff-9bbb-14b3621a9f44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.194s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.185s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/475d431b-3b50-43ff-9bbb-14b3621a9f44/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/475d431b-3b50-43ff-9bbb-14b3621a9f44/disk 1073741824" returned: 0 in 0.064s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Successfully created port: 5263e48c-6e86-49a0-9de4-f383d00b9d7e {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.248s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Checking if we can resize image /opt/stack/data/nova/instances/475d431b-3b50-43ff-9bbb-14b3621a9f44/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/475d431b-3b50-43ff-9bbb-14b3621a9f44/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/475d431b-3b50-43ff-9bbb-14b3621a9f44/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Cannot resize image /opt/stack/data/nova/instances/475d431b-3b50-43ff-9bbb-14b3621a9f44/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG nova.objects.instance [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'migration_context' on Instance uuid 475d431b-3b50-43ff-9bbb-14b3621a9f44 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Ensure instance console log exists: /opt/stack/data/nova/instances/475d431b-3b50-43ff-9bbb-14b3621a9f44/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Successfully updated port: 5263e48c-6e86-49a0-9de4-f383d00b9d7e {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "refresh_cache-475d431b-3b50-43ff-9bbb-14b3621a9f44" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquired lock "refresh_cache-475d431b-3b50-43ff-9bbb-14b3621a9f44" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.compute.manager [req-b007fce5-05eb-4499-ba9b-5e010293a781 req-c42e97be-acea-4f4d-b87c-6900be980cc0 service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Received event network-changed-5263e48c-6e86-49a0-9de4-f383d00b9d7e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.compute.manager [req-b007fce5-05eb-4499-ba9b-5e010293a781 req-c42e97be-acea-4f4d-b87c-6900be980cc0 service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Refreshing instance network info cache due to event network-changed-5263e48c-6e86-49a0-9de4-f383d00b9d7e. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b007fce5-05eb-4499-ba9b-5e010293a781 req-c42e97be-acea-4f4d-b87c-6900be980cc0 service nova] Acquiring lock "refresh_cache-475d431b-3b50-43ff-9bbb-14b3621a9f44" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Updating instance_info_cache with network_info: [{"id": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "address": "fa:16:3e:ab:f1:1d", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e48c-6e", "ovs_interfaceid": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Releasing lock "refresh_cache-475d431b-3b50-43ff-9bbb-14b3621a9f44" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Instance network_info: |[{"id": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "address": "fa:16:3e:ab:f1:1d", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e48c-6e", "ovs_interfaceid": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b007fce5-05eb-4499-ba9b-5e010293a781 req-c42e97be-acea-4f4d-b87c-6900be980cc0 service nova] Acquired lock "refresh_cache-475d431b-3b50-43ff-9bbb-14b3621a9f44" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.network.neutron [req-b007fce5-05eb-4499-ba9b-5e010293a781 req-c42e97be-acea-4f4d-b87c-6900be980cc0 service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Refreshing network info cache for port 5263e48c-6e86-49a0-9de4-f383d00b9d7e {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Start _get_guest_xml network_info=[{"id": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "address": "fa:16:3e:ab:f1:1d", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e48c-6e", "ovs_interfaceid": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:10:04 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:10:04 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:10:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1236898622',display_name='tempest-AttachVolumeNegativeTest-server-1236898622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1236898622',id=34,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwAYFI6cbjo+Mdgy6ggeihpeU03Ou33SxrJa0TYtaTW6QkPhISNofm9abz/rXsnoPv3YQkPAqDTZ1J2DRIFila2ChRgBMW/3BEJtQ+LUj6w310yAYhqZt08J6y87+9Quw==',key_name='tempest-keypair-675782615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab150042073d4977b15414a3062d82fd',ramdisk_id='',reservation_id='r-3jkjknp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-356032718',owner_user_name='tempest-AttachVolumeNegativeTest-356032718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:10:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25b830ec1451440f911d6578c8c55f3d',uuid=475d431b-3b50-43ff-9bbb-14b3621a9f44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "address": "fa:16:3e:ab:f1:1d", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e48c-6e", "ovs_interfaceid": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converting VIF {"id": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "address": "fa:16:3e:ab:f1:1d", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e48c-6e", "ovs_interfaceid": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f1:1d,bridge_name='br-int',has_traffic_filtering=True,id=5263e48c-6e86-49a0-9de4-f383d00b9d7e,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5263e48c-6e') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.objects.instance [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'pci_devices' on Instance uuid 475d431b-3b50-43ff-9bbb-14b3621a9f44 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:10:04 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:10:04 user nova-compute[73469]:   <uuid>475d431b-3b50-43ff-9bbb-14b3621a9f44</uuid>
Aug 22 03:10:04 user nova-compute[73469]:   <name>instance-00000022</name>
Aug 22 03:10:04 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:10:04 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:10:04 user nova-compute[73469]:   <metadata>
Aug 22 03:10:04 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:10:04 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:10:04 user nova-compute[73469]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1236898622</nova:name>
Aug 22 03:10:04 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:10:04</nova:creationTime>
Aug 22 03:10:04 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:10:04 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:10:04 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:10:04 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:10:04 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:10:04 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:10:04 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:10:04 user nova-compute[73469]:       <nova:owner>
Aug 22 03:10:04 user nova-compute[73469]:         <nova:user uuid="25b830ec1451440f911d6578c8c55f3d">tempest-AttachVolumeNegativeTest-356032718-project-member</nova:user>
Aug 22 03:10:04 user nova-compute[73469]:         <nova:project uuid="ab150042073d4977b15414a3062d82fd">tempest-AttachVolumeNegativeTest-356032718</nova:project>
Aug 22 03:10:04 user nova-compute[73469]:       </nova:owner>
Aug 22 03:10:04 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:10:04 user nova-compute[73469]:       <nova:ports>
Aug 22 03:10:04 user nova-compute[73469]:         <nova:port uuid="5263e48c-6e86-49a0-9de4-f383d00b9d7e">
Aug 22 03:10:04 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 22 03:10:04 user nova-compute[73469]:         </nova:port>
Aug 22 03:10:04 user nova-compute[73469]:       </nova:ports>
Aug 22 03:10:04 user nova-compute[73469]:     </nova:instance>
Aug 22 03:10:04 user nova-compute[73469]:   </metadata>
Aug 22 03:10:04 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:10:04 user nova-compute[73469]:     <system>
Aug 22 03:10:04 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:10:04 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:10:04 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:10:04 user nova-compute[73469]:       <entry name="serial">475d431b-3b50-43ff-9bbb-14b3621a9f44</entry>
Aug 22 03:10:04 user nova-compute[73469]:       <entry name="uuid">475d431b-3b50-43ff-9bbb-14b3621a9f44</entry>
Aug 22 03:10:04 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:10:04 user nova-compute[73469]:     </system>
Aug 22 03:10:04 user nova-compute[73469]:   </sysinfo>
Aug 22 03:10:04 user nova-compute[73469]:   <os>
Aug 22 03:10:04 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:10:04 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:10:04 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:10:04 user nova-compute[73469]:   </os>
Aug 22 03:10:04 user nova-compute[73469]:   <features>
Aug 22 03:10:04 user nova-compute[73469]:     <acpi/>
Aug 22 03:10:04 user nova-compute[73469]:     <apic/>
Aug 22 03:10:04 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:10:04 user nova-compute[73469]:   </features>
Aug 22 03:10:04 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:10:04 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:10:04 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:10:04 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:10:04 user nova-compute[73469]:   </clock>
Aug 22 03:10:04 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:10:04 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:10:04 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:10:04 user nova-compute[73469]:   </cpu>
Aug 22 03:10:04 user nova-compute[73469]:   <devices>
Aug 22 03:10:04 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:10:04 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:10:04 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/475d431b-3b50-43ff-9bbb-14b3621a9f44/disk"/>
Aug 22 03:10:04 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:10:04 user nova-compute[73469]:     </disk>
Aug 22 03:10:04 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:10:04 user nova-compute[73469]:       <mac address="fa:16:3e:ab:f1:1d"/>
Aug 22 03:10:04 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:10:04 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:10:04 user nova-compute[73469]:       <target dev="tap5263e48c-6e"/>
Aug 22 03:10:04 user nova-compute[73469]:     </interface>
Aug 22 03:10:04 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:10:04 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/475d431b-3b50-43ff-9bbb-14b3621a9f44/console.log" append="off"/>
Aug 22 03:10:04 user nova-compute[73469]:     </serial>
Aug 22 03:10:04 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:10:04 user nova-compute[73469]:     <video>
Aug 22 03:10:04 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:10:04 user nova-compute[73469]:     </video>
Aug 22 03:10:04 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:10:04 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:10:04 user nova-compute[73469]:     </rng>
Aug 22 03:10:04 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:10:04 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:10:04 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:10:04 user nova-compute[73469]:     </memballoon>
Aug 22 03:10:04 user nova-compute[73469]:   </devices>
Aug 22 03:10:04 user nova-compute[73469]: </domain>
Aug 22 03:10:04 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:10:05 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:10:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1236898622',display_name='tempest-AttachVolumeNegativeTest-server-1236898622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1236898622',id=34,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwAYFI6cbjo+Mdgy6ggeihpeU03Ou33SxrJa0TYtaTW6QkPhISNofm9abz/rXsnoPv3YQkPAqDTZ1J2DRIFila2ChRgBMW/3BEJtQ+LUj6w310yAYhqZt08J6y87+9Quw==',key_name='tempest-keypair-675782615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab150042073d4977b15414a3062d82fd',ramdisk_id='',reservation_id='r-3jkjknp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-356032718',owner_user_name='tempest-AttachVolumeNegativeTest-356032718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:10:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25b830ec1451440f911d6578c8c55f3d',uuid=475d431b-3b50-43ff-9bbb-14b3621a9f44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "address": "fa:16:3e:ab:f1:1d", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e48c-6e", "ovs_interfaceid": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:10:05 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converting VIF {"id": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "address": "fa:16:3e:ab:f1:1d", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e48c-6e", "ovs_interfaceid": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:10:05 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f1:1d,bridge_name='br-int',has_traffic_filtering=True,id=5263e48c-6e86-49a0-9de4-f383d00b9d7e,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5263e48c-6e') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:10:05 user nova-compute[73469]: DEBUG os_vif [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f1:1d,bridge_name='br-int',has_traffic_filtering=True,id=5263e48c-6e86-49a0-9de4-f383d00b9d7e,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5263e48c-6e') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:10:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:10:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:10:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5263e48c-6e, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:10:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5263e48c-6e, col_values=(('external_ids', {'iface-id': '5263e48c-6e86-49a0-9de4-f383d00b9d7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:f1:1d', 'vm-uuid': '475d431b-3b50-43ff-9bbb-14b3621a9f44'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:10:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:10:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:05 user nova-compute[73469]: INFO os_vif [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f1:1d,bridge_name='br-int',has_traffic_filtering=True,id=5263e48c-6e86-49a0-9de4-f383d00b9d7e,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5263e48c-6e')
Aug 22 03:10:05 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:10:05 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] No VIF found with MAC fa:16:3e:ab:f1:1d, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:10:05 user nova-compute[73469]: DEBUG nova.network.neutron [req-b007fce5-05eb-4499-ba9b-5e010293a781 req-c42e97be-acea-4f4d-b87c-6900be980cc0 service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Updated VIF entry in instance network info cache for port 5263e48c-6e86-49a0-9de4-f383d00b9d7e. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:10:05 user nova-compute[73469]: DEBUG nova.network.neutron [req-b007fce5-05eb-4499-ba9b-5e010293a781 req-c42e97be-acea-4f4d-b87c-6900be980cc0 service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Updating instance_info_cache with network_info: [{"id": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "address": "fa:16:3e:ab:f1:1d", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e48c-6e", "ovs_interfaceid": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:10:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b007fce5-05eb-4499-ba9b-5e010293a781 req-c42e97be-acea-4f4d-b87c-6900be980cc0 service nova] Releasing lock "refresh_cache-475d431b-3b50-43ff-9bbb-14b3621a9f44" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aAtZlPRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:10:06 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:10:06 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:10:06 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9282f831-8d1e-4cd2-a852-860c6ab5fb45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:10:06 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37b0a75-607d-4cba-a74e-cf9f1668bc4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b] added
Aug 22 03:10:06 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[05535fb0-f187-45d8-9af8-616816c75331]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[333f2c35-709a-4f41-99d9-b14e99441231]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aAtZlPRJ {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aAtZlPRJ" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b4df27-8717-4adc-a0f2-e87ff50a6dab]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aAtZlPRJ'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b48001e-d66d-4936-b9ad-126418239386]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14b1f90-e58d-4afe-85cd-c65b57608ddf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:10:06 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:10:06 user nova-compute[73469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a (non-flash)
Aug 22 03:10:06 user nova-compute[73469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:10:06 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:10:06 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:10:06 user nova-compute[73469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a (non-flash)
Aug 22 03:10:06 user nova-compute[73469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:10:06 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[160b2863-c53f-4395-9215-510cd1c3599f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b, portal: 172.16.0.220,3260]
Aug 22 03:10:06 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b, portal: 172.16.0.220,3260] successful.
Aug 22 03:10:06 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG nova.compute.manager [req-85a92a32-54de-43c2-9efb-3fa9fdddd63e req-4f7b19d0-d13b-466e-938a-49e07c11b50b service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Received event network-vif-plugged-5263e48c-6e86-49a0-9de4-f383d00b9d7e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-85a92a32-54de-43c2-9efb-3fa9fdddd63e req-4f7b19d0-d13b-466e-938a-49e07c11b50b service nova] Acquiring lock "475d431b-3b50-43ff-9bbb-14b3621a9f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-85a92a32-54de-43c2-9efb-3fa9fdddd63e req-4f7b19d0-d13b-466e-938a-49e07c11b50b service nova] Lock "475d431b-3b50-43ff-9bbb-14b3621a9f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-85a92a32-54de-43c2-9efb-3fa9fdddd63e req-4f7b19d0-d13b-466e-938a-49e07c11b50b service nova] Lock "475d431b-3b50-43ff-9bbb-14b3621a9f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG nova.compute.manager [req-85a92a32-54de-43c2-9efb-3fa9fdddd63e req-4f7b19d0-d13b-466e-938a-49e07c11b50b service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] No waiting events found dispatching network-vif-plugged-5263e48c-6e86-49a0-9de4-f383d00b9d7e {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:10:06 user nova-compute[73469]: WARNING nova.compute.manager [req-85a92a32-54de-43c2-9efb-3fa9fdddd63e req-4f7b19d0-d13b-466e-938a-49e07c11b50b service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Received unexpected event network-vif-plugged-5263e48c-6e86-49a0-9de4-f383d00b9d7e for instance with vm_state building and task_state spawning.
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef55327-144b-42c5-93e0-686d18811c2d]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[730e872d-f1e8-4a56-bbec-32a68305f7aa]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:10:06 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:10:06 user nova-compute[73469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a (non-flash)
Aug 22 03:10:06 user nova-compute[73469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:10:06 user nova-compute[73469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b (non-flash)
Aug 22 03:10:06 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:10:06 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:10:06 user nova-compute[73469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a (non-flash)
Aug 22 03:10:06 user nova-compute[73469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:10:06 user nova-compute[73469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b (non-flash)
Aug 22 03:10:06 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[defca96f-547b-4132-94f7-5c460e0b2a7f]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:10:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aAtZlPRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:10:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:10:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26465633633323031', 'path': '/dev/sde'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:10:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465633633323031', 'path': '/dev/sde'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:10:07 user nova-compute[73469]: DEBUG nova.objects.instance [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'flavor' on Instance uuid a0a019bd-fadd-46cb-ac48-d47bfc263b0c {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:10:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:10:07 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:10:07 user nova-compute[73469]:   <source dev="/dev/sde"/>
Aug 22 03:10:07 user nova-compute[73469]:   <target dev="vdc" bus="virtio"/>
Aug 22 03:10:07 user nova-compute[73469]:   <serial>1344efaf-e3fd-46a7-88ed-e471f3e9f36b</serial>
Aug 22 03:10:07 user nova-compute[73469]: </disk>
Aug 22 03:10:07 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] No VIF found with MAC fa:16:3e:df:6e:f3, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-59ba94f9-e39a-4269-912e-c7d9276702a2 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.388s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673808.7263122, 475d431b-3b50-43ff-9bbb-14b3621a9f44 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:10:08 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] VM Resumed (Lifecycle Event)
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:10:08 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Instance spawned successfully.
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:10:08 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673808.7268941, 475d431b-3b50-43ff-9bbb-14b3621a9f44 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:10:08 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] VM Started (Lifecycle Event)
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-992ca980-2b2e-4f81-b08f-599ff72e3c2a req-09327c1b-49f4-4bd0-82c3-5be62a6b0224 service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Received event network-vif-plugged-5263e48c-6e86-49a0-9de4-f383d00b9d7e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-992ca980-2b2e-4f81-b08f-599ff72e3c2a req-09327c1b-49f4-4bd0-82c3-5be62a6b0224 service nova] Acquiring lock "475d431b-3b50-43ff-9bbb-14b3621a9f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-992ca980-2b2e-4f81-b08f-599ff72e3c2a req-09327c1b-49f4-4bd0-82c3-5be62a6b0224 service nova] Lock "475d431b-3b50-43ff-9bbb-14b3621a9f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-992ca980-2b2e-4f81-b08f-599ff72e3c2a req-09327c1b-49f4-4bd0-82c3-5be62a6b0224 service nova] Lock "475d431b-3b50-43ff-9bbb-14b3621a9f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-992ca980-2b2e-4f81-b08f-599ff72e3c2a req-09327c1b-49f4-4bd0-82c3-5be62a6b0224 service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] No waiting events found dispatching network-vif-plugged-5263e48c-6e86-49a0-9de4-f383d00b9d7e {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:10:08 user nova-compute[73469]: WARNING nova.compute.manager [req-992ca980-2b2e-4f81-b08f-599ff72e3c2a req-09327c1b-49f4-4bd0-82c3-5be62a6b0224 service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Received unexpected event network-vif-plugged-5263e48c-6e86-49a0-9de4-f383d00b9d7e for instance with vm_state building and task_state spawning.
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:10:08 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:10:08 user nova-compute[73469]: INFO nova.compute.manager [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Took 5.95 seconds to spawn the instance on the hypervisor.
Aug 22 03:10:08 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:10:08 user nova-compute[73469]: INFO nova.compute.manager [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Took 7.43 seconds to build instance.
Aug 22 03:10:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6c4df591-9e60-4731-a7bb-64f38b0435e9 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "475d431b-3b50-43ff-9bbb-14b3621a9f44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.570s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:09 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673794.3289638, 9d0668c0-7a49-4857-9b69-541021f18ab2 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:10:09 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] VM Stopped (Lifecycle Event)
Aug 22 03:10:09 user nova-compute[73469]: DEBUG nova.compute.manager [None req-8df8ab9c-9275-49a7-bbed-bbccc2712572 None None] [instance: 9d0668c0-7a49-4857-9b69-541021f18ab2] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:10 user nova-compute[73469]: INFO nova.compute.manager [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Detaching volume 5c1c2e12-d98c-41d6-a037-a1401a998c3a
Aug 22 03:10:10 user nova-compute[73469]: INFO nova.virt.block_device [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Attempting to driver detach volume 5c1c2e12-d98c-41d6-a037-a1401a998c3a from mountpoint /dev/vdb
Aug 22 03:10:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Attempting to detach device vdb from instance a0a019bd-fadd-46cb-ac48-d47bfc263b0c from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:10:10 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:10:10 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:10:10 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:10:10 user nova-compute[73469]:   <serial>5c1c2e12-d98c-41d6-a037-a1401a998c3a</serial>
Aug 22 03:10:10 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:10:10 user nova-compute[73469]: </disk>
Aug 22 03:10:10 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:10:10 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Successfully detached device vdb from instance a0a019bd-fadd-46cb-ac48-d47bfc263b0c from the persistent domain config.
Aug 22 03:10:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a0a019bd-fadd-46cb-ac48-d47bfc263b0c from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:10:10 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:10:10 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:10:10 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:10:10 user nova-compute[73469]:   <serial>5c1c2e12-d98c-41d6-a037-a1401a998c3a</serial>
Aug 22 03:10:10 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:10:10 user nova-compute[73469]: </disk>
Aug 22 03:10:10 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692673810.6068506, a0a019bd-fadd-46cb-ac48-d47bfc263b0c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a0a019bd-fadd-46cb-ac48-d47bfc263b0c {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:10:10 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Successfully detached device vdb from instance a0a019bd-fadd-46cb-ac48-d47bfc263b0c from the live domain config.
Aug 22 03:10:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMKsnJDZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:10:10 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:10:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eda9b0c-3f88-4651-9afd-d343f2d26361]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[624e1c6e-fc13-437a-9f7b-7fbb6ac129a6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:10:10 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:10:10 user nova-compute[73469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a (non-flash)
Aug 22 03:10:10 user nova-compute[73469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:10:10 user nova-compute[73469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b (non-flash)
Aug 22 03:10:10 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:10:10 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:10:10 user nova-compute[73469]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a (non-flash)
Aug 22 03:10:10 user nova-compute[73469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:10:10 user nova-compute[73469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b (non-flash)
Aug 22 03:10:10 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a413b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e494c4fe-1f97-449c-8ced-71336750f7c2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[71df4fc4-59c3-4f44-bb27-78ef87fb76b8]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2732c8-e676-4b77-9506-93c11bf5e5f3]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[254a7eea-7ca2-4996-9c08-0ae85f6f2c84]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac092e74-1e03-4821-b48e-c3fa3773c008]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c61b82-6dbc-4c75-8fa2-501657ec0e11]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a, portal: 172.16.0.220,3260]
Aug 22 03:10:10 user nova-compute[73469]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a, portal: 172.16.0.220,3260] successful.
Aug 22 03:10:10 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1c2e12-d98c-41d6-a037-a1401a998c3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e245df-58a7-4227-9c6d-833c8956de95]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] <== disconnect_volume: return (314ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:10:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:10:11 user nova-compute[73469]: DEBUG nova.objects.instance [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'flavor' on Instance uuid a0a019bd-fadd-46cb-ac48-d47bfc263b0c {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:10:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-3584c9f4-3653-48b3-bbe1-9922123e1bb0 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.835s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:12 user nova-compute[73469]: INFO nova.compute.manager [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Detaching volume 1344efaf-e3fd-46a7-88ed-e471f3e9f36b
Aug 22 03:10:12 user nova-compute[73469]: INFO nova.virt.block_device [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Attempting to driver detach volume 1344efaf-e3fd-46a7-88ed-e471f3e9f36b from mountpoint /dev/vdc
Aug 22 03:10:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Attempting to detach device vdc from instance a0a019bd-fadd-46cb-ac48-d47bfc263b0c from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:10:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:10:12 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:10:12 user nova-compute[73469]:   <source dev="/dev/sde"/>
Aug 22 03:10:12 user nova-compute[73469]:   <target dev="vdc" bus="virtio"/>
Aug 22 03:10:12 user nova-compute[73469]:   <serial>1344efaf-e3fd-46a7-88ed-e471f3e9f36b</serial>
Aug 22 03:10:12 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 22 03:10:12 user nova-compute[73469]: </disk>
Aug 22 03:10:12 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:10:12 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Successfully detached device vdc from instance a0a019bd-fadd-46cb-ac48-d47bfc263b0c from the persistent domain config.
Aug 22 03:10:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a0a019bd-fadd-46cb-ac48-d47bfc263b0c from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:10:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:10:12 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:10:12 user nova-compute[73469]:   <source dev="/dev/sde"/>
Aug 22 03:10:12 user nova-compute[73469]:   <target dev="vdc" bus="virtio"/>
Aug 22 03:10:12 user nova-compute[73469]:   <serial>1344efaf-e3fd-46a7-88ed-e471f3e9f36b</serial>
Aug 22 03:10:12 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 22 03:10:12 user nova-compute[73469]: </disk>
Aug 22 03:10:12 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692673813.1213303, a0a019bd-fadd-46cb-ac48-d47bfc263b0c => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a0a019bd-fadd-46cb-ac48-d47bfc263b0c {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:10:13 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Successfully detached device vdc from instance a0a019bd-fadd-46cb-ac48-d47bfc263b0c from the live domain config.
Aug 22 03:10:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aAtZlPRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:10:13 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:10:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[80249b5e-1be3-492d-b099-1676dba7e9ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28638f0-d32c-4e76-b936-2db4589fa3cb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:10:13 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:10:13 user nova-compute[73469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:10:13 user nova-compute[73469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b (non-flash)
Aug 22 03:10:13 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:10:13 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:10:13 user nova-compute[73469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:10:13 user nova-compute[73469]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b (non-flash)
Aug 22 03:10:13 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f798051ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b'): ({'sde'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Removing single pathed devices sde {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[39085eb0-90a4-4dd2-94c8-e0eb7b99edd9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59773a6-112a-44dd-a201-b53f6bce5d4b]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Flushing IO for device /dev/sde {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab45fd5-ebdc-4066-93c1-ef949f51c7a8]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[051f0cad-6987-4510-922b-15725cdb647b]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] SCSI volumes sde have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[00abdbb6-da15-4df6-953b-59cfd3057fc6]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4862b90-f3e8-4274-894b-ec18efd512ca]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b, portal: 172.16.0.220,3260]
Aug 22 03:10:13 user nova-compute[73469]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b, portal: 172.16.0.220,3260] successful.
Aug 22 03:10:13 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1344efaf-e3fd-46a7-88ed-e471f3e9f36b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[767d2ea6-0cd6-4b2b-bec8-bc1df2a85e4a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] <== disconnect_volume: return (331ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:10:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:10:14 user nova-compute[73469]: DEBUG nova.objects.instance [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'flavor' on Instance uuid a0a019bd-fadd-46cb-ac48-d47bfc263b0c {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:10:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4f7f8b51-c5ab-46c0-b99a-eef140903d31 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.869s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:15 user nova-compute[73469]: INFO nova.compute.manager [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Terminating instance
Aug 22 03:10:15 user nova-compute[73469]: DEBUG nova.compute.manager [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG nova.compute.manager [req-6c245f59-ef18-4d5c-b7eb-84134c843bc4 req-cd49979e-7d89-47c3-8519-fa1c1f10191c service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Received event network-vif-unplugged-135c6c26-00c9-4174-8b5d-51002185def1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6c245f59-ef18-4d5c-b7eb-84134c843bc4 req-cd49979e-7d89-47c3-8519-fa1c1f10191c service nova] Acquiring lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6c245f59-ef18-4d5c-b7eb-84134c843bc4 req-cd49979e-7d89-47c3-8519-fa1c1f10191c service nova] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6c245f59-ef18-4d5c-b7eb-84134c843bc4 req-cd49979e-7d89-47c3-8519-fa1c1f10191c service nova] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG nova.compute.manager [req-6c245f59-ef18-4d5c-b7eb-84134c843bc4 req-cd49979e-7d89-47c3-8519-fa1c1f10191c service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] No waiting events found dispatching network-vif-unplugged-135c6c26-00c9-4174-8b5d-51002185def1 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG nova.compute.manager [req-6c245f59-ef18-4d5c-b7eb-84134c843bc4 req-cd49979e-7d89-47c3-8519-fa1c1f10191c service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Received event network-vif-unplugged-135c6c26-00c9-4174-8b5d-51002185def1 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:10:15 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Instance destroyed successfully.
Aug 22 03:10:15 user nova-compute[73469]: DEBUG nova.objects.instance [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lazy-loading 'resources' on Instance uuid a0a019bd-fadd-46cb-ac48-d47bfc263b0c {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-790075097',display_name='tempest-AttachVolumeTestJSON-server-790075097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-790075097',id=31,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIANewk1ubOhUIMRi5IAPT+T3QpuYOFlznIx9x7Joo0Nk2oKfelUbpFBqljS4d8T6YH02em6RHostSLYkwHzrvmRd4PYZ+jeZZdAFSrf7cP7wp9BdSAU4KrDdd+Cah3y0A==',key_name='tempest-keypair-1715971158',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:07:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e49e405f5aca432097b7ba854fd3055b',ramdisk_id='',reservation_id='r-m9qao35k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-356928747',owner_user_name='tempest-AttachVolumeTestJSON-356928747-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:07:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e62d25dff554a629a7e0af1406d97a9',uuid=a0a019bd-fadd-46cb-ac48-d47bfc263b0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "135c6c26-00c9-4174-8b5d-51002185def1", "address": "fa:16:3e:df:6e:f3", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c6c26-00", "ovs_interfaceid": "135c6c26-00c9-4174-8b5d-51002185def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converting VIF {"id": "135c6c26-00c9-4174-8b5d-51002185def1", "address": "fa:16:3e:df:6e:f3", "network": {"id": "27d580b5-dbbe-4440-9b08-7c21e190d297", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-789280974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49e405f5aca432097b7ba854fd3055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135c6c26-00", "ovs_interfaceid": "135c6c26-00c9-4174-8b5d-51002185def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:6e:f3,bridge_name='br-int',has_traffic_filtering=True,id=135c6c26-00c9-4174-8b5d-51002185def1,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135c6c26-00') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG os_vif [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:6e:f3,bridge_name='br-int',has_traffic_filtering=True,id=135c6c26-00c9-4174-8b5d-51002185def1,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135c6c26-00') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap135c6c26-00, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:10:15 user nova-compute[73469]: INFO os_vif [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:6e:f3,bridge_name='br-int',has_traffic_filtering=True,id=135c6c26-00c9-4174-8b5d-51002185def1,network=Network(27d580b5-dbbe-4440-9b08-7c21e190d297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135c6c26-00')
Aug 22 03:10:15 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Deleting instance files /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c_del
Aug 22 03:10:15 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Deletion of /opt/stack/data/nova/instances/a0a019bd-fadd-46cb-ac48-d47bfc263b0c_del complete
Aug 22 03:10:16 user nova-compute[73469]: INFO nova.compute.manager [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 22 03:10:16 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:10:16 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:10:16 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:10:16 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:10:16 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Took 0.88 seconds to deallocate network for instance.
Aug 22 03:10:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:17 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:10:17 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:10:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:17 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Deleted allocations for instance a0a019bd-fadd-46cb-ac48-d47bfc263b0c
Aug 22 03:10:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0a748cb2-3b4c-462f-a60a-1632366c6180 tempest-AttachVolumeTestJSON-356928747 tempest-AttachVolumeTestJSON-356928747-project-member] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.321s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:17 user nova-compute[73469]: DEBUG nova.compute.manager [req-a98af085-ccb1-4af7-a8e4-57dde5158158 req-ea674fb5-7f49-4aed-a873-7622d918d57b service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Received event network-vif-plugged-135c6c26-00c9-4174-8b5d-51002185def1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:10:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a98af085-ccb1-4af7-a8e4-57dde5158158 req-ea674fb5-7f49-4aed-a873-7622d918d57b service nova] Acquiring lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a98af085-ccb1-4af7-a8e4-57dde5158158 req-ea674fb5-7f49-4aed-a873-7622d918d57b service nova] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a98af085-ccb1-4af7-a8e4-57dde5158158 req-ea674fb5-7f49-4aed-a873-7622d918d57b service nova] Lock "a0a019bd-fadd-46cb-ac48-d47bfc263b0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:17 user nova-compute[73469]: DEBUG nova.compute.manager [req-a98af085-ccb1-4af7-a8e4-57dde5158158 req-ea674fb5-7f49-4aed-a873-7622d918d57b service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] No waiting events found dispatching network-vif-plugged-135c6c26-00c9-4174-8b5d-51002185def1 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:10:17 user nova-compute[73469]: WARNING nova.compute.manager [req-a98af085-ccb1-4af7-a8e4-57dde5158158 req-ea674fb5-7f49-4aed-a873-7622d918d57b service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Received unexpected event network-vif-plugged-135c6c26-00c9-4174-8b5d-51002185def1 for instance with vm_state deleted and task_state None.
Aug 22 03:10:17 user nova-compute[73469]: DEBUG nova.compute.manager [req-a98af085-ccb1-4af7-a8e4-57dde5158158 req-ea674fb5-7f49-4aed-a873-7622d918d57b service nova] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Received event network-vif-deleted-135c6c26-00c9-4174-8b5d-51002185def1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:10:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquiring lock "b5525c10-e097-4214-ad4f-7b3afcf53483" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "b5525c10-e097-4214-ad4f-7b3afcf53483" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquiring lock "b5525c10-e097-4214-ad4f-7b3afcf53483-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "b5525c10-e097-4214-ad4f-7b3afcf53483-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "b5525c10-e097-4214-ad4f-7b3afcf53483-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:24 user nova-compute[73469]: INFO nova.compute.manager [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Terminating instance
Aug 22 03:10:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-90bd9932-9087-411d-8e2b-d723a3b4b714 req-d43e8bbf-6d97-4712-aec3-ef77318a1333 service nova] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Received event network-vif-unplugged-143adaa4-b7f9-4648-9224-1eb631e8120b {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-90bd9932-9087-411d-8e2b-d723a3b4b714 req-d43e8bbf-6d97-4712-aec3-ef77318a1333 service nova] Acquiring lock "b5525c10-e097-4214-ad4f-7b3afcf53483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-90bd9932-9087-411d-8e2b-d723a3b4b714 req-d43e8bbf-6d97-4712-aec3-ef77318a1333 service nova] Lock "b5525c10-e097-4214-ad4f-7b3afcf53483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-90bd9932-9087-411d-8e2b-d723a3b4b714 req-d43e8bbf-6d97-4712-aec3-ef77318a1333 service nova] Lock "b5525c10-e097-4214-ad4f-7b3afcf53483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-90bd9932-9087-411d-8e2b-d723a3b4b714 req-d43e8bbf-6d97-4712-aec3-ef77318a1333 service nova] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] No waiting events found dispatching network-vif-unplugged-143adaa4-b7f9-4648-9224-1eb631e8120b {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-90bd9932-9087-411d-8e2b-d723a3b4b714 req-d43e8bbf-6d97-4712-aec3-ef77318a1333 service nova] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Received event network-vif-unplugged-143adaa4-b7f9-4648-9224-1eb631e8120b for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:10:24 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Instance destroyed successfully.
Aug 22 03:10:24 user nova-compute[73469]: DEBUG nova.objects.instance [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lazy-loading 'resources' on Instance uuid b5525c10-e097-4214-ad4f-7b3afcf53483 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:08:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1653739734',display_name='tempest-ServersNegativeTestJSON-server-1653739734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1653739734',id=33,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:08:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cec2ad0547114410a036090a792d0645',ramdisk_id='',reservation_id='r-wk1j4f64',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1709480953',owner_user_name='tempest-ServersNegativeTestJSON-1709480953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:08:41Z,user_data=None,user_id='635f762a1488400fa57a6a9e244ddb42',uuid=b5525c10-e097-4214-ad4f-7b3afcf53483,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "143adaa4-b7f9-4648-9224-1eb631e8120b", "address": "fa:16:3e:a4:3c:33", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143adaa4-b7", "ovs_interfaceid": "143adaa4-b7f9-4648-9224-1eb631e8120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Converting VIF {"id": "143adaa4-b7f9-4648-9224-1eb631e8120b", "address": "fa:16:3e:a4:3c:33", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143adaa4-b7", "ovs_interfaceid": "143adaa4-b7f9-4648-9224-1eb631e8120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3c:33,bridge_name='br-int',has_traffic_filtering=True,id=143adaa4-b7f9-4648-9224-1eb631e8120b,network=Network(b1119133-216d-41a0-b227-d1e9e4aed153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143adaa4-b7') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG os_vif [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3c:33,bridge_name='br-int',has_traffic_filtering=True,id=143adaa4-b7f9-4648-9224-1eb631e8120b,network=Network(b1119133-216d-41a0-b227-d1e9e4aed153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143adaa4-b7') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap143adaa4-b7, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:10:24 user nova-compute[73469]: INFO os_vif [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3c:33,bridge_name='br-int',has_traffic_filtering=True,id=143adaa4-b7f9-4648-9224-1eb631e8120b,network=Network(b1119133-216d-41a0-b227-d1e9e4aed153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143adaa4-b7')
Aug 22 03:10:24 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Deleting instance files /opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483_del
Aug 22 03:10:24 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Deletion of /opt/stack/data/nova/instances/b5525c10-e097-4214-ad4f-7b3afcf53483_del complete
Aug 22 03:10:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:24 user nova-compute[73469]: INFO nova.compute.manager [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 22 03:10:24 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:10:24 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:10:25 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:10:25 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Took 0.80 seconds to deallocate network for instance.
Aug 22 03:10:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:25 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:10:25 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:10:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:25 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Deleted allocations for instance b5525c10-e097-4214-ad4f-7b3afcf53483
Aug 22 03:10:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0c9f5516-03b8-41eb-8dc5-8e89077b811e tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "b5525c10-e097-4214-ad4f-7b3afcf53483" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.964s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-43562c01-8ce3-4651-9cac-f8037c2b4b4f req-161b858e-caa8-4555-83e4-d8465523bda6 service nova] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Received event network-vif-plugged-143adaa4-b7f9-4648-9224-1eb631e8120b {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:10:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-43562c01-8ce3-4651-9cac-f8037c2b4b4f req-161b858e-caa8-4555-83e4-d8465523bda6 service nova] Acquiring lock "b5525c10-e097-4214-ad4f-7b3afcf53483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-43562c01-8ce3-4651-9cac-f8037c2b4b4f req-161b858e-caa8-4555-83e4-d8465523bda6 service nova] Lock "b5525c10-e097-4214-ad4f-7b3afcf53483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-43562c01-8ce3-4651-9cac-f8037c2b4b4f req-161b858e-caa8-4555-83e4-d8465523bda6 service nova] Lock "b5525c10-e097-4214-ad4f-7b3afcf53483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-43562c01-8ce3-4651-9cac-f8037c2b4b4f req-161b858e-caa8-4555-83e4-d8465523bda6 service nova] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] No waiting events found dispatching network-vif-plugged-143adaa4-b7f9-4648-9224-1eb631e8120b {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:10:26 user nova-compute[73469]: WARNING nova.compute.manager [req-43562c01-8ce3-4651-9cac-f8037c2b4b4f req-161b858e-caa8-4555-83e4-d8465523bda6 service nova] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Received unexpected event network-vif-plugged-143adaa4-b7f9-4648-9224-1eb631e8120b for instance with vm_state deleted and task_state None.
Aug 22 03:10:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-43562c01-8ce3-4651-9cac-f8037c2b4b4f req-161b858e-caa8-4555-83e4-d8465523bda6 service nova] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Received event network-vif-deleted-143adaa4-b7f9-4648-9224-1eb631e8120b {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:10:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:30 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673815.93742, a0a019bd-fadd-46cb-ac48-d47bfc263b0c => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:10:30 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] VM Stopped (Lifecycle Event)
Aug 22 03:10:30 user nova-compute[73469]: DEBUG nova.compute.manager [None req-2f61a655-c133-48aa-8b55-a31361d912f2 None None] [instance: a0a019bd-fadd-46cb-ac48-d47bfc263b0c] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:10:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "e43158b8-28fc-429c-b329-26be91761d4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "e43158b8-28fc-429c-b329-26be91761d4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "e43158b8-28fc-429c-b329-26be91761d4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:35 user nova-compute[73469]: INFO nova.compute.manager [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Terminating instance
Aug 22 03:10:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:10:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-52234c0c-6441-4d84-ac69-0f5d84373423 req-c027212e-f515-4b68-93e3-970eefcb2e08 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received event network-vif-unplugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:10:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-52234c0c-6441-4d84-ac69-0f5d84373423 req-c027212e-f515-4b68-93e3-970eefcb2e08 service nova] Acquiring lock "e43158b8-28fc-429c-b329-26be91761d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-52234c0c-6441-4d84-ac69-0f5d84373423 req-c027212e-f515-4b68-93e3-970eefcb2e08 service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-52234c0c-6441-4d84-ac69-0f5d84373423 req-c027212e-f515-4b68-93e3-970eefcb2e08 service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-52234c0c-6441-4d84-ac69-0f5d84373423 req-c027212e-f515-4b68-93e3-970eefcb2e08 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] No waiting events found dispatching network-vif-unplugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:10:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-52234c0c-6441-4d84-ac69-0f5d84373423 req-c027212e-f515-4b68-93e3-970eefcb2e08 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received event network-vif-unplugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:10:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:36 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Instance destroyed successfully.
Aug 22 03:10:36 user nova-compute[73469]: DEBUG nova.objects.instance [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'resources' on Instance uuid e43158b8-28fc-429c-b329-26be91761d4f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:04:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-159252147',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-159252147',id=28,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:07:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9131cb883044191931dc31e51e94766',ramdisk_id='',reservation_id='r-dm0r0052',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568629509',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:08:50Z,user_data=None,user_id='a7b228f99c9e4d058e128a5a99636b7b',uuid=e43158b8-28fc-429c-b329-26be91761d4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "address": "fa:16:3e:94:d6:2d", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbb3f1b-29", "ovs_interfaceid": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converting VIF {"id": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "address": "fa:16:3e:94:d6:2d", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbb3f1b-29", "ovs_interfaceid": "bbbb3f1b-29b6-4f01-9296-3452d13d0b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:d6:2d,bridge_name='br-int',has_traffic_filtering=True,id=bbbb3f1b-29b6-4f01-9296-3452d13d0b0c,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbbb3f1b-29') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG os_vif [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:d6:2d,bridge_name='br-int',has_traffic_filtering=True,id=bbbb3f1b-29b6-4f01-9296-3452d13d0b0c,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbbb3f1b-29') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbbb3f1b-29, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:36 user nova-compute[73469]: INFO os_vif [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:d6:2d,bridge_name='br-int',has_traffic_filtering=True,id=bbbb3f1b-29b6-4f01-9296-3452d13d0b0c,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbbb3f1b-29')
Aug 22 03:10:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgBPSsQo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:10:36 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:10:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16aaa72-b77d-45c2-b6f5-1624a17d4121]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b67be5-8c9d-4019-9e50-69b78e2d6a3f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:10:36 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:10:36 user nova-compute[73469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:10:36 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:10:36 user nova-compute[73469]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 (non-flash)
Aug 22 03:10:36 user nova-compute[73469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:10:36 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a413b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193'): ({'sdj'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Removing single pathed devices sdj {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b275c4e5-9ec2-48d2-8f08-f2a913eb83cc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[87de59ed-bc4f-4f3b-b3e0-d508dfd39c55]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Flushing IO for device /dev/sdj {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e003195-1293-4a5b-9e2c-85341d05dad1]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.053s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc94b82-49b9-42a3-b19b-24f50c2051cf]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] SCSI volumes sdj have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[65400419-b25c-4bef-b52c-7566ceb1648e]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5737692-b6ec-4fcd-9a6a-67b0bd444888]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193, portal: 172.16.0.220,3260]
Aug 22 03:10:36 user nova-compute[73469]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193, portal: 172.16.0.220,3260] successful.
Aug 22 03:10:36 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3315f119-dcfd-456b-8a2f-a361a5e42193 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a72ec85-51d8-48b4-a35f-2436178846c2]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] <== disconnect_volume: return (295ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:10:36 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Deleting instance files /opt/stack/data/nova/instances/e43158b8-28fc-429c-b329-26be91761d4f_del
Aug 22 03:10:36 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Deletion of /opt/stack/data/nova/instances/e43158b8-28fc-429c-b329-26be91761d4f_del complete
Aug 22 03:10:36 user nova-compute[73469]: INFO nova.compute.manager [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 22 03:10:36 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: e43158b8-28fc-429c-b329-26be91761d4f] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:10:36 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Took 0.54 seconds to deallocate network for instance.
Aug 22 03:10:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-d2dd5769-0a83-4102-a780-68a76cca9062 req-2b6309ed-49be-47d1-9d78-82a416ee4fb0 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received event network-vif-deleted-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:10:36 user nova-compute[73469]: INFO nova.compute.manager [req-d2dd5769-0a83-4102-a780-68a76cca9062 req-2b6309ed-49be-47d1-9d78-82a416ee4fb0 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Neutron deleted interface bbbb3f1b-29b6-4f01-9296-3452d13d0b0c; detaching it from the instance and deleting it from the info cache
Aug 22 03:10:36 user nova-compute[73469]: DEBUG nova.network.neutron [req-d2dd5769-0a83-4102-a780-68a76cca9062 req-2b6309ed-49be-47d1-9d78-82a416ee4fb0 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:10:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-d2dd5769-0a83-4102-a780-68a76cca9062 req-2b6309ed-49be-47d1-9d78-82a416ee4fb0 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Detach interface failed, port_id=bbbb3f1b-29b6-4f01-9296-3452d13d0b0c, reason: Instance e43158b8-28fc-429c-b329-26be91761d4f could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 03:10:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:37 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:10:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:37 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:10:37 user nova-compute[73469]: INFO nova.compute.claims [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Claim successful on node user
Aug 22 03:10:37 user nova-compute[73469]: DEBUG nova.compute.manager [req-8eea42d1-7a4c-4381-89f5-cf8a8dbef5a1 req-aad4d19b-f00a-4b7a-b796-8a0c45e03475 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received event network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:10:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8eea42d1-7a4c-4381-89f5-cf8a8dbef5a1 req-aad4d19b-f00a-4b7a-b796-8a0c45e03475 service nova] Acquiring lock "e43158b8-28fc-429c-b329-26be91761d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8eea42d1-7a4c-4381-89f5-cf8a8dbef5a1 req-aad4d19b-f00a-4b7a-b796-8a0c45e03475 service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8eea42d1-7a4c-4381-89f5-cf8a8dbef5a1 req-aad4d19b-f00a-4b7a-b796-8a0c45e03475 service nova] Lock "e43158b8-28fc-429c-b329-26be91761d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:37 user nova-compute[73469]: DEBUG nova.compute.manager [req-8eea42d1-7a4c-4381-89f5-cf8a8dbef5a1 req-aad4d19b-f00a-4b7a-b796-8a0c45e03475 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] No waiting events found dispatching network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:10:37 user nova-compute[73469]: WARNING nova.compute.manager [req-8eea42d1-7a4c-4381-89f5-cf8a8dbef5a1 req-aad4d19b-f00a-4b7a-b796-8a0c45e03475 service nova] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Received unexpected event network-vif-plugged-bbbb3f1b-29b6-4f01-9296-3452d13d0b0c for instance with vm_state active and task_state deleting.
Aug 22 03:10:37 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:10:37 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:10:37 user nova-compute[73469]: INFO nova.compute.manager [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Took 0.79 seconds to detach 1 volumes for instance.
Aug 22 03:10:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:37 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:10:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:37 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:10:37 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:10:37 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:10:37 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:10:37 user nova-compute[73469]: DEBUG nova.policy [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b47d6cefd0d4949bf4c3c0fc72a9cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1c312e979e47558b06d4fa70bc103a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:10:37 user nova-compute[73469]: INFO nova.virt.block_device [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Booting with volume 9e2d9588-7a08-4e9c-8aea-98b5448ddca6 at /dev/vda
Aug 22 03:10:37 user nova-compute[73469]: DEBUG os_brick.utils [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:10:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff98c4fd-fcdf-4295-b929-88b5eb66aab7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[964ee129-9871-422c-9a7a-75f8b12e35a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf03d5cd-3e48-4886-9f65-737017ce1528]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0439cf05-2f56-4b13-b582-3074382cc817]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:10:38 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:10:38 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c253372f-cbe5-463a-bae1-bf26f30f5eef]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG os_brick.utils [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Updating existing volume attachment record: 6e0d3e23-e443-46d4-bc74-02bb574f39da {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:38 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Deleted allocations for instance e43158b8-28fc-429c-b329-26be91761d4f
Aug 22 03:10:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2dc81111-f052-4e9b-9251-3c87475b8fe0 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "e43158b8-28fc-429c-b329-26be91761d4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.166s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:38 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Successfully created port: 869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:10:39 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Successfully updated port: 869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:10:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:10:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquired lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:10:39 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:10:39 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:10:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-27158d84-6644-4120-b046-91f1f2e47a99 req-42c2b05b-0eb3-48db-bbd7-a4a9c3ffd161 service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Received event network-changed-869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:10:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-27158d84-6644-4120-b046-91f1f2e47a99 req-42c2b05b-0eb3-48db-bbd7-a4a9c3ffd161 service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Refreshing instance network info cache due to event network-changed-869bff62-e3a4-4403-af83-7434b36b53ed. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:10:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-27158d84-6644-4120-b046-91f1f2e47a99 req-42c2b05b-0eb3-48db-bbd7-a4a9c3ffd161 service nova] Acquiring lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:10:39 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673824.6470094, b5525c10-e097-4214-ad4f-7b3afcf53483 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:10:39 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] VM Stopped (Lifecycle Event)
Aug 22 03:10:39 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cf81e26d-553c-44cd-9311-dcf160b773c9 None None] [instance: b5525c10-e097-4214-ad4f-7b3afcf53483] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:10:39 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Updating instance_info_cache with network_info: [{"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:10:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Releasing lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:10:39 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Instance network_info: |[{"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:10:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-27158d84-6644-4120-b046-91f1f2e47a99 req-42c2b05b-0eb3-48db-bbd7-a4a9c3ffd161 service nova] Acquired lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:10:39 user nova-compute[73469]: DEBUG nova.network.neutron [req-27158d84-6644-4120-b046-91f1f2e47a99 req-42c2b05b-0eb3-48db-bbd7-a4a9c3ffd161 service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Refreshing network info cache for port 869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:10:40 user nova-compute[73469]: DEBUG nova.network.neutron [req-27158d84-6644-4120-b046-91f1f2e47a99 req-42c2b05b-0eb3-48db-bbd7-a4a9c3ffd161 service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Updated VIF entry in instance network info cache for port 869bff62-e3a4-4403-af83-7434b36b53ed. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:10:40 user nova-compute[73469]: DEBUG nova.network.neutron [req-27158d84-6644-4120-b046-91f1f2e47a99 req-42c2b05b-0eb3-48db-bbd7-a4a9c3ffd161 service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Updating instance_info_cache with network_info: [{"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:10:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-27158d84-6644-4120-b046-91f1f2e47a99 req-42c2b05b-0eb3-48db-bbd7-a4a9c3ffd161 service nova] Releasing lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:10:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:10:49 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Creating image(s)
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Did not create local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Ensure instance console log exists: /opt/stack/data/nova/instances/9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Start _get_guest_xml network_info=[{"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '6e0d3e23-e443-46d4-bc74-02bb574f39da', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTPihObH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00', 'attached_at': '', 'detached_at': '', 'volume_id': '9e2d9588-7a08-4e9c-8aea-98b5448ddca6', 'serial': '9e2d9588-7a08-4e9c-8aea-98b5448ddca6'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:10:49 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:10:49 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTPihObH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:10:49 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:10:49 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:10:49 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[61806a32-2926-4f2d-a616-7be37f0b8f58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:10:49 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e781657-9a05-4f22-b68f-860ebf0e4cf5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6] added
Aug 22 03:10:49 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc58a44c-65d5-4ff4-a030-cd1e90c58303]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbe66d7-56aa-47e1-a5e9-2dfdee3b2439]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zTPihObH {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zTPihObH" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[11524267-9a44-4713-b8dc-6a21c2391abf]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zTPihObH'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae0e2ea-a832-42b2-8227-ac0cc24f9e91]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb59d835-f536-4e17-a85f-3e346ba74c97]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:10:49 user nova-compute[73469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:10:49 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:10:49 user nova-compute[73469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:10:49 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ae4f8c-f032-4a15-925f-1376f28c18ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6, portal: 172.16.0.220,3260]
Aug 22 03:10:49 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6, portal: 172.16.0.220,3260] successful.
Aug 22 03:10:49 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07a3cfe-5020-4fa7-b350-c60fd489b27a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c12e1a5-5e75-4f97-8336-aa9a57c759e1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:10:49 user nova-compute[73469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:10:49 user nova-compute[73469]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:10:49 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:10:49 user nova-compute[73469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:10:49 user nova-compute[73469]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:10:49 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e25d35-fecb-41a0-b3b9-87ac224dbee0]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:10:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTPihObH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23932393539323864', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932393539323864', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:10:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-15753066',display_name='tempest-ServerActionsTestOtherA-server-15753066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-15753066',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqna53ychrrpICcXpgxhDHdrzJyFFu88HUxTxIQK5z+xOZfcw7kHrC8QJBeI4lEfQOxVPYITpSoaAG4B9QNlgmIHoEX0gtT1wKkQ7bp7nCHyaP40f+//buUPKlKHlWXEA==',key_name='tempest-keypair-651522654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d1c312e979e47558b06d4fa70bc103a',ramdisk_id='',reservation_id='r-g82q5n0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1751677379',owner_user_name='tempest-ServerActionsTestOtherA-1751677379-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:10:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b47d6cefd0d4949bf4c3c0fc72a9cd5',uuid=9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converting VIF {"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:97:9c,bridge_name='br-int',has_traffic_filtering=True,id=869bff62-e3a4-4403-af83-7434b36b53ed,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869bff62-e3') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG nova.objects.instance [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:10:50 user nova-compute[73469]:   <uuid>9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00</uuid>
Aug 22 03:10:50 user nova-compute[73469]:   <name>instance-00000023</name>
Aug 22 03:10:50 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:10:50 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:10:50 user nova-compute[73469]:   <metadata>
Aug 22 03:10:50 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:10:50 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:10:50 user nova-compute[73469]:       <nova:name>tempest-ServerActionsTestOtherA-server-15753066</nova:name>
Aug 22 03:10:50 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:10:49</nova:creationTime>
Aug 22 03:10:50 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:10:50 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:10:50 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:10:50 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:10:50 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:10:50 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:10:50 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:10:50 user nova-compute[73469]:       <nova:owner>
Aug 22 03:10:50 user nova-compute[73469]:         <nova:user uuid="8b47d6cefd0d4949bf4c3c0fc72a9cd5">tempest-ServerActionsTestOtherA-1751677379-project-member</nova:user>
Aug 22 03:10:50 user nova-compute[73469]:         <nova:project uuid="2d1c312e979e47558b06d4fa70bc103a">tempest-ServerActionsTestOtherA-1751677379</nova:project>
Aug 22 03:10:50 user nova-compute[73469]:       </nova:owner>
Aug 22 03:10:50 user nova-compute[73469]:       <nova:ports>
Aug 22 03:10:50 user nova-compute[73469]:         <nova:port uuid="869bff62-e3a4-4403-af83-7434b36b53ed">
Aug 22 03:10:50 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 22 03:10:50 user nova-compute[73469]:         </nova:port>
Aug 22 03:10:50 user nova-compute[73469]:       </nova:ports>
Aug 22 03:10:50 user nova-compute[73469]:     </nova:instance>
Aug 22 03:10:50 user nova-compute[73469]:   </metadata>
Aug 22 03:10:50 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:10:50 user nova-compute[73469]:     <system>
Aug 22 03:10:50 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:10:50 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:10:50 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:10:50 user nova-compute[73469]:       <entry name="serial">9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00</entry>
Aug 22 03:10:50 user nova-compute[73469]:       <entry name="uuid">9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00</entry>
Aug 22 03:10:50 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:10:50 user nova-compute[73469]:     </system>
Aug 22 03:10:50 user nova-compute[73469]:   </sysinfo>
Aug 22 03:10:50 user nova-compute[73469]:   <os>
Aug 22 03:10:50 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:10:50 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:10:50 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:10:50 user nova-compute[73469]:   </os>
Aug 22 03:10:50 user nova-compute[73469]:   <features>
Aug 22 03:10:50 user nova-compute[73469]:     <acpi/>
Aug 22 03:10:50 user nova-compute[73469]:     <apic/>
Aug 22 03:10:50 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:10:50 user nova-compute[73469]:   </features>
Aug 22 03:10:50 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:10:50 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:10:50 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:10:50 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:10:50 user nova-compute[73469]:   </clock>
Aug 22 03:10:50 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:10:50 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:10:50 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:10:50 user nova-compute[73469]:   </cpu>
Aug 22 03:10:50 user nova-compute[73469]:   <devices>
Aug 22 03:10:50 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:10:50 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:10:50 user nova-compute[73469]:       <source dev="/dev/sdb"/>
Aug 22 03:10:50 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:10:50 user nova-compute[73469]:       <serial>9e2d9588-7a08-4e9c-8aea-98b5448ddca6</serial>
Aug 22 03:10:50 user nova-compute[73469]:     </disk>
Aug 22 03:10:50 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:10:50 user nova-compute[73469]:       <mac address="fa:16:3e:c4:97:9c"/>
Aug 22 03:10:50 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:10:50 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:10:50 user nova-compute[73469]:       <target dev="tap869bff62-e3"/>
Aug 22 03:10:50 user nova-compute[73469]:     </interface>
Aug 22 03:10:50 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:10:50 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00/console.log" append="off"/>
Aug 22 03:10:50 user nova-compute[73469]:     </serial>
Aug 22 03:10:50 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:10:50 user nova-compute[73469]:     <video>
Aug 22 03:10:50 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:10:50 user nova-compute[73469]:     </video>
Aug 22 03:10:50 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:10:50 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:10:50 user nova-compute[73469]:     </rng>
Aug 22 03:10:50 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:10:50 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:10:50 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:10:50 user nova-compute[73469]:     </memballoon>
Aug 22 03:10:50 user nova-compute[73469]:   </devices>
Aug 22 03:10:50 user nova-compute[73469]: </domain>
Aug 22 03:10:50 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:10:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-15753066',display_name='tempest-ServerActionsTestOtherA-server-15753066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-15753066',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqna53ychrrpICcXpgxhDHdrzJyFFu88HUxTxIQK5z+xOZfcw7kHrC8QJBeI4lEfQOxVPYITpSoaAG4B9QNlgmIHoEX0gtT1wKkQ7bp7nCHyaP40f+//buUPKlKHlWXEA==',key_name='tempest-keypair-651522654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d1c312e979e47558b06d4fa70bc103a',ramdisk_id='',reservation_id='r-g82q5n0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1751677379',owner_user_name='tempest-ServerActionsTestOtherA-1751677379-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:10:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b47d6cefd0d4949bf4c3c0fc72a9cd5',uuid=9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converting VIF {"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:97:9c,bridge_name='br-int',has_traffic_filtering=True,id=869bff62-e3a4-4403-af83-7434b36b53ed,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869bff62-e3') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG os_vif [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:97:9c,bridge_name='br-int',has_traffic_filtering=True,id=869bff62-e3a4-4403-af83-7434b36b53ed,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869bff62-e3') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap869bff62-e3, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap869bff62-e3, col_values=(('external_ids', {'iface-id': '869bff62-e3a4-4403-af83-7434b36b53ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:97:9c', 'vm-uuid': '9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:10:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:50 user nova-compute[73469]: INFO os_vif [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:97:9c,bridge_name='br-int',has_traffic_filtering=True,id=869bff62-e3a4-4403-af83-7434b36b53ed,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869bff62-e3')
Aug 22 03:10:51 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673836.0069153, e43158b8-28fc-429c-b329-26be91761d4f => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:10:51 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: e43158b8-28fc-429c-b329-26be91761d4f] VM Stopped (Lifecycle Event)
Aug 22 03:10:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:10:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] No VIF found with MAC fa:16:3e:c4:97:9c, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:10:51 user nova-compute[73469]: DEBUG nova.compute.manager [None req-d50ec1f2-5874-493f-b85f-16e816e1180a None None] [instance: e43158b8-28fc-429c-b329-26be91761d4f] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:10:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:52 user nova-compute[73469]: DEBUG nova.compute.manager [req-2689f01d-5ed4-4625-9c7c-d9335e8d5990 req-98769f06-32db-47d3-97f3-3d9defd71af5 service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Received event network-vif-plugged-869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:10:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2689f01d-5ed4-4625-9c7c-d9335e8d5990 req-98769f06-32db-47d3-97f3-3d9defd71af5 service nova] Acquiring lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2689f01d-5ed4-4625-9c7c-d9335e8d5990 req-98769f06-32db-47d3-97f3-3d9defd71af5 service nova] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2689f01d-5ed4-4625-9c7c-d9335e8d5990 req-98769f06-32db-47d3-97f3-3d9defd71af5 service nova] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:52 user nova-compute[73469]: DEBUG nova.compute.manager [req-2689f01d-5ed4-4625-9c7c-d9335e8d5990 req-98769f06-32db-47d3-97f3-3d9defd71af5 service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] No waiting events found dispatching network-vif-plugged-869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:10:52 user nova-compute[73469]: WARNING nova.compute.manager [req-2689f01d-5ed4-4625-9c7c-d9335e8d5990 req-98769f06-32db-47d3-97f3-3d9defd71af5 service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Received unexpected event network-vif-plugged-869bff62-e3a4-4403-af83-7434b36b53ed for instance with vm_state building and task_state spawning.
Aug 22 03:10:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-980e57bf-dec9-46f3-8d69-e20a17603af8" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-980e57bf-dec9-46f3-8d69-e20a17603af8" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673854.3455644, 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:10:54 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] VM Resumed (Lifecycle Event)
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:10:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Instance spawned successfully.
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:10:54 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673854.3472788, 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:10:54 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] VM Started (Lifecycle Event)
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:10:54 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:10:54 user nova-compute[73469]: INFO nova.compute.manager [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Took 5.00 seconds to spawn the instance on the hypervisor.
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.compute.manager [req-15c93589-9209-4a44-959e-f8f06f16d29b req-49091b0a-251a-4c90-aeac-544950fe291d service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Received event network-vif-plugged-869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-15c93589-9209-4a44-959e-f8f06f16d29b req-49091b0a-251a-4c90-aeac-544950fe291d service nova] Acquiring lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-15c93589-9209-4a44-959e-f8f06f16d29b req-49091b0a-251a-4c90-aeac-544950fe291d service nova] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-15c93589-9209-4a44-959e-f8f06f16d29b req-49091b0a-251a-4c90-aeac-544950fe291d service nova] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.compute.manager [req-15c93589-9209-4a44-959e-f8f06f16d29b req-49091b0a-251a-4c90-aeac-544950fe291d service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] No waiting events found dispatching network-vif-plugged-869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:10:54 user nova-compute[73469]: WARNING nova.compute.manager [req-15c93589-9209-4a44-959e-f8f06f16d29b req-49091b0a-251a-4c90-aeac-544950fe291d service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Received unexpected event network-vif-plugged-869bff62-e3a4-4403-af83-7434b36b53ed for instance with vm_state building and task_state spawning.
Aug 22 03:10:54 user nova-compute[73469]: INFO nova.compute.manager [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Took 17.32 seconds to build instance.
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9bfa124d-ec94-4478-a111-4e94fe9d411c tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.410s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Updating instance_info_cache with network_info: [{"id": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "address": "fa:16:3e:48:68:85", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0746c7bf-34", "ovs_interfaceid": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-980e57bf-dec9-46f3-8d69-e20a17603af8" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:10:54 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:10:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/475d431b-3b50-43ff-9bbb-14b3621a9f44/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/475d431b-3b50-43ff-9bbb-14b3621a9f44/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/475d431b-3b50-43ff-9bbb-14b3621a9f44/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/475d431b-3b50-43ff-9bbb-14b3621a9f44/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:10:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:10:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:10:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:10:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:10:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:10:58 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:10:58 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:10:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=7675MB free_disk=24.968448638916016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:10:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:10:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:10:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:10:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8242cec1-3b35-4d14-9e0b-db8a7e75697d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:10:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82e872a7-70b0-4290-9a11-5316765aed01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:10:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 980e57bf-dec9-46f3-8d69-e20a17603af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:10:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a7e95a46-9a75-4b0c-a5c9-42ed521668a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:10:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 228b721b-c7c4-4994-b1be-28234ea6a4fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:10:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 149b34df-3d3c-48fc-99f2-0c3dc4334b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:10:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 475d431b-3b50-43ff-9bbb-14b3621a9f44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:10:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:10:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:10:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:10:59 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:10:59 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:10:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:10:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.571s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:11:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:11:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:11:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:11:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:11:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:11:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:11:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:11:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:11:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "980e57bf-dec9-46f3-8d69-e20a17603af8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:11:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "980e57bf-dec9-46f3-8d69-e20a17603af8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:11:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "980e57bf-dec9-46f3-8d69-e20a17603af8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:11:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "980e57bf-dec9-46f3-8d69-e20a17603af8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:11:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "980e57bf-dec9-46f3-8d69-e20a17603af8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:11:25 user nova-compute[73469]: INFO nova.compute.manager [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Terminating instance
Aug 22 03:11:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:11:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-5b4806de-99e1-4fb6-8189-870cee6a32db req-07290b40-5935-4a92-926f-d4982a6007a1 service nova] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Received event network-vif-unplugged-0746c7bf-34e4-4be1-84ba-c0cf192111dd {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:11:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5b4806de-99e1-4fb6-8189-870cee6a32db req-07290b40-5935-4a92-926f-d4982a6007a1 service nova] Acquiring lock "980e57bf-dec9-46f3-8d69-e20a17603af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:11:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5b4806de-99e1-4fb6-8189-870cee6a32db req-07290b40-5935-4a92-926f-d4982a6007a1 service nova] Lock "980e57bf-dec9-46f3-8d69-e20a17603af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:11:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5b4806de-99e1-4fb6-8189-870cee6a32db req-07290b40-5935-4a92-926f-d4982a6007a1 service nova] Lock "980e57bf-dec9-46f3-8d69-e20a17603af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:11:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-5b4806de-99e1-4fb6-8189-870cee6a32db req-07290b40-5935-4a92-926f-d4982a6007a1 service nova] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] No waiting events found dispatching network-vif-unplugged-0746c7bf-34e4-4be1-84ba-c0cf192111dd {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:11:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-5b4806de-99e1-4fb6-8189-870cee6a32db req-07290b40-5935-4a92-926f-d4982a6007a1 service nova] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Received event network-vif-unplugged-0746c7bf-34e4-4be1-84ba-c0cf192111dd for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:11:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:26 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Instance destroyed successfully.
Aug 22 03:11:26 user nova-compute[73469]: DEBUG nova.objects.instance [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'resources' on Instance uuid 980e57bf-dec9-46f3-8d69-e20a17603af8 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:11:26 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-788981196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-788981196',id=22,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:01:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9131cb883044191931dc31e51e94766',ramdisk_id='',reservation_id='r-s291shuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568629509',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:03:10Z,user_data=None,user_id='a7b228f99c9e4d058e128a5a99636b7b',uuid=980e57bf-dec9-46f3-8d69-e20a17603af8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "address": "fa:16:3e:48:68:85", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0746c7bf-34", "ovs_interfaceid": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:11:26 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converting VIF {"id": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "address": "fa:16:3e:48:68:85", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0746c7bf-34", "ovs_interfaceid": "0746c7bf-34e4-4be1-84ba-c0cf192111dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:11:26 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:68:85,bridge_name='br-int',has_traffic_filtering=True,id=0746c7bf-34e4-4be1-84ba-c0cf192111dd,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0746c7bf-34') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:11:26 user nova-compute[73469]: DEBUG os_vif [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:68:85,bridge_name='br-int',has_traffic_filtering=True,id=0746c7bf-34e4-4be1-84ba-c0cf192111dd,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0746c7bf-34') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:11:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0746c7bf-34, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:11:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:11:26 user nova-compute[73469]: INFO os_vif [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:68:85,bridge_name='br-int',has_traffic_filtering=True,id=0746c7bf-34e4-4be1-84ba-c0cf192111dd,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0746c7bf-34')
Aug 22 03:11:26 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Deleting instance files /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8_del
Aug 22 03:11:26 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Deletion of /opt/stack/data/nova/instances/980e57bf-dec9-46f3-8d69-e20a17603af8_del complete
Aug 22 03:11:26 user nova-compute[73469]: INFO nova.compute.manager [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 22 03:11:26 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:11:26 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:11:26 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:11:27 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:11:27 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Took 0.68 seconds to deallocate network for instance.
Aug 22 03:11:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-7ccddafa-2aa1-49c1-aed5-cfe66a5a3994 req-4325d44a-7c84-4e50-8e6f-395dfaed26af service nova] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Received event network-vif-deleted-0746c7bf-34e4-4be1-84ba-c0cf192111dd {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:11:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:11:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:11:27 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:11:27 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:11:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:11:28 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Deleted allocations for instance 980e57bf-dec9-46f3-8d69-e20a17603af8
Aug 22 03:11:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-957f3ecc-8802-44a8-b915-c76889254783 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "980e57bf-dec9-46f3-8d69-e20a17603af8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.158s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:11:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-b1e15d50-6613-486d-aca7-d4bafea85678 req-0fde9264-00eb-4454-b1b9-7dba8a06d206 service nova] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Received event network-vif-plugged-0746c7bf-34e4-4be1-84ba-c0cf192111dd {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:11:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b1e15d50-6613-486d-aca7-d4bafea85678 req-0fde9264-00eb-4454-b1b9-7dba8a06d206 service nova] Acquiring lock "980e57bf-dec9-46f3-8d69-e20a17603af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:11:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b1e15d50-6613-486d-aca7-d4bafea85678 req-0fde9264-00eb-4454-b1b9-7dba8a06d206 service nova] Lock "980e57bf-dec9-46f3-8d69-e20a17603af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:11:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b1e15d50-6613-486d-aca7-d4bafea85678 req-0fde9264-00eb-4454-b1b9-7dba8a06d206 service nova] Lock "980e57bf-dec9-46f3-8d69-e20a17603af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:11:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-b1e15d50-6613-486d-aca7-d4bafea85678 req-0fde9264-00eb-4454-b1b9-7dba8a06d206 service nova] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] No waiting events found dispatching network-vif-plugged-0746c7bf-34e4-4be1-84ba-c0cf192111dd {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:11:28 user nova-compute[73469]: WARNING nova.compute.manager [req-b1e15d50-6613-486d-aca7-d4bafea85678 req-0fde9264-00eb-4454-b1b9-7dba8a06d206 service nova] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Received unexpected event network-vif-plugged-0746c7bf-34e4-4be1-84ba-c0cf192111dd for instance with vm_state deleted and task_state None.
Aug 22 03:11:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:11:39 user nova-compute[73469]: INFO nova.compute.manager [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Terminating instance
Aug 22 03:11:39 user nova-compute[73469]: DEBUG nova.compute.manager [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-28dd04fd-9bf8-4b2e-9f6c-acd9e0cc037f req-29b6b1b8-facb-4e7b-b685-5180fdfa534c service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received event network-vif-unplugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-28dd04fd-9bf8-4b2e-9f6c-acd9e0cc037f req-29b6b1b8-facb-4e7b-b685-5180fdfa534c service nova] Acquiring lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-28dd04fd-9bf8-4b2e-9f6c-acd9e0cc037f req-29b6b1b8-facb-4e7b-b685-5180fdfa534c service nova] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-28dd04fd-9bf8-4b2e-9f6c-acd9e0cc037f req-29b6b1b8-facb-4e7b-b685-5180fdfa534c service nova] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-28dd04fd-9bf8-4b2e-9f6c-acd9e0cc037f req-29b6b1b8-facb-4e7b-b685-5180fdfa534c service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] No waiting events found dispatching network-vif-unplugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG nova.compute.manager [req-28dd04fd-9bf8-4b2e-9f6c-acd9e0cc037f req-29b6b1b8-facb-4e7b-b685-5180fdfa534c service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received event network-vif-unplugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:11:39 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Instance destroyed successfully.
Aug 22 03:11:39 user nova-compute[73469]: DEBUG nova.objects.instance [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lazy-loading 'resources' on Instance uuid 149b34df-3d3c-48fc-99f2-0c3dc4334b1b {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-22T03:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-497177608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-497177608',id=29,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI0YlC0MdxkVUSO81PLfgms40a6G6QD6YfZDORCvcGREtqMCzN/af47ygJmaqeEDyH5JKafVWBVdlK5rvd3tumDct1g36YoiSCIhWA6MhiAMlbCo9hRSMDY7Uq4rNNh/w==',key_name='tempest-keypair-884872358',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:10:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca3e1f2f72c7497ca3ad923a4b9459dc',ramdisk_id='',reservation_id='r-rzj24vpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-774227889',owner_user_name='tempest-AttachVolumeShelveTestJSON-774227889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:10:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41e697cd5e5f422f8ac90f7496f60936',uuid=149b34df-3d3c-48fc-99f2-0c3dc4334b1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converting VIF {"id": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "address": "fa:16:3e:a4:7b:58", "network": {"id": "8bc056a8-11fe-4c3a-baae-bfac3cab1dea", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-969285306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3e1f2f72c7497ca3ad923a4b9459dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866b90b8-9c", "ovs_interfaceid": "866b90b8-9ca8-4235-9f79-45d13fc5f929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:58,bridge_name='br-int',has_traffic_filtering=True,id=866b90b8-9ca8-4235-9f79-45d13fc5f929,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b90b8-9c') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG os_vif [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:58,bridge_name='br-int',has_traffic_filtering=True,id=866b90b8-9ca8-4235-9f79-45d13fc5f929,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b90b8-9c') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap866b90b8-9c, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:11:39 user nova-compute[73469]: INFO os_vif [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:58,bridge_name='br-int',has_traffic_filtering=True,id=866b90b8-9ca8-4235-9f79-45d13fc5f929,network=Network(8bc056a8-11fe-4c3a-baae-bfac3cab1dea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866b90b8-9c')
Aug 22 03:11:39 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Deleting instance files /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b_del
Aug 22 03:11:39 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Deletion of /opt/stack/data/nova/instances/149b34df-3d3c-48fc-99f2-0c3dc4334b1b_del complete
Aug 22 03:11:39 user nova-compute[73469]: INFO nova.compute.manager [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 22 03:11:39 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:11:39 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:11:41 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:11:41 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Took 1.24 seconds to deallocate network for instance.
Aug 22 03:11:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:11:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:11:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-35580734-66e9-48b3-8c5f-5d3969a119fa req-afeeb142-969c-4018-a15c-70faf57029eb service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received event network-vif-plugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:11:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-35580734-66e9-48b3-8c5f-5d3969a119fa req-afeeb142-969c-4018-a15c-70faf57029eb service nova] Acquiring lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:11:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-35580734-66e9-48b3-8c5f-5d3969a119fa req-afeeb142-969c-4018-a15c-70faf57029eb service nova] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:11:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-35580734-66e9-48b3-8c5f-5d3969a119fa req-afeeb142-969c-4018-a15c-70faf57029eb service nova] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:11:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-35580734-66e9-48b3-8c5f-5d3969a119fa req-afeeb142-969c-4018-a15c-70faf57029eb service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] No waiting events found dispatching network-vif-plugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:11:41 user nova-compute[73469]: WARNING nova.compute.manager [req-35580734-66e9-48b3-8c5f-5d3969a119fa req-afeeb142-969c-4018-a15c-70faf57029eb service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received unexpected event network-vif-plugged-866b90b8-9ca8-4235-9f79-45d13fc5f929 for instance with vm_state deleted and task_state None.
Aug 22 03:11:41 user nova-compute[73469]: DEBUG nova.compute.manager [req-35580734-66e9-48b3-8c5f-5d3969a119fa req-afeeb142-969c-4018-a15c-70faf57029eb service nova] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Received event network-vif-deleted-866b90b8-9ca8-4235-9f79-45d13fc5f929 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:11:41 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:11:41 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:11:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:11:41 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Deleted allocations for instance 149b34df-3d3c-48fc-99f2-0c3dc4334b1b
Aug 22 03:11:41 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673886.781166, 980e57bf-dec9-46f3-8d69-e20a17603af8 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:11:41 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] VM Stopped (Lifecycle Event)
Aug 22 03:11:41 user nova-compute[73469]: DEBUG nova.compute.manager [None req-a4b612bd-04d4-43c6-b35c-d74dec004a9d None None] [instance: 980e57bf-dec9-46f3-8d69-e20a17603af8] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:11:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-79127951-3afd-4355-b777-a41b36432eaa tempest-AttachVolumeShelveTestJSON-774227889 tempest-AttachVolumeShelveTestJSON-774227889-project-member] Lock "149b34df-3d3c-48fc-99f2-0c3dc4334b1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.803s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:11:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:52 user nova-compute[73469]: DEBUG nova.compute.manager [req-48895afa-5bfa-4df5-9ca9-e5b59c6837a1 req-43d9c774-6aef-4201-8ec7-54d6980ae510 service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Received event network-changed-5263e48c-6e86-49a0-9de4-f383d00b9d7e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:11:52 user nova-compute[73469]: DEBUG nova.compute.manager [req-48895afa-5bfa-4df5-9ca9-e5b59c6837a1 req-43d9c774-6aef-4201-8ec7-54d6980ae510 service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Refreshing instance network info cache due to event network-changed-5263e48c-6e86-49a0-9de4-f383d00b9d7e. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:11:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-48895afa-5bfa-4df5-9ca9-e5b59c6837a1 req-43d9c774-6aef-4201-8ec7-54d6980ae510 service nova] Acquiring lock "refresh_cache-475d431b-3b50-43ff-9bbb-14b3621a9f44" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:11:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-48895afa-5bfa-4df5-9ca9-e5b59c6837a1 req-43d9c774-6aef-4201-8ec7-54d6980ae510 service nova] Acquired lock "refresh_cache-475d431b-3b50-43ff-9bbb-14b3621a9f44" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:11:52 user nova-compute[73469]: DEBUG nova.network.neutron [req-48895afa-5bfa-4df5-9ca9-e5b59c6837a1 req-43d9c774-6aef-4201-8ec7-54d6980ae510 service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Refreshing network info cache for port 5263e48c-6e86-49a0-9de4-f383d00b9d7e {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:11:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "475d431b-3b50-43ff-9bbb-14b3621a9f44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:11:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "475d431b-3b50-43ff-9bbb-14b3621a9f44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:11:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "475d431b-3b50-43ff-9bbb-14b3621a9f44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:11:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "475d431b-3b50-43ff-9bbb-14b3621a9f44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:11:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "475d431b-3b50-43ff-9bbb-14b3621a9f44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:11:52 user nova-compute[73469]: INFO nova.compute.manager [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Terminating instance
Aug 22 03:11:52 user nova-compute[73469]: DEBUG nova.compute.manager [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:11:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:52 user nova-compute[73469]: DEBUG nova.network.neutron [req-48895afa-5bfa-4df5-9ca9-e5b59c6837a1 req-43d9c774-6aef-4201-8ec7-54d6980ae510 service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Updated VIF entry in instance network info cache for port 5263e48c-6e86-49a0-9de4-f383d00b9d7e. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:11:52 user nova-compute[73469]: DEBUG nova.network.neutron [req-48895afa-5bfa-4df5-9ca9-e5b59c6837a1 req-43d9c774-6aef-4201-8ec7-54d6980ae510 service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Updating instance_info_cache with network_info: [{"id": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "address": "fa:16:3e:ab:f1:1d", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e48c-6e", "ovs_interfaceid": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:11:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-48895afa-5bfa-4df5-9ca9-e5b59c6837a1 req-43d9c774-6aef-4201-8ec7-54d6980ae510 service nova] Releasing lock "refresh_cache-475d431b-3b50-43ff-9bbb-14b3621a9f44" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:11:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:53 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Instance destroyed successfully.
Aug 22 03:11:53 user nova-compute[73469]: DEBUG nova.objects.instance [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'resources' on Instance uuid 475d431b-3b50-43ff-9bbb-14b3621a9f44 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:11:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:10:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1236898622',display_name='tempest-AttachVolumeNegativeTest-server-1236898622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1236898622',id=34,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwAYFI6cbjo+Mdgy6ggeihpeU03Ou33SxrJa0TYtaTW6QkPhISNofm9abz/rXsnoPv3YQkPAqDTZ1J2DRIFila2ChRgBMW/3BEJtQ+LUj6w310yAYhqZt08J6y87+9Quw==',key_name='tempest-keypair-675782615',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:10:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab150042073d4977b15414a3062d82fd',ramdisk_id='',reservation_id='r-3jkjknp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-356032718',owner_user_name='tempest-AttachVolumeNegativeTest-356032718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:10:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25b830ec1451440f911d6578c8c55f3d',uuid=475d431b-3b50-43ff-9bbb-14b3621a9f44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "address": "fa:16:3e:ab:f1:1d", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e48c-6e", "ovs_interfaceid": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:11:53 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converting VIF {"id": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "address": "fa:16:3e:ab:f1:1d", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e48c-6e", "ovs_interfaceid": "5263e48c-6e86-49a0-9de4-f383d00b9d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:11:53 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f1:1d,bridge_name='br-int',has_traffic_filtering=True,id=5263e48c-6e86-49a0-9de4-f383d00b9d7e,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5263e48c-6e') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:11:53 user nova-compute[73469]: DEBUG os_vif [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f1:1d,bridge_name='br-int',has_traffic_filtering=True,id=5263e48c-6e86-49a0-9de4-f383d00b9d7e,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5263e48c-6e') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:11:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5263e48c-6e, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:11:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:11:53 user nova-compute[73469]: INFO os_vif [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f1:1d,bridge_name='br-int',has_traffic_filtering=True,id=5263e48c-6e86-49a0-9de4-f383d00b9d7e,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5263e48c-6e')
Aug 22 03:11:53 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Deleting instance files /opt/stack/data/nova/instances/475d431b-3b50-43ff-9bbb-14b3621a9f44_del
Aug 22 03:11:53 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Deletion of /opt/stack/data/nova/instances/475d431b-3b50-43ff-9bbb-14b3621a9f44_del complete
Aug 22 03:11:53 user nova-compute[73469]: INFO nova.compute.manager [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 22 03:11:53 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:11:53 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:11:53 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:11:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:54 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:11:54 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Took 0.86 seconds to deallocate network for instance.
Aug 22 03:11:54 user nova-compute[73469]: DEBUG nova.compute.manager [req-a7bdd68d-5af2-497b-8240-e3ed0d810e41 req-86807988-de54-40c0-8546-c63f2c27ce9e service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Received event network-vif-deleted-5263e48c-6e86-49a0-9de4-f383d00b9d7e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:11:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:11:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:11:54 user nova-compute[73469]: DEBUG nova.compute.manager [req-a34846c2-1bb6-4f83-93c8-1de99ecd744d req-c2efc71a-a45f-4b35-b94d-f305375b9581 service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Received event network-vif-unplugged-5263e48c-6e86-49a0-9de4-f383d00b9d7e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:11:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a34846c2-1bb6-4f83-93c8-1de99ecd744d req-c2efc71a-a45f-4b35-b94d-f305375b9581 service nova] Acquiring lock "475d431b-3b50-43ff-9bbb-14b3621a9f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:11:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a34846c2-1bb6-4f83-93c8-1de99ecd744d req-c2efc71a-a45f-4b35-b94d-f305375b9581 service nova] Lock "475d431b-3b50-43ff-9bbb-14b3621a9f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:11:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a34846c2-1bb6-4f83-93c8-1de99ecd744d req-c2efc71a-a45f-4b35-b94d-f305375b9581 service nova] Lock "475d431b-3b50-43ff-9bbb-14b3621a9f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:11:54 user nova-compute[73469]: DEBUG nova.compute.manager [req-a34846c2-1bb6-4f83-93c8-1de99ecd744d req-c2efc71a-a45f-4b35-b94d-f305375b9581 service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] No waiting events found dispatching network-vif-unplugged-5263e48c-6e86-49a0-9de4-f383d00b9d7e {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:11:54 user nova-compute[73469]: WARNING nova.compute.manager [req-a34846c2-1bb6-4f83-93c8-1de99ecd744d req-c2efc71a-a45f-4b35-b94d-f305375b9581 service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Received unexpected event network-vif-unplugged-5263e48c-6e86-49a0-9de4-f383d00b9d7e for instance with vm_state deleted and task_state None.
Aug 22 03:11:54 user nova-compute[73469]: DEBUG nova.compute.manager [req-a34846c2-1bb6-4f83-93c8-1de99ecd744d req-c2efc71a-a45f-4b35-b94d-f305375b9581 service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Received event network-vif-plugged-5263e48c-6e86-49a0-9de4-f383d00b9d7e {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:11:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a34846c2-1bb6-4f83-93c8-1de99ecd744d req-c2efc71a-a45f-4b35-b94d-f305375b9581 service nova] Acquiring lock "475d431b-3b50-43ff-9bbb-14b3621a9f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:11:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a34846c2-1bb6-4f83-93c8-1de99ecd744d req-c2efc71a-a45f-4b35-b94d-f305375b9581 service nova] Lock "475d431b-3b50-43ff-9bbb-14b3621a9f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:11:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a34846c2-1bb6-4f83-93c8-1de99ecd744d req-c2efc71a-a45f-4b35-b94d-f305375b9581 service nova] Lock "475d431b-3b50-43ff-9bbb-14b3621a9f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:11:54 user nova-compute[73469]: DEBUG nova.compute.manager [req-a34846c2-1bb6-4f83-93c8-1de99ecd744d req-c2efc71a-a45f-4b35-b94d-f305375b9581 service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] No waiting events found dispatching network-vif-plugged-5263e48c-6e86-49a0-9de4-f383d00b9d7e {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:11:54 user nova-compute[73469]: WARNING nova.compute.manager [req-a34846c2-1bb6-4f83-93c8-1de99ecd744d req-c2efc71a-a45f-4b35-b94d-f305375b9581 service nova] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Received unexpected event network-vif-plugged-5263e48c-6e86-49a0-9de4-f383d00b9d7e for instance with vm_state deleted and task_state None.
Aug 22 03:11:54 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:11:54 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:11:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:11:54 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Deleted allocations for instance 475d431b-3b50-43ff-9bbb-14b3621a9f44
Aug 22 03:11:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-11b07041-9344-4ebe-bc2f-735873517473 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "475d431b-3b50-43ff-9bbb-14b3621a9f44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.045s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:11:54 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673899.8466651, 149b34df-3d3c-48fc-99f2-0c3dc4334b1b => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:11:54 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] VM Stopped (Lifecycle Event)
Aug 22 03:11:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-bd1e8178-34ee-4733-a57c-d2e533e13763 None None] [instance: 149b34df-3d3c-48fc-99f2-0c3dc4334b1b] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:11:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Didn't find any instances for network info cache update. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:11:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:12:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:12:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:12:01 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:12:01 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:12:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=7984MB free_disk=25.12854766845703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:12:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:12:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 8242cec1-3b35-4d14-9e0b-db8a7e75697d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:12:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82e872a7-70b0-4290-9a11-5316765aed01 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:12:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a7e95a46-9a75-4b0c-a5c9-42ed521668a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:12:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 228b721b-c7c4-4994-b1be-28234ea6a4fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:12:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:12:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:12:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:12:01 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:12:01 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:12:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:12:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:08 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673913.073142, 475d431b-3b50-43ff-9bbb-14b3621a9f44 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:12:08 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] VM Stopped (Lifecycle Event)
Aug 22 03:12:08 user nova-compute[73469]: DEBUG nova.compute.manager [None req-fd291c59-f7f5-449e-93be-5b88ae345813 None None] [instance: 475d431b-3b50-43ff-9bbb-14b3621a9f44] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:12:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:16 user nova-compute[73469]: INFO nova.compute.manager [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Terminating instance
Aug 22 03:12:16 user nova-compute[73469]: DEBUG nova.compute.manager [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:12:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-ab0a1fc4-fd65-4092-8c6a-e33c75a530b8 req-10ddcc4b-5796-48e5-b173-48f5f5e1eff3 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received event network-vif-unplugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:12:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ab0a1fc4-fd65-4092-8c6a-e33c75a530b8 req-10ddcc4b-5796-48e5-b173-48f5f5e1eff3 service nova] Acquiring lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ab0a1fc4-fd65-4092-8c6a-e33c75a530b8 req-10ddcc4b-5796-48e5-b173-48f5f5e1eff3 service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ab0a1fc4-fd65-4092-8c6a-e33c75a530b8 req-10ddcc4b-5796-48e5-b173-48f5f5e1eff3 service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-ab0a1fc4-fd65-4092-8c6a-e33c75a530b8 req-10ddcc4b-5796-48e5-b173-48f5f5e1eff3 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] No waiting events found dispatching network-vif-unplugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:12:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-ab0a1fc4-fd65-4092-8c6a-e33c75a530b8 req-10ddcc4b-5796-48e5-b173-48f5f5e1eff3 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received event network-vif-unplugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:17 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Instance destroyed successfully.
Aug 22 03:12:17 user nova-compute[73469]: DEBUG nova.objects.instance [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'resources' on Instance uuid 8242cec1-3b35-4d14-9e0b-db8a7e75697d {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:55:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1769101267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1769101267',id=13,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:57:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9131cb883044191931dc31e51e94766',ramdisk_id='',reservation_id='r-d7zk2v2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568629509',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:59:26Z,user_data=None,user_id='a7b228f99c9e4d058e128a5a99636b7b',uuid=8242cec1-3b35-4d14-9e0b-db8a7e75697d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "address": "fa:16:3e:4f:6e:44", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec640a77-a1", "ovs_interfaceid": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converting VIF {"id": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "address": "fa:16:3e:4f:6e:44", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec640a77-a1", "ovs_interfaceid": "ec640a77-a18c-41a2-aa5e-3eadf60f5e34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=ec640a77-a18c-41a2-aa5e-3eadf60f5e34,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec640a77-a1') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG os_vif [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=ec640a77-a18c-41a2-aa5e-3eadf60f5e34,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec640a77-a1') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec640a77-a1, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:12:17 user nova-compute[73469]: INFO os_vif [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=ec640a77-a18c-41a2-aa5e-3eadf60f5e34,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec640a77-a1')
Aug 22 03:12:17 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLtMIbzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:12:17 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:12:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f09404c-dcf6-439e-805f-7ca530ecaf06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[058aa140-d131-4a71-9758-cd450771dda6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:12:17 user nova-compute[73469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:12:17 user nova-compute[73469]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:12:17 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 (non-flash)
Aug 22 03:12:17 user nova-compute[73469]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:12:17 user nova-compute[73469]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:12:17 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79b4141b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461'): ({'sdc'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Removing single pathed devices sdc {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec74e4a5-40ad-443e-8b29-6b3d1cd97433]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cb15df-0dc4-45ef-98a5-7cb36f29c8aa]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Flushing IO for device /dev/sdc {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e0d117-7e2d-4a9b-9ed7-17f40e1b17c5]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1c8933-e8af-4678-be69-000d5cd82017]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b3d7ce-c63e-4be5-b9ca-e595dfc91d4b]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a953f7-7302-411a-8e91-45b1a72d5aae]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461, portal: 172.16.0.220,3260]
Aug 22 03:12:17 user nova-compute[73469]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461, portal: 172.16.0.220,3260] successful.
Aug 22 03:12:17 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3d151e-571e-44c9-b33f-3d8b146c0461 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[451e324b-fdb9-4891-a434-c03b3d2b03e5]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] <== disconnect_volume: return (289ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:12:17 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Deleting instance files /opt/stack/data/nova/instances/8242cec1-3b35-4d14-9e0b-db8a7e75697d_del
Aug 22 03:12:17 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Deletion of /opt/stack/data/nova/instances/8242cec1-3b35-4d14-9e0b-db8a7e75697d_del complete
Aug 22 03:12:17 user nova-compute[73469]: INFO nova.compute.manager [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 22 03:12:17 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:12:17 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:12:18 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:12:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-c5b31fe9-d3f4-45ef-b4ca-2c183338518f req-9c2a73be-8a93-46e7-b20f-b7255a5aceda service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received event network-vif-deleted-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:12:18 user nova-compute[73469]: INFO nova.compute.manager [req-c5b31fe9-d3f4-45ef-b4ca-2c183338518f req-9c2a73be-8a93-46e7-b20f-b7255a5aceda service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Neutron deleted interface ec640a77-a18c-41a2-aa5e-3eadf60f5e34; detaching it from the instance and deleting it from the info cache
Aug 22 03:12:18 user nova-compute[73469]: DEBUG nova.network.neutron [req-c5b31fe9-d3f4-45ef-b4ca-2c183338518f req-9c2a73be-8a93-46e7-b20f-b7255a5aceda service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:12:18 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Took 0.52 seconds to deallocate network for instance.
Aug 22 03:12:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-c5b31fe9-d3f4-45ef-b4ca-2c183338518f req-9c2a73be-8a93-46e7-b20f-b7255a5aceda service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Detach interface failed, port_id=ec640a77-a18c-41a2-aa5e-3eadf60f5e34, reason: Instance 8242cec1-3b35-4d14-9e0b-db8a7e75697d could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 03:12:19 user nova-compute[73469]: DEBUG nova.compute.manager [req-54c5fd6e-23d8-4a3b-8c0b-9d9106701fc7 req-36828be6-f0c1-4eca-be4b-3bf86a736c06 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received event network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:12:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-54c5fd6e-23d8-4a3b-8c0b-9d9106701fc7 req-36828be6-f0c1-4eca-be4b-3bf86a736c06 service nova] Acquiring lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-54c5fd6e-23d8-4a3b-8c0b-9d9106701fc7 req-36828be6-f0c1-4eca-be4b-3bf86a736c06 service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-54c5fd6e-23d8-4a3b-8c0b-9d9106701fc7 req-36828be6-f0c1-4eca-be4b-3bf86a736c06 service nova] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:19 user nova-compute[73469]: DEBUG nova.compute.manager [req-54c5fd6e-23d8-4a3b-8c0b-9d9106701fc7 req-36828be6-f0c1-4eca-be4b-3bf86a736c06 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] No waiting events found dispatching network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:12:19 user nova-compute[73469]: WARNING nova.compute.manager [req-54c5fd6e-23d8-4a3b-8c0b-9d9106701fc7 req-36828be6-f0c1-4eca-be4b-3bf86a736c06 service nova] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Received unexpected event network-vif-plugged-ec640a77-a18c-41a2-aa5e-3eadf60f5e34 for instance with vm_state active and task_state deleting.
Aug 22 03:12:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "1189d718-45af-415f-bbf9-56093977b0c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1189d718-45af-415f-bbf9-56093977b0c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:12:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:12:25 user nova-compute[73469]: INFO nova.compute.claims [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Claim successful on node user
Aug 22 03:12:25 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:12:25 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:12:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:12:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:12:25 user nova-compute[73469]: DEBUG nova.network.neutron [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:12:25 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:12:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:12:25 user nova-compute[73469]: DEBUG nova.policy [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6eb46fb485964d14b308dfbb74c034c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3173cbd63e4552b2cd30afd9d5f222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:12:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:12:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:12:25 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Creating image(s)
Aug 22 03:12:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "/opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "/opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "/opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.183s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.210s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk 1073741824" returned: 0 in 0.051s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.175s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Cannot resize image /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG nova.objects.instance [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lazy-loading 'migration_context' on Instance uuid 1189d718-45af-415f-bbf9-56093977b0c4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Ensure instance console log exists: /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:26 user nova-compute[73469]: INFO nova.compute.manager [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Took 8.18 seconds to detach 1 volumes for instance.
Aug 22 03:12:26 user nova-compute[73469]: DEBUG nova.network.neutron [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Successfully created port: 11b72dfc-679a-4db6-97a0-1bf25884e4d2 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:12:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:26 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Deleted allocations for instance 8242cec1-3b35-4d14-9e0b-db8a7e75697d
Aug 22 03:12:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-10bca1a5-f6cc-41a5-9609-2aba17194090 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "8242cec1-3b35-4d14-9e0b-db8a7e75697d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.318s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:27 user nova-compute[73469]: DEBUG nova.network.neutron [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Successfully updated port: 11b72dfc-679a-4db6-97a0-1bf25884e4d2 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:12:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "refresh_cache-1189d718-45af-415f-bbf9-56093977b0c4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:12:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquired lock "refresh_cache-1189d718-45af-415f-bbf9-56093977b0c4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:12:27 user nova-compute[73469]: DEBUG nova.network.neutron [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:12:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-43bfb950-006f-43ce-9793-3305d5217360 req-f7b05cc7-2bb2-41cc-8978-2ed9add54665 service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Received event network-changed-11b72dfc-679a-4db6-97a0-1bf25884e4d2 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:12:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-43bfb950-006f-43ce-9793-3305d5217360 req-f7b05cc7-2bb2-41cc-8978-2ed9add54665 service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Refreshing instance network info cache due to event network-changed-11b72dfc-679a-4db6-97a0-1bf25884e4d2. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:12:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-43bfb950-006f-43ce-9793-3305d5217360 req-f7b05cc7-2bb2-41cc-8978-2ed9add54665 service nova] Acquiring lock "refresh_cache-1189d718-45af-415f-bbf9-56093977b0c4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.network.neutron [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.network.neutron [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Updating instance_info_cache with network_info: [{"id": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "address": "fa:16:3e:d8:2e:37", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b72dfc-67", "ovs_interfaceid": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Releasing lock "refresh_cache-1189d718-45af-415f-bbf9-56093977b0c4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Instance network_info: |[{"id": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "address": "fa:16:3e:d8:2e:37", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b72dfc-67", "ovs_interfaceid": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-43bfb950-006f-43ce-9793-3305d5217360 req-f7b05cc7-2bb2-41cc-8978-2ed9add54665 service nova] Acquired lock "refresh_cache-1189d718-45af-415f-bbf9-56093977b0c4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.network.neutron [req-43bfb950-006f-43ce-9793-3305d5217360 req-f7b05cc7-2bb2-41cc-8978-2ed9add54665 service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Refreshing network info cache for port 11b72dfc-679a-4db6-97a0-1bf25884e4d2 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Start _get_guest_xml network_info=[{"id": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "address": "fa:16:3e:d8:2e:37", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b72dfc-67", "ovs_interfaceid": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:12:28 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:12:28 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:12:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-171839715',display_name='tempest-VolumesSnapshotTestJSON-instance-171839715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-171839715',id=36,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAq69m6plub00DIN8gd0PDZ9Md+9R0vOcTNORvcvqu0+1xj1fk1xK5O0H4xfAsClWOfxmdEAQaDq/OTdgLblobst+7sOpdN2brh1sTGQpNewNH2U9t2GHToNbDdXfDFi7A==',key_name='tempest-keypair-837758461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db3173cbd63e4552b2cd30afd9d5f222',ramdisk_id='',reservation_id='r-ytbmf3g3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1072377725',owner_user_name='tempest-VolumesSnapshotTestJSON-1072377725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:12:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eb46fb485964d14b308dfbb74c034c0',uuid=1189d718-45af-415f-bbf9-56093977b0c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "address": "fa:16:3e:d8:2e:37", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b72dfc-67", "ovs_interfaceid": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Converting VIF {"id": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "address": "fa:16:3e:d8:2e:37", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b72dfc-67", "ovs_interfaceid": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:2e:37,bridge_name='br-int',has_traffic_filtering=True,id=11b72dfc-679a-4db6-97a0-1bf25884e4d2,network=Network(f2fb8b83-b1db-45fd-8a84-230e5333ebef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b72dfc-67') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.objects.instance [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lazy-loading 'pci_devices' on Instance uuid 1189d718-45af-415f-bbf9-56093977b0c4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:12:28 user nova-compute[73469]:   <uuid>1189d718-45af-415f-bbf9-56093977b0c4</uuid>
Aug 22 03:12:28 user nova-compute[73469]:   <name>instance-00000024</name>
Aug 22 03:12:28 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:12:28 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:12:28 user nova-compute[73469]:   <metadata>
Aug 22 03:12:28 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:12:28 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:12:28 user nova-compute[73469]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-171839715</nova:name>
Aug 22 03:12:28 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:12:28</nova:creationTime>
Aug 22 03:12:28 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:12:28 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:12:28 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:12:28 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:12:28 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:12:28 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:12:28 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:12:28 user nova-compute[73469]:       <nova:owner>
Aug 22 03:12:28 user nova-compute[73469]:         <nova:user uuid="6eb46fb485964d14b308dfbb74c034c0">tempest-VolumesSnapshotTestJSON-1072377725-project-member</nova:user>
Aug 22 03:12:28 user nova-compute[73469]:         <nova:project uuid="db3173cbd63e4552b2cd30afd9d5f222">tempest-VolumesSnapshotTestJSON-1072377725</nova:project>
Aug 22 03:12:28 user nova-compute[73469]:       </nova:owner>
Aug 22 03:12:28 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:12:28 user nova-compute[73469]:       <nova:ports>
Aug 22 03:12:28 user nova-compute[73469]:         <nova:port uuid="11b72dfc-679a-4db6-97a0-1bf25884e4d2">
Aug 22 03:12:28 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 22 03:12:28 user nova-compute[73469]:         </nova:port>
Aug 22 03:12:28 user nova-compute[73469]:       </nova:ports>
Aug 22 03:12:28 user nova-compute[73469]:     </nova:instance>
Aug 22 03:12:28 user nova-compute[73469]:   </metadata>
Aug 22 03:12:28 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:12:28 user nova-compute[73469]:     <system>
Aug 22 03:12:28 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:12:28 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:12:28 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:12:28 user nova-compute[73469]:       <entry name="serial">1189d718-45af-415f-bbf9-56093977b0c4</entry>
Aug 22 03:12:28 user nova-compute[73469]:       <entry name="uuid">1189d718-45af-415f-bbf9-56093977b0c4</entry>
Aug 22 03:12:28 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:12:28 user nova-compute[73469]:     </system>
Aug 22 03:12:28 user nova-compute[73469]:   </sysinfo>
Aug 22 03:12:28 user nova-compute[73469]:   <os>
Aug 22 03:12:28 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:12:28 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:12:28 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:12:28 user nova-compute[73469]:   </os>
Aug 22 03:12:28 user nova-compute[73469]:   <features>
Aug 22 03:12:28 user nova-compute[73469]:     <acpi/>
Aug 22 03:12:28 user nova-compute[73469]:     <apic/>
Aug 22 03:12:28 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:12:28 user nova-compute[73469]:   </features>
Aug 22 03:12:28 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:12:28 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:12:28 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:12:28 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:12:28 user nova-compute[73469]:   </clock>
Aug 22 03:12:28 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:12:28 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:12:28 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:12:28 user nova-compute[73469]:   </cpu>
Aug 22 03:12:28 user nova-compute[73469]:   <devices>
Aug 22 03:12:28 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:12:28 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:12:28 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk"/>
Aug 22 03:12:28 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:12:28 user nova-compute[73469]:     </disk>
Aug 22 03:12:28 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:12:28 user nova-compute[73469]:       <mac address="fa:16:3e:d8:2e:37"/>
Aug 22 03:12:28 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:12:28 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:12:28 user nova-compute[73469]:       <target dev="tap11b72dfc-67"/>
Aug 22 03:12:28 user nova-compute[73469]:     </interface>
Aug 22 03:12:28 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:12:28 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/console.log" append="off"/>
Aug 22 03:12:28 user nova-compute[73469]:     </serial>
Aug 22 03:12:28 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:12:28 user nova-compute[73469]:     <video>
Aug 22 03:12:28 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:12:28 user nova-compute[73469]:     </video>
Aug 22 03:12:28 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:12:28 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:12:28 user nova-compute[73469]:     </rng>
Aug 22 03:12:28 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:12:28 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:12:28 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:12:28 user nova-compute[73469]:     </memballoon>
Aug 22 03:12:28 user nova-compute[73469]:   </devices>
Aug 22 03:12:28 user nova-compute[73469]: </domain>
Aug 22 03:12:28 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:12:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-171839715',display_name='tempest-VolumesSnapshotTestJSON-instance-171839715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-171839715',id=36,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAq69m6plub00DIN8gd0PDZ9Md+9R0vOcTNORvcvqu0+1xj1fk1xK5O0H4xfAsClWOfxmdEAQaDq/OTdgLblobst+7sOpdN2brh1sTGQpNewNH2U9t2GHToNbDdXfDFi7A==',key_name='tempest-keypair-837758461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db3173cbd63e4552b2cd30afd9d5f222',ramdisk_id='',reservation_id='r-ytbmf3g3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1072377725',owner_user_name='tempest-VolumesSnapshotTestJSON-1072377725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:12:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eb46fb485964d14b308dfbb74c034c0',uuid=1189d718-45af-415f-bbf9-56093977b0c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "address": "fa:16:3e:d8:2e:37", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b72dfc-67", "ovs_interfaceid": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Converting VIF {"id": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "address": "fa:16:3e:d8:2e:37", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b72dfc-67", "ovs_interfaceid": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:2e:37,bridge_name='br-int',has_traffic_filtering=True,id=11b72dfc-679a-4db6-97a0-1bf25884e4d2,network=Network(f2fb8b83-b1db-45fd-8a84-230e5333ebef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b72dfc-67') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG os_vif [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:2e:37,bridge_name='br-int',has_traffic_filtering=True,id=11b72dfc-679a-4db6-97a0-1bf25884e4d2,network=Network(f2fb8b83-b1db-45fd-8a84-230e5333ebef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b72dfc-67') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11b72dfc-67, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap11b72dfc-67, col_values=(('external_ids', {'iface-id': '11b72dfc-679a-4db6-97a0-1bf25884e4d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:2e:37', 'vm-uuid': '1189d718-45af-415f-bbf9-56093977b0c4'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:28 user nova-compute[73469]: INFO os_vif [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:2e:37,bridge_name='br-int',has_traffic_filtering=True,id=11b72dfc-679a-4db6-97a0-1bf25884e4d2,network=Network(f2fb8b83-b1db-45fd-8a84-230e5333ebef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b72dfc-67')
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:12:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] No VIF found with MAC fa:16:3e:d8:2e:37, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:12:29 user nova-compute[73469]: DEBUG nova.network.neutron [req-43bfb950-006f-43ce-9793-3305d5217360 req-f7b05cc7-2bb2-41cc-8978-2ed9add54665 service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Updated VIF entry in instance network info cache for port 11b72dfc-679a-4db6-97a0-1bf25884e4d2. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:12:29 user nova-compute[73469]: DEBUG nova.network.neutron [req-43bfb950-006f-43ce-9793-3305d5217360 req-f7b05cc7-2bb2-41cc-8978-2ed9add54665 service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Updating instance_info_cache with network_info: [{"id": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "address": "fa:16:3e:d8:2e:37", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b72dfc-67", "ovs_interfaceid": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:12:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-43bfb950-006f-43ce-9793-3305d5217360 req-f7b05cc7-2bb2-41cc-8978-2ed9add54665 service nova] Releasing lock "refresh_cache-1189d718-45af-415f-bbf9-56093977b0c4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:12:29 user nova-compute[73469]: DEBUG nova.compute.manager [req-671b2b12-690c-4558-ad45-5e66d3bd0ba3 req-68ee6d02-1d9a-44d6-8691-2b6fc8be96e8 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Received event network-changed-78ca747b-f8a3-4bde-8c6d-bfd860eca41b {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:12:29 user nova-compute[73469]: DEBUG nova.compute.manager [req-671b2b12-690c-4558-ad45-5e66d3bd0ba3 req-68ee6d02-1d9a-44d6-8691-2b6fc8be96e8 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Refreshing instance network info cache due to event network-changed-78ca747b-f8a3-4bde-8c6d-bfd860eca41b. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:12:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-671b2b12-690c-4558-ad45-5e66d3bd0ba3 req-68ee6d02-1d9a-44d6-8691-2b6fc8be96e8 service nova] Acquiring lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:12:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-671b2b12-690c-4558-ad45-5e66d3bd0ba3 req-68ee6d02-1d9a-44d6-8691-2b6fc8be96e8 service nova] Acquired lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:12:29 user nova-compute[73469]: DEBUG nova.network.neutron [req-671b2b12-690c-4558-ad45-5e66d3bd0ba3 req-68ee6d02-1d9a-44d6-8691-2b6fc8be96e8 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Refreshing network info cache for port 78ca747b-f8a3-4bde-8c6d-bfd860eca41b {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:12:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:30 user nova-compute[73469]: DEBUG nova.network.neutron [req-671b2b12-690c-4558-ad45-5e66d3bd0ba3 req-68ee6d02-1d9a-44d6-8691-2b6fc8be96e8 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Updated VIF entry in instance network info cache for port 78ca747b-f8a3-4bde-8c6d-bfd860eca41b. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:12:30 user nova-compute[73469]: DEBUG nova.network.neutron [req-671b2b12-690c-4558-ad45-5e66d3bd0ba3 req-68ee6d02-1d9a-44d6-8691-2b6fc8be96e8 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Updating instance_info_cache with network_info: [{"id": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "address": "fa:16:3e:0d:d7:78", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ca747b-f8", "ovs_interfaceid": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:12:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-671b2b12-690c-4558-ad45-5e66d3bd0ba3 req-68ee6d02-1d9a-44d6-8691-2b6fc8be96e8 service nova] Releasing lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:12:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-671b2b12-690c-4558-ad45-5e66d3bd0ba3 req-68ee6d02-1d9a-44d6-8691-2b6fc8be96e8 service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Received event network-changed-869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:12:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-671b2b12-690c-4558-ad45-5e66d3bd0ba3 req-68ee6d02-1d9a-44d6-8691-2b6fc8be96e8 service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Refreshing instance network info cache due to event network-changed-869bff62-e3a4-4403-af83-7434b36b53ed. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:12:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-671b2b12-690c-4558-ad45-5e66d3bd0ba3 req-68ee6d02-1d9a-44d6-8691-2b6fc8be96e8 service nova] Acquiring lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:12:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-671b2b12-690c-4558-ad45-5e66d3bd0ba3 req-68ee6d02-1d9a-44d6-8691-2b6fc8be96e8 service nova] Acquired lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:12:30 user nova-compute[73469]: DEBUG nova.network.neutron [req-671b2b12-690c-4558-ad45-5e66d3bd0ba3 req-68ee6d02-1d9a-44d6-8691-2b6fc8be96e8 service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Refreshing network info cache for port 869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:12:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-76074ec6-f340-4898-9dc7-21b908d093ab req-95dff362-c7e0-4978-8990-898b03091cb1 service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Received event network-vif-plugged-11b72dfc-679a-4db6-97a0-1bf25884e4d2 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:12:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-76074ec6-f340-4898-9dc7-21b908d093ab req-95dff362-c7e0-4978-8990-898b03091cb1 service nova] Acquiring lock "1189d718-45af-415f-bbf9-56093977b0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-76074ec6-f340-4898-9dc7-21b908d093ab req-95dff362-c7e0-4978-8990-898b03091cb1 service nova] Lock "1189d718-45af-415f-bbf9-56093977b0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-76074ec6-f340-4898-9dc7-21b908d093ab req-95dff362-c7e0-4978-8990-898b03091cb1 service nova] Lock "1189d718-45af-415f-bbf9-56093977b0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-76074ec6-f340-4898-9dc7-21b908d093ab req-95dff362-c7e0-4978-8990-898b03091cb1 service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] No waiting events found dispatching network-vif-plugged-11b72dfc-679a-4db6-97a0-1bf25884e4d2 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:12:30 user nova-compute[73469]: WARNING nova.compute.manager [req-76074ec6-f340-4898-9dc7-21b908d093ab req-95dff362-c7e0-4978-8990-898b03091cb1 service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Received unexpected event network-vif-plugged-11b72dfc-679a-4db6-97a0-1bf25884e4d2 for instance with vm_state building and task_state spawning.
Aug 22 03:12:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:31 user nova-compute[73469]: DEBUG nova.network.neutron [req-671b2b12-690c-4558-ad45-5e66d3bd0ba3 req-68ee6d02-1d9a-44d6-8691-2b6fc8be96e8 service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Updated VIF entry in instance network info cache for port 869bff62-e3a4-4403-af83-7434b36b53ed. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:12:31 user nova-compute[73469]: DEBUG nova.network.neutron [req-671b2b12-690c-4558-ad45-5e66d3bd0ba3 req-68ee6d02-1d9a-44d6-8691-2b6fc8be96e8 service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Updating instance_info_cache with network_info: [{"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:12:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-671b2b12-690c-4558-ad45-5e66d3bd0ba3 req-68ee6d02-1d9a-44d6-8691-2b6fc8be96e8 service nova] Releasing lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Stashing vm_state: active {{(pid=73469) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'pci_requests' on Instance uuid 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:12:32 user nova-compute[73469]: INFO nova.compute.claims [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Claim successful on node user
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'resources' on Instance uuid 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:12:32 user nova-compute[73469]: INFO nova.compute.resource_tracker [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Updating resource usage from migration 8fd81ceb-7ba4-44b9-8cbb-d8724dab588b
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673937.4404783, 8242cec1-3b35-4d14-9e0b-db8a7e75697d => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:12:32 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] VM Stopped (Lifecycle Event)
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-2c8c2e7e-db38-44e8-a32e-985439e34693 None None] [instance: 8242cec1-3b35-4d14-9e0b-db8a7e75697d] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.381s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:32 user nova-compute[73469]: INFO nova.compute.manager [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Migrating
Aug 22 03:12:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquired lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-8a240390-e8b2-4aff-8a94-268863416905 req-a05c57fe-664b-4f73-a583-33024bc59a68 service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Received event network-vif-plugged-11b72dfc-679a-4db6-97a0-1bf25884e4d2 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8a240390-e8b2-4aff-8a94-268863416905 req-a05c57fe-664b-4f73-a583-33024bc59a68 service nova] Acquiring lock "1189d718-45af-415f-bbf9-56093977b0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8a240390-e8b2-4aff-8a94-268863416905 req-a05c57fe-664b-4f73-a583-33024bc59a68 service nova] Lock "1189d718-45af-415f-bbf9-56093977b0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8a240390-e8b2-4aff-8a94-268863416905 req-a05c57fe-664b-4f73-a583-33024bc59a68 service nova] Lock "1189d718-45af-415f-bbf9-56093977b0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-8a240390-e8b2-4aff-8a94-268863416905 req-a05c57fe-664b-4f73-a583-33024bc59a68 service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] No waiting events found dispatching network-vif-plugged-11b72dfc-679a-4db6-97a0-1bf25884e4d2 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:12:32 user nova-compute[73469]: WARNING nova.compute.manager [req-8a240390-e8b2-4aff-8a94-268863416905 req-a05c57fe-664b-4f73-a583-33024bc59a68 service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Received unexpected event network-vif-plugged-11b72dfc-679a-4db6-97a0-1bf25884e4d2 for instance with vm_state building and task_state spawning.
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673952.6649387, 1189d718-45af-415f-bbf9-56093977b0c4 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:12:32 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] VM Resumed (Lifecycle Event)
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:12:32 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Instance spawned successfully.
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:12:32 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673952.6667142, 1189d718-45af-415f-bbf9-56093977b0c4 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:12:32 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] VM Started (Lifecycle Event)
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:12:32 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:12:32 user nova-compute[73469]: INFO nova.compute.manager [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Took 7.13 seconds to spawn the instance on the hypervisor.
Aug 22 03:12:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:12:32 user nova-compute[73469]: INFO nova.compute.manager [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Took 7.81 seconds to build instance.
Aug 22 03:12:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-36c1e1ec-b45f-41f9-9431-9592f85a8c8e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1189d718-45af-415f-bbf9-56093977b0c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.915s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:33 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Updating instance_info_cache with network_info: [{"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:12:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Releasing lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:12:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Starting migrate_disk_and_power_off {{(pid=73469) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 22 03:12:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-180a86a7-ab53-4b0d-9598-2d59060281c6 req-244577d0-9a86-4eb9-ae0b-7f69d2f98d1a service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Received event network-vif-unplugged-869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:12:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-180a86a7-ab53-4b0d-9598-2d59060281c6 req-244577d0-9a86-4eb9-ae0b-7f69d2f98d1a service nova] Acquiring lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-180a86a7-ab53-4b0d-9598-2d59060281c6 req-244577d0-9a86-4eb9-ae0b-7f69d2f98d1a service nova] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-180a86a7-ab53-4b0d-9598-2d59060281c6 req-244577d0-9a86-4eb9-ae0b-7f69d2f98d1a service nova] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-180a86a7-ab53-4b0d-9598-2d59060281c6 req-244577d0-9a86-4eb9-ae0b-7f69d2f98d1a service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] No waiting events found dispatching network-vif-unplugged-869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:12:33 user nova-compute[73469]: WARNING nova.compute.manager [req-180a86a7-ab53-4b0d-9598-2d59060281c6 req-244577d0-9a86-4eb9-ae0b-7f69d2f98d1a service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Received unexpected event network-vif-unplugged-869bff62-e3a4-4403-af83-7434b36b53ed for instance with vm_state active and task_state resize_migrating.
Aug 22 03:12:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:34 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Instance destroyed successfully.
Aug 22 03:12:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:10:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-15753066',display_name='tempest-ServerActionsTestOtherA-server-15753066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-15753066',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqna53ychrrpICcXpgxhDHdrzJyFFu88HUxTxIQK5z+xOZfcw7kHrC8QJBeI4lEfQOxVPYITpSoaAG4B9QNlgmIHoEX0gtT1wKkQ7bp7nCHyaP40f+//buUPKlKHlWXEA==',key_name='tempest-keypair-651522654',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:10:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2d1c312e979e47558b06d4fa70bc103a',ramdisk_id='',reservation_id='r-g82q5n0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1751677379',owner_user_name='tempest-ServerActionsTestOtherA-1751677379-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:12:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b47d6cefd0d4949bf4c3c0fc72a9cd5',uuid=9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-357776005-network", "vif_mac": "fa:16:3e:c4:97:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converting VIF {"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-357776005-network", "vif_mac": "fa:16:3e:c4:97:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:97:9c,bridge_name='br-int',has_traffic_filtering=True,id=869bff62-e3a4-4403-af83-7434b36b53ed,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869bff62-e3') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_vif [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:97:9c,bridge_name='br-int',has_traffic_filtering=True,id=869bff62-e3a4-4403-af83-7434b36b53ed,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869bff62-e3') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap869bff62-e3, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:12:34 user nova-compute[73469]: INFO os_vif [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:97:9c,bridge_name='br-int',has_traffic_filtering=True,id=869bff62-e3a4-4403-af83-7434b36b53ed,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869bff62-e3')
Aug 22 03:12:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTPihObH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:12:34 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c5a8db-726b-4397-b1f9-5e75189dccd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2875ee7-e1ea-4f0c-bdb2-b90e3bb35aac]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:12:34 user nova-compute[73469]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:12:34 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:12:34 user nova-compute[73469]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:12:34 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f798079d2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da9a79f-770f-4828-8d91-2356fdb848bc]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7af324-2801-44d3-9ef6-eaebecf065ac]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2e0ed5-491a-4f4f-9645-fea762f1bbbc]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28ba941-b9b6-403b-9482-9fc587625ade]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf3674d56-9295928dcc0f701a', '/dev/disk/by-id/scsi-23932393539323864', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f3674d56') {{(pid=84378) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c360df-9ef7-463d-97b6-1c76a27a3228]: (4, None) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd246e29-1c80-4561-a5c1-44d5fd553000]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3cfb5c-43a3-4c78-bf10-9b442c832db4]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6, portal: 172.16.0.220,3260]
Aug 22 03:12:34 user nova-compute[73469]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6, portal: 172.16.0.220,3260] successful.
Aug 22 03:12:34 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[660cd1bd-ff5e-44a1-9ffb-74e559a7b2f2]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] <== disconnect_volume: return (358ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:12:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:12:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-ffa808d0-5661-4c6f-9bcc-533abf132a2b req-fd219dec-b7b4-47c1-a080-3103e536284f service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Received event network-vif-plugged-869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:12:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ffa808d0-5661-4c6f-9bcc-533abf132a2b req-fd219dec-b7b4-47c1-a080-3103e536284f service nova] Acquiring lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ffa808d0-5661-4c6f-9bcc-533abf132a2b req-fd219dec-b7b4-47c1-a080-3103e536284f service nova] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ffa808d0-5661-4c6f-9bcc-533abf132a2b req-fd219dec-b7b4-47c1-a080-3103e536284f service nova] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-ffa808d0-5661-4c6f-9bcc-533abf132a2b req-fd219dec-b7b4-47c1-a080-3103e536284f service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] No waiting events found dispatching network-vif-plugged-869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:12:35 user nova-compute[73469]: WARNING nova.compute.manager [req-ffa808d0-5661-4c6f-9bcc-533abf132a2b req-fd219dec-b7b4-47c1-a080-3103e536284f service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Received unexpected event network-vif-plugged-869bff62-e3a4-4403-af83-7434b36b53ed for instance with vm_state active and task_state resize_migrating.
Aug 22 03:12:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:39 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Port 869bff62-e3a4-4403-af83-7434b36b53ed binding to destination host user is already ACTIVE {{(pid=73469) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 22 03:12:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:12:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquired lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:12:39 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Updating instance_info_cache with network_info: [{"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Releasing lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG os_brick.utils [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c205541b-45ed-45d5-a707-b034b27d71f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4f50c0-3bd4-4cc3-83d9-715c4f7a3b87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddc38b1-7d07-456c-9a5b-8d2ad3f9b2fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16dec63-a522-4c92-8025-9e38db949dab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:12:40 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:12:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62d4c30-981a-4c45-b9af-55bcdb3157b4]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:12:40 user nova-compute[73469]: DEBUG os_brick.utils [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:12:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "228b721b-c7c4-4994-b1be-28234ea6a4fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:44 user nova-compute[73469]: INFO nova.compute.manager [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Detaching volume f59d6e5b-0893-4146-9943-1e46c59fa6d0
Aug 22 03:12:44 user nova-compute[73469]: INFO nova.virt.block_device [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Attempting to driver detach volume f59d6e5b-0893-4146-9943-1e46c59fa6d0 from mountpoint /dev/vdb
Aug 22 03:12:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Attempting to detach device vdb from instance 228b721b-c7c4-4994-b1be-28234ea6a4fd from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:12:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:12:44 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:12:44 user nova-compute[73469]:   <source dev="/dev/sdd"/>
Aug 22 03:12:44 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:12:44 user nova-compute[73469]:   <serial>f59d6e5b-0893-4146-9943-1e46c59fa6d0</serial>
Aug 22 03:12:44 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:12:44 user nova-compute[73469]: </disk>
Aug 22 03:12:44 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:12:44 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Successfully detached device vdb from instance 228b721b-c7c4-4994-b1be-28234ea6a4fd from the persistent domain config.
Aug 22 03:12:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 228b721b-c7c4-4994-b1be-28234ea6a4fd from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:12:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:12:44 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:12:44 user nova-compute[73469]:   <source dev="/dev/sdd"/>
Aug 22 03:12:44 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:12:44 user nova-compute[73469]:   <serial>f59d6e5b-0893-4146-9943-1e46c59fa6d0</serial>
Aug 22 03:12:44 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:12:44 user nova-compute[73469]: </disk>
Aug 22 03:12:44 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692673965.4301164, 228b721b-c7c4-4994-b1be-28234ea6a4fd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 228b721b-c7c4-4994-b1be-28234ea6a4fd {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:12:45 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Successfully detached device vdb from instance 228b721b-c7c4-4994-b1be-28234ea6a4fd from the live domain config.
Aug 22 03:12:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGAWgOoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:12:45 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:12:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[decd3325-96aa-40ff-846f-1ab30729b32d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc6add5-acdc-45ed-b7c9-bfa5742cebaa]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:12:45 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 (non-flash)
Aug 22 03:12:45 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4647520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0'): ({'sdd'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Removing single pathed devices sdd {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd005af-f1c9-4668-b817-d5af32319205]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb849973-b975-45e4-8821-847b0bbcb6f3]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Flushing IO for device /dev/sdd {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9b435b-2a67-4531-a967-ec2fbbb28a2b]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5537efd2-f38a-4606-8b44-e1af783b6250]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45fce71-508b-4e2c-b7ec-949e96d6b521]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce49714-abf5-4611-a964-c1279e37c13d]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0, portal: 172.16.0.220,3260]
Aug 22 03:12:45 user nova-compute[73469]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0, portal: 172.16.0.220,3260] successful.
Aug 22 03:12:45 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f59d6e5b-0893-4146-9943-1e46c59fa6d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c855185e-c1b8-4f1c-b22e-bc4d94626284]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] <== disconnect_volume: return (302ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:12:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:12:46 user nova-compute[73469]: DEBUG nova.objects.instance [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'flavor' on Instance uuid 228b721b-c7c4-4994-b1be-28234ea6a4fd {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:12:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-98755f10-48c0-4972-84c5-f44d6f23a3d5 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.932s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:49 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673954.130594, 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:12:49 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] VM Stopped (Lifecycle Event)
Aug 22 03:12:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-55692825-615b-4014-9a83-9ed16806d708 None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:12:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-55692825-615b-4014-9a83-9ed16806d708 None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:12:49 user nova-compute[73469]: INFO nova.compute.manager [None req-55692825-615b-4014-9a83-9ed16806d708 None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 22 03:12:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:52 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:12:52 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:12:52 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:12:52 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:12:52 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:12:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:54 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:12:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:12:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:12:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-bda33a54-edf0-4809-9469-f1774fdc5b12" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:12:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-bda33a54-edf0-4809-9469-f1774fdc5b12" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:12:54 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:12:54 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid bda33a54-edf0-4809-9469-f1774fdc5b12 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:12:55 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Updating instance_info_cache with network_info: [{"id": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "address": "fa:16:3e:bb:16:09", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2932ec7b-19", "ovs_interfaceid": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:12:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-bda33a54-edf0-4809-9469-f1774fdc5b12" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:12:55 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:12:55 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:12:55 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:12:55 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:12:55 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:12:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:55 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:12:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:12:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:12:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:12:57 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:12:57 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:12:57 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8045MB free_disk=25.088558197021484GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:12:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:12:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:12:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Applying migration context for instance 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 as it has an incoming, in-progress migration 8fd81ceb-7ba4-44b9-8cbb-d8724dab588b. Migration status is post-migrating {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 22 03:12:58 user nova-compute[73469]: INFO nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Updating resource usage from migration 8fd81ceb-7ba4-44b9-8cbb-d8724dab588b
Aug 22 03:12:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance bda33a54-edf0-4809-9469-f1774fdc5b12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:12:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82e872a7-70b0-4290-9a11-5316765aed01 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:12:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a7e95a46-9a75-4b0c-a5c9-42ed521668a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:12:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 228b721b-c7c4-4994-b1be-28234ea6a4fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:12:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 1189d718-45af-415f-bbf9-56093977b0c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:12:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Migration 8fd81ceb-7ba4-44b9-8cbb-d8724dab588b is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 22 03:12:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:12:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:12:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:12:58 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:12:58 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:12:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:12:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:12:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:12:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:00 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:13:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "bda33a54-edf0-4809-9469-f1774fdc5b12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "bda33a54-edf0-4809-9469-f1774fdc5b12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "bda33a54-edf0-4809-9469-f1774fdc5b12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "bda33a54-edf0-4809-9469-f1774fdc5b12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "bda33a54-edf0-4809-9469-f1774fdc5b12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:07 user nova-compute[73469]: INFO nova.compute.manager [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Terminating instance
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.compute.manager [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Starting finish_migration {{(pid=73469) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Instance directory exists: not creating {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 22 03:13:07 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Creating image(s)
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Did not create local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Ensure instance console log exists: /opt/stack/data/nova/instances/9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Start _get_guest_xml network_info=[{"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-357776005-network", "vif_mac": "fa:16:3e:c4:97:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'c6b5f050-0be2-48c5-8dfd-6561ee69d26b', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTPihObH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00', 'attached_at': '2023-08-22T03:13:07.000000', 'detached_at': '', 'volume_id': '9e2d9588-7a08-4e9c-8aea-98b5448ddca6', 'serial': '9e2d9588-7a08-4e9c-8aea-98b5448ddca6'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:07 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:13:07 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTPihObH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:13:07 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:13:07 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:13:07 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:13:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[040bee2a-57fa-49c6-8cf0-38e26ca3262f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:13:07 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba89663-f717-46e5-835d-9a15b5457c60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6] added
Aug 22 03:13:07 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-86b72fdf-d8b1-459b-9cb1-7df0ef93be44 req-bdbc624f-6ffc-4b14-b507-bb5d9f748268 service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Received event network-vif-unplugged-2932ec7b-1969-4b0c-8566-d4ebca4b99f7 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-86b72fdf-d8b1-459b-9cb1-7df0ef93be44 req-bdbc624f-6ffc-4b14-b507-bb5d9f748268 service nova] Acquiring lock "bda33a54-edf0-4809-9469-f1774fdc5b12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-86b72fdf-d8b1-459b-9cb1-7df0ef93be44 req-bdbc624f-6ffc-4b14-b507-bb5d9f748268 service nova] Lock "bda33a54-edf0-4809-9469-f1774fdc5b12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-86b72fdf-d8b1-459b-9cb1-7df0ef93be44 req-bdbc624f-6ffc-4b14-b507-bb5d9f748268 service nova] Lock "bda33a54-edf0-4809-9469-f1774fdc5b12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-86b72fdf-d8b1-459b-9cb1-7df0ef93be44 req-bdbc624f-6ffc-4b14-b507-bb5d9f748268 service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] No waiting events found dispatching network-vif-unplugged-2932ec7b-1969-4b0c-8566-d4ebca4b99f7 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-86b72fdf-d8b1-459b-9cb1-7df0ef93be44 req-bdbc624f-6ffc-4b14-b507-bb5d9f748268 service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Received event network-vif-unplugged-2932ec7b-1969-4b0c-8566-d4ebca4b99f7 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7ea02f-53fb-479d-8af9-6835b88a933c]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[608bdadf-a3d4-4275-9e9e-3e81f478e11c]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zTPihObH {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zTPihObH" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fa5fe9-39ba-4ac6-8fb6-4b6319e6198f]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zTPihObH'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c8c8ca-1327-4c66-8bfe-4fef8f9e7607]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4670e8-bb54-4497-8317-7f6d22032f5f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:13:07 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:13:07 user nova-compute[73469]:  {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:13:07 user nova-compute[73469]: WARNING os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 22 03:13:07 user nova-compute[73469]: 
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff47bc9-a01a-45f3-810a-cc8ec02f79bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6, portal: 172.16.0.220,3260]
Aug 22 03:13:07 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6, portal: 172.16.0.220,3260] successful.
Aug 22 03:13:07 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[962a908e-7c86-4905-a8b6-7ae8af1e5d23]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb7d818-f702-451a-b423-2257325d6d3f]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:13:07 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:13:07 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.031s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9197e6a3-1ed4-4cca-baca-fac2f996a7f8]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:13:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTPihObH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:13:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:08 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Instance destroyed successfully.
Aug 22 03:13:08 user nova-compute[73469]: DEBUG nova.objects.instance [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lazy-loading 'resources' on Instance uuid bda33a54-edf0-4809-9469-f1774fdc5b12 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:13:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-718399569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-718399569',id=1,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:52:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9131cb883044191931dc31e51e94766',ramdisk_id='',reservation_id='r-o5r9oly0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568629509',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:54:36Z,user_data=None,user_id='a7b228f99c9e4d058e128a5a99636b7b',uuid=bda33a54-edf0-4809-9469-f1774fdc5b12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "address": "fa:16:3e:bb:16:09", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2932ec7b-19", "ovs_interfaceid": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:13:08 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converting VIF {"id": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "address": "fa:16:3e:bb:16:09", "network": {"id": "1bd637a1-3704-4eb7-a887-13e16f26653c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-784196557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9131cb883044191931dc31e51e94766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2932ec7b-19", "ovs_interfaceid": "2932ec7b-1969-4b0c-8566-d4ebca4b99f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:13:08 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:16:09,bridge_name='br-int',has_traffic_filtering=True,id=2932ec7b-1969-4b0c-8566-d4ebca4b99f7,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2932ec7b-19') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:13:08 user nova-compute[73469]: DEBUG os_vif [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:16:09,bridge_name='br-int',has_traffic_filtering=True,id=2932ec7b-1969-4b0c-8566-d4ebca4b99f7,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2932ec7b-19') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:13:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2932ec7b-19, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:13:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:08 user nova-compute[73469]: INFO os_vif [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:16:09,bridge_name='br-int',has_traffic_filtering=True,id=2932ec7b-1969-4b0c-8566-d4ebca4b99f7,network=Network(1bd637a1-3704-4eb7-a887-13e16f26653c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2932ec7b-19')
Aug 22 03:13:08 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Deleting instance files /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12_del
Aug 22 03:13:08 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Deletion of /opt/stack/data/nova/instances/bda33a54-edf0-4809-9469-f1774fdc5b12_del complete
Aug 22 03:13:08 user nova-compute[73469]: INFO nova.compute.manager [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Took 0.78 seconds to destroy the instance on the hypervisor.
Aug 22 03:13:08 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:13:08 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:13:08 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:13:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:13:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23932393539323864', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:13:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932393539323864', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:10:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-15753066',display_name='tempest-ServerActionsTestOtherA-server-15753066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-15753066',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqna53ychrrpICcXpgxhDHdrzJyFFu88HUxTxIQK5z+xOZfcw7kHrC8QJBeI4lEfQOxVPYITpSoaAG4B9QNlgmIHoEX0gtT1wKkQ7bp7nCHyaP40f+//buUPKlKHlWXEA==',key_name='tempest-keypair-651522654',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:10:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2d1c312e979e47558b06d4fa70bc103a',ramdisk_id='',reservation_id='r-g82q5n0v',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1751677379',owner_user_name='tempest-ServerActionsTestOtherA-1751677379-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:12:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b47d6cefd0d4949bf4c3c0fc72a9cd5',uuid=9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-357776005-network", "vif_mac": "fa:16:3e:c4:97:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converting VIF {"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-357776005-network", "vif_mac": "fa:16:3e:c4:97:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:97:9c,bridge_name='br-int',has_traffic_filtering=True,id=869bff62-e3a4-4403-af83-7434b36b53ed,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869bff62-e3') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:13:09 user nova-compute[73469]:   <uuid>9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00</uuid>
Aug 22 03:13:09 user nova-compute[73469]:   <name>instance-00000023</name>
Aug 22 03:13:09 user nova-compute[73469]:   <memory>2097152</memory>
Aug 22 03:13:09 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:13:09 user nova-compute[73469]:   <metadata>
Aug 22 03:13:09 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:13:09 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:13:09 user nova-compute[73469]:       <nova:name>tempest-ServerActionsTestOtherA-server-15753066</nova:name>
Aug 22 03:13:09 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:13:07</nova:creationTime>
Aug 22 03:13:09 user nova-compute[73469]:       <nova:flavor name="m1.small">
Aug 22 03:13:09 user nova-compute[73469]:         <nova:memory>2048</nova:memory>
Aug 22 03:13:09 user nova-compute[73469]:         <nova:disk>20</nova:disk>
Aug 22 03:13:09 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:13:09 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:13:09 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:13:09 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:13:09 user nova-compute[73469]:       <nova:owner>
Aug 22 03:13:09 user nova-compute[73469]:         <nova:user uuid="8b47d6cefd0d4949bf4c3c0fc72a9cd5">tempest-ServerActionsTestOtherA-1751677379-project-member</nova:user>
Aug 22 03:13:09 user nova-compute[73469]:         <nova:project uuid="2d1c312e979e47558b06d4fa70bc103a">tempest-ServerActionsTestOtherA-1751677379</nova:project>
Aug 22 03:13:09 user nova-compute[73469]:       </nova:owner>
Aug 22 03:13:09 user nova-compute[73469]:       <nova:ports>
Aug 22 03:13:09 user nova-compute[73469]:         <nova:port uuid="869bff62-e3a4-4403-af83-7434b36b53ed">
Aug 22 03:13:09 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 22 03:13:09 user nova-compute[73469]:         </nova:port>
Aug 22 03:13:09 user nova-compute[73469]:       </nova:ports>
Aug 22 03:13:09 user nova-compute[73469]:     </nova:instance>
Aug 22 03:13:09 user nova-compute[73469]:   </metadata>
Aug 22 03:13:09 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:13:09 user nova-compute[73469]:     <system>
Aug 22 03:13:09 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:13:09 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:13:09 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:13:09 user nova-compute[73469]:       <entry name="serial">9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00</entry>
Aug 22 03:13:09 user nova-compute[73469]:       <entry name="uuid">9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00</entry>
Aug 22 03:13:09 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:13:09 user nova-compute[73469]:     </system>
Aug 22 03:13:09 user nova-compute[73469]:   </sysinfo>
Aug 22 03:13:09 user nova-compute[73469]:   <os>
Aug 22 03:13:09 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:13:09 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:13:09 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:13:09 user nova-compute[73469]:   </os>
Aug 22 03:13:09 user nova-compute[73469]:   <features>
Aug 22 03:13:09 user nova-compute[73469]:     <acpi/>
Aug 22 03:13:09 user nova-compute[73469]:     <apic/>
Aug 22 03:13:09 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:13:09 user nova-compute[73469]:   </features>
Aug 22 03:13:09 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:13:09 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:13:09 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:13:09 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:13:09 user nova-compute[73469]:   </clock>
Aug 22 03:13:09 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:13:09 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:13:09 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:13:09 user nova-compute[73469]:   </cpu>
Aug 22 03:13:09 user nova-compute[73469]:   <devices>
Aug 22 03:13:09 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:13:09 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:13:09 user nova-compute[73469]:       <source dev="/dev/sdb"/>
Aug 22 03:13:09 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:13:09 user nova-compute[73469]:       <serial>9e2d9588-7a08-4e9c-8aea-98b5448ddca6</serial>
Aug 22 03:13:09 user nova-compute[73469]:     </disk>
Aug 22 03:13:09 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:13:09 user nova-compute[73469]:       <mac address="fa:16:3e:c4:97:9c"/>
Aug 22 03:13:09 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:13:09 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:13:09 user nova-compute[73469]:       <target dev="tap869bff62-e3"/>
Aug 22 03:13:09 user nova-compute[73469]:     </interface>
Aug 22 03:13:09 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:13:09 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00/console.log" append="off"/>
Aug 22 03:13:09 user nova-compute[73469]:     </serial>
Aug 22 03:13:09 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:13:09 user nova-compute[73469]:     <video>
Aug 22 03:13:09 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:13:09 user nova-compute[73469]:     </video>
Aug 22 03:13:09 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:13:09 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:13:09 user nova-compute[73469]:     </rng>
Aug 22 03:13:09 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:13:09 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:13:09 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:13:09 user nova-compute[73469]:     </memballoon>
Aug 22 03:13:09 user nova-compute[73469]:   </devices>
Aug 22 03:13:09 user nova-compute[73469]: </domain>
Aug 22 03:13:09 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:10:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-15753066',display_name='tempest-ServerActionsTestOtherA-server-15753066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-15753066',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqna53ychrrpICcXpgxhDHdrzJyFFu88HUxTxIQK5z+xOZfcw7kHrC8QJBeI4lEfQOxVPYITpSoaAG4B9QNlgmIHoEX0gtT1wKkQ7bp7nCHyaP40f+//buUPKlKHlWXEA==',key_name='tempest-keypair-651522654',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:10:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2d1c312e979e47558b06d4fa70bc103a',ramdisk_id='',reservation_id='r-g82q5n0v',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1751677379',owner_user_name='tempest-ServerActionsTestOtherA-1751677379-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:12:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b47d6cefd0d4949bf4c3c0fc72a9cd5',uuid=9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-357776005-network", "vif_mac": "fa:16:3e:c4:97:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converting VIF {"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-357776005-network", "vif_mac": "fa:16:3e:c4:97:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:97:9c,bridge_name='br-int',has_traffic_filtering=True,id=869bff62-e3a4-4403-af83-7434b36b53ed,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869bff62-e3') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG os_vif [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:97:9c,bridge_name='br-int',has_traffic_filtering=True,id=869bff62-e3a4-4403-af83-7434b36b53ed,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869bff62-e3') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap869bff62-e3, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap869bff62-e3, col_values=(('external_ids', {'iface-id': '869bff62-e3a4-4403-af83-7434b36b53ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:97:9c', 'vm-uuid': '9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG nova.compute.manager [req-0c8f33cc-696b-4101-84d0-61d346b0596d req-48097412-2eb9-4ea0-823b-22dfaaa8b6ec service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Received event network-vif-deleted-2932ec7b-1969-4b0c-8566-d4ebca4b99f7 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:13:09 user nova-compute[73469]: INFO nova.compute.manager [req-0c8f33cc-696b-4101-84d0-61d346b0596d req-48097412-2eb9-4ea0-823b-22dfaaa8b6ec service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Neutron deleted interface 2932ec7b-1969-4b0c-8566-d4ebca4b99f7; detaching it from the instance and deleting it from the info cache
Aug 22 03:13:09 user nova-compute[73469]: DEBUG nova.network.neutron [req-0c8f33cc-696b-4101-84d0-61d346b0596d req-48097412-2eb9-4ea0-823b-22dfaaa8b6ec service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:09 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Took 0.82 seconds to deallocate network for instance.
Aug 22 03:13:09 user nova-compute[73469]: INFO os_vif [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:97:9c,bridge_name='br-int',has_traffic_filtering=True,id=869bff62-e3a4-4403-af83-7434b36b53ed,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869bff62-e3')
Aug 22 03:13:09 user nova-compute[73469]: DEBUG nova.compute.manager [req-0c8f33cc-696b-4101-84d0-61d346b0596d req-48097412-2eb9-4ea0-823b-22dfaaa8b6ec service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Detach interface failed, port_id=2932ec7b-1969-4b0c-8566-d4ebca4b99f7, reason: Instance bda33a54-edf0-4809-9469-f1774fdc5b12 could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] No VIF found with MAC fa:16:3e:c4:97:9c, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:09 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Deleted allocations for instance bda33a54-edf0-4809-9469-f1774fdc5b12
Aug 22 03:13:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-05541226-4ebd-486f-8248-0bc3cd7fcb50 tempest-ServerBootFromVolumeStableRescueTest-568629509 tempest-ServerBootFromVolumeStableRescueTest-568629509-project-member] Lock "bda33a54-edf0-4809-9469-f1774fdc5b12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.219s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG nova.compute.manager [req-385b6703-0614-49ca-a7bb-a23b34a2d7fc req-e4927644-922a-4bdb-939f-b888460b1057 service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Received event network-vif-plugged-2932ec7b-1969-4b0c-8566-d4ebca4b99f7 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-385b6703-0614-49ca-a7bb-a23b34a2d7fc req-e4927644-922a-4bdb-939f-b888460b1057 service nova] Acquiring lock "bda33a54-edf0-4809-9469-f1774fdc5b12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-385b6703-0614-49ca-a7bb-a23b34a2d7fc req-e4927644-922a-4bdb-939f-b888460b1057 service nova] Lock "bda33a54-edf0-4809-9469-f1774fdc5b12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-385b6703-0614-49ca-a7bb-a23b34a2d7fc req-e4927644-922a-4bdb-939f-b888460b1057 service nova] Lock "bda33a54-edf0-4809-9469-f1774fdc5b12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:09 user nova-compute[73469]: DEBUG nova.compute.manager [req-385b6703-0614-49ca-a7bb-a23b34a2d7fc req-e4927644-922a-4bdb-939f-b888460b1057 service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] No waiting events found dispatching network-vif-plugged-2932ec7b-1969-4b0c-8566-d4ebca4b99f7 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:13:09 user nova-compute[73469]: WARNING nova.compute.manager [req-385b6703-0614-49ca-a7bb-a23b34a2d7fc req-e4927644-922a-4bdb-939f-b888460b1057 service nova] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Received unexpected event network-vif-plugged-2932ec7b-1969-4b0c-8566-d4ebca4b99f7 for instance with vm_state deleted and task_state None.
Aug 22 03:13:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:12 user nova-compute[73469]: DEBUG nova.compute.manager [req-7594d3c5-130d-46f5-a452-67856b1c17c3 req-6de3e8ba-9bc5-4b60-a37e-e80edb291c73 service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Received event network-vif-plugged-869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:13:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7594d3c5-130d-46f5-a452-67856b1c17c3 req-6de3e8ba-9bc5-4b60-a37e-e80edb291c73 service nova] Acquiring lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7594d3c5-130d-46f5-a452-67856b1c17c3 req-6de3e8ba-9bc5-4b60-a37e-e80edb291c73 service nova] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7594d3c5-130d-46f5-a452-67856b1c17c3 req-6de3e8ba-9bc5-4b60-a37e-e80edb291c73 service nova] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:12 user nova-compute[73469]: DEBUG nova.compute.manager [req-7594d3c5-130d-46f5-a452-67856b1c17c3 req-6de3e8ba-9bc5-4b60-a37e-e80edb291c73 service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] No waiting events found dispatching network-vif-plugged-869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:13:12 user nova-compute[73469]: WARNING nova.compute.manager [req-7594d3c5-130d-46f5-a452-67856b1c17c3 req-6de3e8ba-9bc5-4b60-a37e-e80edb291c73 service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Received unexpected event network-vif-plugged-869bff62-e3a4-4403-af83-7434b36b53ed for instance with vm_state active and task_state resize_finish.
Aug 22 03:13:12 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673992.6589746, 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:13:12 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] VM Resumed (Lifecycle Event)
Aug 22 03:13:12 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:13:12 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Instance running successfully.
Aug 22 03:13:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Failed to set time: agent not configured {{(pid=73469) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 22 03:13:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b16b9676-9d6b-4b65-bb0a-bddc73abf39f tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] finish_migration finished successfully. {{(pid=73469) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 22 03:13:12 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:13:12 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:13:12 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 22 03:13:12 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692673992.6604917, 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:13:12 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] VM Started (Lifecycle Event)
Aug 22 03:13:12 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:13:12 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:13:12 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 22 03:13:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-46c840dc-7857-411c-ac23-cab740cefe01 req-edd3256f-4c08-484b-b446-aea98db164fd service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Received event network-vif-plugged-869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:13:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-46c840dc-7857-411c-ac23-cab740cefe01 req-edd3256f-4c08-484b-b446-aea98db164fd service nova] Acquiring lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-46c840dc-7857-411c-ac23-cab740cefe01 req-edd3256f-4c08-484b-b446-aea98db164fd service nova] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-46c840dc-7857-411c-ac23-cab740cefe01 req-edd3256f-4c08-484b-b446-aea98db164fd service nova] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-46c840dc-7857-411c-ac23-cab740cefe01 req-edd3256f-4c08-484b-b446-aea98db164fd service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] No waiting events found dispatching network-vif-plugged-869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:13:14 user nova-compute[73469]: WARNING nova.compute.manager [req-46c840dc-7857-411c-ac23-cab740cefe01 req-edd3256f-4c08-484b-b446-aea98db164fd service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Received unexpected event network-vif-plugged-869bff62-e3a4-4403-af83-7434b36b53ed for instance with vm_state resized and task_state None.
Aug 22 03:13:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Acquiring lock "c2497d75-a68e-44ed-9f12-efb73b933bf3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Lock "c2497d75-a68e-44ed-9f12-efb73b933bf3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:20 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:13:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:20 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:13:20 user nova-compute[73469]: INFO nova.compute.claims [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Claim successful on node user
Aug 22 03:13:21 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:13:21 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:13:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG nova.policy [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82b0db7bcddf45e5ab7d8d434dec4834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db81e49cdb3e45918600fbe15131a8e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:13:21 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Creating image(s)
Aug 22 03:13:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Lock "/opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Lock "/opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.209s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.196s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/disk 1073741824" returned: 0 in 0.087s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:22 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Successfully created port: ccee7d66-b060-4ba1-9c0a-e17a25a7bd07 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:13:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:22 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:13:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:22 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Cannot resize image /opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:13:22 user nova-compute[73469]: DEBUG nova.objects.instance [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Lazy-loading 'migration_context' on Instance uuid c2497d75-a68e-44ed-9f12-efb73b933bf3 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:13:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:13:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Ensure instance console log exists: /opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:13:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Successfully updated port: ccee7d66-b060-4ba1-9c0a-e17a25a7bd07 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Acquiring lock "refresh_cache-c2497d75-a68e-44ed-9f12-efb73b933bf3" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Acquired lock "refresh_cache-c2497d75-a68e-44ed-9f12-efb73b933bf3" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-54cf4445-e7d1-4820-b287-b383eecb122d req-43ac33db-e8d1-4e23-81a6-e3a97bfd881e service nova] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Received event network-changed-ccee7d66-b060-4ba1-9c0a-e17a25a7bd07 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-54cf4445-e7d1-4820-b287-b383eecb122d req-43ac33db-e8d1-4e23-81a6-e3a97bfd881e service nova] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Refreshing instance network info cache due to event network-changed-ccee7d66-b060-4ba1-9c0a-e17a25a7bd07. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-54cf4445-e7d1-4820-b287-b383eecb122d req-43ac33db-e8d1-4e23-81a6-e3a97bfd881e service nova] Acquiring lock "refresh_cache-c2497d75-a68e-44ed-9f12-efb73b933bf3" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692673988.1040301, bda33a54-edf0-4809-9469-f1774fdc5b12 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:13:23 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] VM Stopped (Lifecycle Event)
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ef59c536-877b-444c-9134-2fefb22a3637 None None] [instance: bda33a54-edf0-4809-9469-f1774fdc5b12] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Updating instance_info_cache with network_info: [{"id": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "address": "fa:16:3e:6e:12:29", "network": {"id": "c90e7c67-e16e-421c-919c-69255250d9ee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db81e49cdb3e45918600fbe15131a8e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee7d66-b0", "ovs_interfaceid": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Releasing lock "refresh_cache-c2497d75-a68e-44ed-9f12-efb73b933bf3" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Instance network_info: |[{"id": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "address": "fa:16:3e:6e:12:29", "network": {"id": "c90e7c67-e16e-421c-919c-69255250d9ee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db81e49cdb3e45918600fbe15131a8e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee7d66-b0", "ovs_interfaceid": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-54cf4445-e7d1-4820-b287-b383eecb122d req-43ac33db-e8d1-4e23-81a6-e3a97bfd881e service nova] Acquired lock "refresh_cache-c2497d75-a68e-44ed-9f12-efb73b933bf3" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.network.neutron [req-54cf4445-e7d1-4820-b287-b383eecb122d req-43ac33db-e8d1-4e23-81a6-e3a97bfd881e service nova] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Refreshing network info cache for port ccee7d66-b060-4ba1-9c0a-e17a25a7bd07 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Start _get_guest_xml network_info=[{"id": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "address": "fa:16:3e:6e:12:29", "network": {"id": "c90e7c67-e16e-421c-919c-69255250d9ee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db81e49cdb3e45918600fbe15131a8e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee7d66-b0", "ovs_interfaceid": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:23 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:13:23 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-940629221',display_name='tempest-VolumesActionsTest-instance-940629221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-940629221',id=37,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db81e49cdb3e45918600fbe15131a8e2',ramdisk_id='',reservation_id='r-60gf518o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-778029228',owner_user_name='tempest-VolumesActionsTest-778029228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:13:21Z,user_data=None,user_id='82b0db7bcddf45e5ab7d8d434dec4834',uuid=c2497d75-a68e-44ed-9f12-efb73b933bf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "address": "fa:16:3e:6e:12:29", "network": {"id": "c90e7c67-e16e-421c-919c-69255250d9ee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db81e49cdb3e45918600fbe15131a8e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee7d66-b0", "ovs_interfaceid": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Converting VIF {"id": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "address": "fa:16:3e:6e:12:29", "network": {"id": "c90e7c67-e16e-421c-919c-69255250d9ee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db81e49cdb3e45918600fbe15131a8e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee7d66-b0", "ovs_interfaceid": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:12:29,bridge_name='br-int',has_traffic_filtering=True,id=ccee7d66-b060-4ba1-9c0a-e17a25a7bd07,network=Network(c90e7c67-e16e-421c-919c-69255250d9ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccee7d66-b0') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.objects.instance [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Lazy-loading 'pci_devices' on Instance uuid c2497d75-a68e-44ed-9f12-efb73b933bf3 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:13:23 user nova-compute[73469]:   <uuid>c2497d75-a68e-44ed-9f12-efb73b933bf3</uuid>
Aug 22 03:13:23 user nova-compute[73469]:   <name>instance-00000025</name>
Aug 22 03:13:23 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:13:23 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:13:23 user nova-compute[73469]:   <metadata>
Aug 22 03:13:23 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:13:23 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:13:23 user nova-compute[73469]:       <nova:name>tempest-VolumesActionsTest-instance-940629221</nova:name>
Aug 22 03:13:23 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:13:23</nova:creationTime>
Aug 22 03:13:23 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:13:23 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:13:23 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:13:23 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:13:23 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:13:23 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:13:23 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:13:23 user nova-compute[73469]:       <nova:owner>
Aug 22 03:13:23 user nova-compute[73469]:         <nova:user uuid="82b0db7bcddf45e5ab7d8d434dec4834">tempest-VolumesActionsTest-778029228-project-member</nova:user>
Aug 22 03:13:23 user nova-compute[73469]:         <nova:project uuid="db81e49cdb3e45918600fbe15131a8e2">tempest-VolumesActionsTest-778029228</nova:project>
Aug 22 03:13:23 user nova-compute[73469]:       </nova:owner>
Aug 22 03:13:23 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:13:23 user nova-compute[73469]:       <nova:ports>
Aug 22 03:13:23 user nova-compute[73469]:         <nova:port uuid="ccee7d66-b060-4ba1-9c0a-e17a25a7bd07">
Aug 22 03:13:23 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 22 03:13:23 user nova-compute[73469]:         </nova:port>
Aug 22 03:13:23 user nova-compute[73469]:       </nova:ports>
Aug 22 03:13:23 user nova-compute[73469]:     </nova:instance>
Aug 22 03:13:23 user nova-compute[73469]:   </metadata>
Aug 22 03:13:23 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:13:23 user nova-compute[73469]:     <system>
Aug 22 03:13:23 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:13:23 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:13:23 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:13:23 user nova-compute[73469]:       <entry name="serial">c2497d75-a68e-44ed-9f12-efb73b933bf3</entry>
Aug 22 03:13:23 user nova-compute[73469]:       <entry name="uuid">c2497d75-a68e-44ed-9f12-efb73b933bf3</entry>
Aug 22 03:13:23 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:13:23 user nova-compute[73469]:     </system>
Aug 22 03:13:23 user nova-compute[73469]:   </sysinfo>
Aug 22 03:13:23 user nova-compute[73469]:   <os>
Aug 22 03:13:23 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:13:23 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:13:23 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:13:23 user nova-compute[73469]:   </os>
Aug 22 03:13:23 user nova-compute[73469]:   <features>
Aug 22 03:13:23 user nova-compute[73469]:     <acpi/>
Aug 22 03:13:23 user nova-compute[73469]:     <apic/>
Aug 22 03:13:23 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:13:23 user nova-compute[73469]:   </features>
Aug 22 03:13:23 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:13:23 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:13:23 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:13:23 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:13:23 user nova-compute[73469]:   </clock>
Aug 22 03:13:23 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:13:23 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:13:23 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:13:23 user nova-compute[73469]:   </cpu>
Aug 22 03:13:23 user nova-compute[73469]:   <devices>
Aug 22 03:13:23 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:13:23 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:13:23 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/disk"/>
Aug 22 03:13:23 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:13:23 user nova-compute[73469]:     </disk>
Aug 22 03:13:23 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:13:23 user nova-compute[73469]:       <mac address="fa:16:3e:6e:12:29"/>
Aug 22 03:13:23 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:13:23 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:13:23 user nova-compute[73469]:       <target dev="tapccee7d66-b0"/>
Aug 22 03:13:23 user nova-compute[73469]:     </interface>
Aug 22 03:13:23 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:13:23 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/console.log" append="off"/>
Aug 22 03:13:23 user nova-compute[73469]:     </serial>
Aug 22 03:13:23 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:13:23 user nova-compute[73469]:     <video>
Aug 22 03:13:23 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:13:23 user nova-compute[73469]:     </video>
Aug 22 03:13:23 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:13:23 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:13:23 user nova-compute[73469]:     </rng>
Aug 22 03:13:23 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:13:23 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:13:23 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:13:23 user nova-compute[73469]:     </memballoon>
Aug 22 03:13:23 user nova-compute[73469]:   </devices>
Aug 22 03:13:23 user nova-compute[73469]: </domain>
Aug 22 03:13:23 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-940629221',display_name='tempest-VolumesActionsTest-instance-940629221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-940629221',id=37,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db81e49cdb3e45918600fbe15131a8e2',ramdisk_id='',reservation_id='r-60gf518o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-778029228',owner_user_name='tempest-VolumesActionsTest-778029228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:13:21Z,user_data=None,user_id='82b0db7bcddf45e5ab7d8d434dec4834',uuid=c2497d75-a68e-44ed-9f12-efb73b933bf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "address": "fa:16:3e:6e:12:29", "network": {"id": "c90e7c67-e16e-421c-919c-69255250d9ee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db81e49cdb3e45918600fbe15131a8e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee7d66-b0", "ovs_interfaceid": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Converting VIF {"id": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "address": "fa:16:3e:6e:12:29", "network": {"id": "c90e7c67-e16e-421c-919c-69255250d9ee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db81e49cdb3e45918600fbe15131a8e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee7d66-b0", "ovs_interfaceid": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:12:29,bridge_name='br-int',has_traffic_filtering=True,id=ccee7d66-b060-4ba1-9c0a-e17a25a7bd07,network=Network(c90e7c67-e16e-421c-919c-69255250d9ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccee7d66-b0') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG os_vif [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:12:29,bridge_name='br-int',has_traffic_filtering=True,id=ccee7d66-b060-4ba1-9c0a-e17a25a7bd07,network=Network(c90e7c67-e16e-421c-919c-69255250d9ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccee7d66-b0') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccee7d66-b0, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapccee7d66-b0, col_values=(('external_ids', {'iface-id': 'ccee7d66-b060-4ba1-9c0a-e17a25a7bd07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:12:29', 'vm-uuid': 'c2497d75-a68e-44ed-9f12-efb73b933bf3'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:23 user nova-compute[73469]: INFO os_vif [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:12:29,bridge_name='br-int',has_traffic_filtering=True,id=ccee7d66-b060-4ba1-9c0a-e17a25a7bd07,network=Network(c90e7c67-e16e-421c-919c-69255250d9ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccee7d66-b0')
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] No VIF found with MAC fa:16:3e:6e:12:29, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:13:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:24 user nova-compute[73469]: DEBUG nova.network.neutron [req-54cf4445-e7d1-4820-b287-b383eecb122d req-43ac33db-e8d1-4e23-81a6-e3a97bfd881e service nova] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Updated VIF entry in instance network info cache for port ccee7d66-b060-4ba1-9c0a-e17a25a7bd07. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:13:24 user nova-compute[73469]: DEBUG nova.network.neutron [req-54cf4445-e7d1-4820-b287-b383eecb122d req-43ac33db-e8d1-4e23-81a6-e3a97bfd881e service nova] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Updating instance_info_cache with network_info: [{"id": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "address": "fa:16:3e:6e:12:29", "network": {"id": "c90e7c67-e16e-421c-919c-69255250d9ee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db81e49cdb3e45918600fbe15131a8e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee7d66-b0", "ovs_interfaceid": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:13:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-54cf4445-e7d1-4820-b287-b383eecb122d req-43ac33db-e8d1-4e23-81a6-e3a97bfd881e service nova] Releasing lock "refresh_cache-c2497d75-a68e-44ed-9f12-efb73b933bf3" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:13:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:27 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674007.1305096, c2497d75-a68e-44ed-9f12-efb73b933bf3 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:13:27 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] VM Resumed (Lifecycle Event)
Aug 22 03:13:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:13:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:13:27 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Instance spawned successfully.
Aug 22 03:13:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:13:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:13:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:13:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:13:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:13:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:13:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:13:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:13:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:13:27 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:13:27 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674007.1310055, c2497d75-a68e-44ed-9f12-efb73b933bf3 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:13:27 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] VM Started (Lifecycle Event)
Aug 22 03:13:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:13:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:13:27 user nova-compute[73469]: INFO nova.compute.manager [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Took 5.82 seconds to spawn the instance on the hypervisor.
Aug 22 03:13:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:13:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:27 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:13:27 user nova-compute[73469]: INFO nova.compute.manager [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Took 6.60 seconds to build instance.
Aug 22 03:13:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4dcee7a5-4195-4552-9b57-fa9ece9005f5 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Lock "c2497d75-a68e-44ed-9f12-efb73b933bf3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.698s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:30 user nova-compute[73469]: DEBUG nova.compute.manager [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:13:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:30 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:13:30 user nova-compute[73469]: INFO nova.compute.claims [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Claim successful on node user
Aug 22 03:13:31 user nova-compute[73469]: DEBUG nova.compute.manager [req-23e8c2a0-2077-4308-a9be-a6824884ab80 req-de7b92ed-14b8-415c-a636-75a8418acb1b service nova] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Received event network-vif-plugged-ccee7d66-b060-4ba1-9c0a-e17a25a7bd07 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-23e8c2a0-2077-4308-a9be-a6824884ab80 req-de7b92ed-14b8-415c-a636-75a8418acb1b service nova] Acquiring lock "c2497d75-a68e-44ed-9f12-efb73b933bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-23e8c2a0-2077-4308-a9be-a6824884ab80 req-de7b92ed-14b8-415c-a636-75a8418acb1b service nova] Lock "c2497d75-a68e-44ed-9f12-efb73b933bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-23e8c2a0-2077-4308-a9be-a6824884ab80 req-de7b92ed-14b8-415c-a636-75a8418acb1b service nova] Lock "c2497d75-a68e-44ed-9f12-efb73b933bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG nova.compute.manager [req-23e8c2a0-2077-4308-a9be-a6824884ab80 req-de7b92ed-14b8-415c-a636-75a8418acb1b service nova] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] No waiting events found dispatching network-vif-plugged-ccee7d66-b060-4ba1-9c0a-e17a25a7bd07 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:13:31 user nova-compute[73469]: WARNING nova.compute.manager [req-23e8c2a0-2077-4308-a9be-a6824884ab80 req-de7b92ed-14b8-415c-a636-75a8418acb1b service nova] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Received unexpected event network-vif-plugged-ccee7d66-b060-4ba1-9c0a-e17a25a7bd07 for instance with vm_state active and task_state None.
Aug 22 03:13:31 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG nova.network.neutron [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:13:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:13:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG nova.policy [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd28ae61412174d8eb44ce47db982482b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d94885e479743cfa031cb6d9ecff20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:13:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Creating image(s)
Aug 22 03:13:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "/opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "/opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.190s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.256s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk 1073741824" returned: 0 in 0.058s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.186s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:32 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:13:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:32 user nova-compute[73469]: DEBUG nova.network.neutron [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Successfully created port: e7947445-5f12-4c43-a8c4-21c202aa5c99 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:13:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:32 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Cannot resize image /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:13:32 user nova-compute[73469]: DEBUG nova.objects.instance [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lazy-loading 'migration_context' on Instance uuid a0e6ef45-c52c-4b08-8541-24375cf34af1 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:13:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:13:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Ensure instance console log exists: /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:13:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-659ba090-3c31-422a-a9c0-296f11f89ee7 req-eeaf54f7-8b3a-4152-9c4f-c8de8ad8aae0 service nova] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Received event network-vif-plugged-ccee7d66-b060-4ba1-9c0a-e17a25a7bd07 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-659ba090-3c31-422a-a9c0-296f11f89ee7 req-eeaf54f7-8b3a-4152-9c4f-c8de8ad8aae0 service nova] Acquiring lock "c2497d75-a68e-44ed-9f12-efb73b933bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-659ba090-3c31-422a-a9c0-296f11f89ee7 req-eeaf54f7-8b3a-4152-9c4f-c8de8ad8aae0 service nova] Lock "c2497d75-a68e-44ed-9f12-efb73b933bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-659ba090-3c31-422a-a9c0-296f11f89ee7 req-eeaf54f7-8b3a-4152-9c4f-c8de8ad8aae0 service nova] Lock "c2497d75-a68e-44ed-9f12-efb73b933bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-659ba090-3c31-422a-a9c0-296f11f89ee7 req-eeaf54f7-8b3a-4152-9c4f-c8de8ad8aae0 service nova] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] No waiting events found dispatching network-vif-plugged-ccee7d66-b060-4ba1-9c0a-e17a25a7bd07 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:13:33 user nova-compute[73469]: WARNING nova.compute.manager [req-659ba090-3c31-422a-a9c0-296f11f89ee7 req-eeaf54f7-8b3a-4152-9c4f-c8de8ad8aae0 service nova] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Received unexpected event network-vif-plugged-ccee7d66-b060-4ba1-9c0a-e17a25a7bd07 for instance with vm_state active and task_state None.
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.network.neutron [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Successfully updated port: e7947445-5f12-4c43-a8c4-21c202aa5c99 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "refresh_cache-a0e6ef45-c52c-4b08-8541-24375cf34af1" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquired lock "refresh_cache-a0e6ef45-c52c-4b08-8541-24375cf34af1" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.network.neutron [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-53915169-ac94-44ae-a84f-c859a498cf35 req-8fb58b1e-fc96-4f7a-8804-04f0d935a14a service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Received event network-changed-e7947445-5f12-4c43-a8c4-21c202aa5c99 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-53915169-ac94-44ae-a84f-c859a498cf35 req-8fb58b1e-fc96-4f7a-8804-04f0d935a14a service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Refreshing instance network info cache due to event network-changed-e7947445-5f12-4c43-a8c4-21c202aa5c99. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-53915169-ac94-44ae-a84f-c859a498cf35 req-8fb58b1e-fc96-4f7a-8804-04f0d935a14a service nova] Acquiring lock "refresh_cache-a0e6ef45-c52c-4b08-8541-24375cf34af1" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.network.neutron [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.network.neutron [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Updating instance_info_cache with network_info: [{"id": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "address": "fa:16:3e:da:f7:e9", "network": {"id": "eb8cebc6-eef2-44f3-8cd2-de7239131b70", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1082345691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d94885e479743cfa031cb6d9ecff20d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947445-5f", "ovs_interfaceid": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Releasing lock "refresh_cache-a0e6ef45-c52c-4b08-8541-24375cf34af1" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.compute.manager [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Instance network_info: |[{"id": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "address": "fa:16:3e:da:f7:e9", "network": {"id": "eb8cebc6-eef2-44f3-8cd2-de7239131b70", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1082345691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d94885e479743cfa031cb6d9ecff20d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947445-5f", "ovs_interfaceid": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-53915169-ac94-44ae-a84f-c859a498cf35 req-8fb58b1e-fc96-4f7a-8804-04f0d935a14a service nova] Acquired lock "refresh_cache-a0e6ef45-c52c-4b08-8541-24375cf34af1" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.network.neutron [req-53915169-ac94-44ae-a84f-c859a498cf35 req-8fb58b1e-fc96-4f7a-8804-04f0d935a14a service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Refreshing network info cache for port e7947445-5f12-4c43-a8c4-21c202aa5c99 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Start _get_guest_xml network_info=[{"id": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "address": "fa:16:3e:da:f7:e9", "network": {"id": "eb8cebc6-eef2-44f3-8cd2-de7239131b70", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1082345691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d94885e479743cfa031cb6d9ecff20d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947445-5f", "ovs_interfaceid": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:13:33 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:13:33 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:13:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-257607089',display_name='tempest-TestServerVolumeAttachmentScenario-server-257607089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-257607089',id=38,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKp3HPhvMrkpv+qCjNg2ZHrujFsFAXzrDT/zGAD5/Sjj6zbsN8iQYXHMVoqwSZ2FfPB/IGvs8jhN89Id+Dve9v2c8X6Syow+l5t5+IoBEOnaZTUf2IPTwC22xfLj1FyFbA==',key_name='tempest-keypair-1015068162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d94885e479743cfa031cb6d9ecff20d',ramdisk_id='',reservation_id='r-jdpur6ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-899685905',owner_user_name='tempest-TestServerVolumeAttachmentScenario-899685905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:13:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d28ae61412174d8eb44ce47db982482b',uuid=a0e6ef45-c52c-4b08-8541-24375cf34af1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "address": "fa:16:3e:da:f7:e9", "network": {"id": "eb8cebc6-eef2-44f3-8cd2-de7239131b70", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1082345691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d94885e479743cfa031cb6d9ecff20d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947445-5f", "ovs_interfaceid": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Converting VIF {"id": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "address": "fa:16:3e:da:f7:e9", "network": {"id": "eb8cebc6-eef2-44f3-8cd2-de7239131b70", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1082345691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d94885e479743cfa031cb6d9ecff20d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947445-5f", "ovs_interfaceid": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:e9,bridge_name='br-int',has_traffic_filtering=True,id=e7947445-5f12-4c43-a8c4-21c202aa5c99,network=Network(eb8cebc6-eef2-44f3-8cd2-de7239131b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7947445-5f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.objects.instance [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lazy-loading 'pci_devices' on Instance uuid a0e6ef45-c52c-4b08-8541-24375cf34af1 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:13:33 user nova-compute[73469]:   <uuid>a0e6ef45-c52c-4b08-8541-24375cf34af1</uuid>
Aug 22 03:13:33 user nova-compute[73469]:   <name>instance-00000026</name>
Aug 22 03:13:33 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:13:33 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:13:33 user nova-compute[73469]:   <metadata>
Aug 22 03:13:33 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:13:33 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:13:33 user nova-compute[73469]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-257607089</nova:name>
Aug 22 03:13:33 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:13:33</nova:creationTime>
Aug 22 03:13:33 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:13:33 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:13:33 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:13:33 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:13:33 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:13:33 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:13:33 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:13:33 user nova-compute[73469]:       <nova:owner>
Aug 22 03:13:33 user nova-compute[73469]:         <nova:user uuid="d28ae61412174d8eb44ce47db982482b">tempest-TestServerVolumeAttachmentScenario-899685905-project-member</nova:user>
Aug 22 03:13:33 user nova-compute[73469]:         <nova:project uuid="7d94885e479743cfa031cb6d9ecff20d">tempest-TestServerVolumeAttachmentScenario-899685905</nova:project>
Aug 22 03:13:33 user nova-compute[73469]:       </nova:owner>
Aug 22 03:13:33 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:13:33 user nova-compute[73469]:       <nova:ports>
Aug 22 03:13:33 user nova-compute[73469]:         <nova:port uuid="e7947445-5f12-4c43-a8c4-21c202aa5c99">
Aug 22 03:13:33 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 22 03:13:33 user nova-compute[73469]:         </nova:port>
Aug 22 03:13:33 user nova-compute[73469]:       </nova:ports>
Aug 22 03:13:33 user nova-compute[73469]:     </nova:instance>
Aug 22 03:13:33 user nova-compute[73469]:   </metadata>
Aug 22 03:13:33 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:13:33 user nova-compute[73469]:     <system>
Aug 22 03:13:33 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:13:33 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:13:33 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:13:33 user nova-compute[73469]:       <entry name="serial">a0e6ef45-c52c-4b08-8541-24375cf34af1</entry>
Aug 22 03:13:33 user nova-compute[73469]:       <entry name="uuid">a0e6ef45-c52c-4b08-8541-24375cf34af1</entry>
Aug 22 03:13:33 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:13:33 user nova-compute[73469]:     </system>
Aug 22 03:13:33 user nova-compute[73469]:   </sysinfo>
Aug 22 03:13:33 user nova-compute[73469]:   <os>
Aug 22 03:13:33 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:13:33 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:13:33 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:13:33 user nova-compute[73469]:   </os>
Aug 22 03:13:33 user nova-compute[73469]:   <features>
Aug 22 03:13:33 user nova-compute[73469]:     <acpi/>
Aug 22 03:13:33 user nova-compute[73469]:     <apic/>
Aug 22 03:13:33 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:13:33 user nova-compute[73469]:   </features>
Aug 22 03:13:33 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:13:33 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:13:33 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:13:33 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:13:33 user nova-compute[73469]:   </clock>
Aug 22 03:13:33 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:13:33 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:13:33 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:13:33 user nova-compute[73469]:   </cpu>
Aug 22 03:13:33 user nova-compute[73469]:   <devices>
Aug 22 03:13:33 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:13:33 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:13:33 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk"/>
Aug 22 03:13:33 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:13:33 user nova-compute[73469]:     </disk>
Aug 22 03:13:33 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:13:33 user nova-compute[73469]:       <mac address="fa:16:3e:da:f7:e9"/>
Aug 22 03:13:33 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:13:33 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:13:33 user nova-compute[73469]:       <target dev="tape7947445-5f"/>
Aug 22 03:13:33 user nova-compute[73469]:     </interface>
Aug 22 03:13:33 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:13:33 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/console.log" append="off"/>
Aug 22 03:13:33 user nova-compute[73469]:     </serial>
Aug 22 03:13:33 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:13:33 user nova-compute[73469]:     <video>
Aug 22 03:13:33 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:13:33 user nova-compute[73469]:     </video>
Aug 22 03:13:33 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:13:33 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:13:33 user nova-compute[73469]:     </rng>
Aug 22 03:13:33 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:13:33 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:13:33 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:13:33 user nova-compute[73469]:     </memballoon>
Aug 22 03:13:33 user nova-compute[73469]:   </devices>
Aug 22 03:13:33 user nova-compute[73469]: </domain>
Aug 22 03:13:33 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:13:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-257607089',display_name='tempest-TestServerVolumeAttachmentScenario-server-257607089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-257607089',id=38,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKp3HPhvMrkpv+qCjNg2ZHrujFsFAXzrDT/zGAD5/Sjj6zbsN8iQYXHMVoqwSZ2FfPB/IGvs8jhN89Id+Dve9v2c8X6Syow+l5t5+IoBEOnaZTUf2IPTwC22xfLj1FyFbA==',key_name='tempest-keypair-1015068162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d94885e479743cfa031cb6d9ecff20d',ramdisk_id='',reservation_id='r-jdpur6ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-899685905',owner_user_name='tempest-TestServerVolumeAttachmentScenario-899685905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:13:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d28ae61412174d8eb44ce47db982482b',uuid=a0e6ef45-c52c-4b08-8541-24375cf34af1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "address": "fa:16:3e:da:f7:e9", "network": {"id": "eb8cebc6-eef2-44f3-8cd2-de7239131b70", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1082345691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d94885e479743cfa031cb6d9ecff20d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947445-5f", "ovs_interfaceid": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Converting VIF {"id": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "address": "fa:16:3e:da:f7:e9", "network": {"id": "eb8cebc6-eef2-44f3-8cd2-de7239131b70", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1082345691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d94885e479743cfa031cb6d9ecff20d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947445-5f", "ovs_interfaceid": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:e9,bridge_name='br-int',has_traffic_filtering=True,id=e7947445-5f12-4c43-a8c4-21c202aa5c99,network=Network(eb8cebc6-eef2-44f3-8cd2-de7239131b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7947445-5f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG os_vif [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:e9,bridge_name='br-int',has_traffic_filtering=True,id=e7947445-5f12-4c43-a8c4-21c202aa5c99,network=Network(eb8cebc6-eef2-44f3-8cd2-de7239131b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7947445-5f') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7947445-5f, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7947445-5f, col_values=(('external_ids', {'iface-id': 'e7947445-5f12-4c43-a8c4-21c202aa5c99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:f7:e9', 'vm-uuid': 'a0e6ef45-c52c-4b08-8541-24375cf34af1'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:33 user nova-compute[73469]: INFO os_vif [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:f7:e9,bridge_name='br-int',has_traffic_filtering=True,id=e7947445-5f12-4c43-a8c4-21c202aa5c99,network=Network(eb8cebc6-eef2-44f3-8cd2-de7239131b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7947445-5f')
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:13:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] No VIF found with MAC fa:16:3e:da:f7:e9, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:13:34 user nova-compute[73469]: DEBUG nova.network.neutron [req-53915169-ac94-44ae-a84f-c859a498cf35 req-8fb58b1e-fc96-4f7a-8804-04f0d935a14a service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Updated VIF entry in instance network info cache for port e7947445-5f12-4c43-a8c4-21c202aa5c99. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:13:34 user nova-compute[73469]: DEBUG nova.network.neutron [req-53915169-ac94-44ae-a84f-c859a498cf35 req-8fb58b1e-fc96-4f7a-8804-04f0d935a14a service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Updating instance_info_cache with network_info: [{"id": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "address": "fa:16:3e:da:f7:e9", "network": {"id": "eb8cebc6-eef2-44f3-8cd2-de7239131b70", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1082345691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d94885e479743cfa031cb6d9ecff20d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947445-5f", "ovs_interfaceid": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:13:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-53915169-ac94-44ae-a84f-c859a498cf35 req-8fb58b1e-fc96-4f7a-8804-04f0d935a14a service nova] Releasing lock "refresh_cache-a0e6ef45-c52c-4b08-8541-24375cf34af1" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:13:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "228b721b-c7c4-4994-b1be-28234ea6a4fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "228b721b-c7c4-4994-b1be-28234ea6a4fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:35 user nova-compute[73469]: INFO nova.compute.manager [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Terminating instance
Aug 22 03:13:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-eda59e0c-55d9-488a-8e1d-2cd84699c5a5 req-766090d9-a7f5-43f0-8d33-0fe910a65cc0 service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Received event network-vif-plugged-e7947445-5f12-4c43-a8c4-21c202aa5c99 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-eda59e0c-55d9-488a-8e1d-2cd84699c5a5 req-766090d9-a7f5-43f0-8d33-0fe910a65cc0 service nova] Acquiring lock "a0e6ef45-c52c-4b08-8541-24375cf34af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-eda59e0c-55d9-488a-8e1d-2cd84699c5a5 req-766090d9-a7f5-43f0-8d33-0fe910a65cc0 service nova] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-eda59e0c-55d9-488a-8e1d-2cd84699c5a5 req-766090d9-a7f5-43f0-8d33-0fe910a65cc0 service nova] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-eda59e0c-55d9-488a-8e1d-2cd84699c5a5 req-766090d9-a7f5-43f0-8d33-0fe910a65cc0 service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] No waiting events found dispatching network-vif-plugged-e7947445-5f12-4c43-a8c4-21c202aa5c99 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:13:35 user nova-compute[73469]: WARNING nova.compute.manager [req-eda59e0c-55d9-488a-8e1d-2cd84699c5a5 req-766090d9-a7f5-43f0-8d33-0fe910a65cc0 service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Received unexpected event network-vif-plugged-e7947445-5f12-4c43-a8c4-21c202aa5c99 for instance with vm_state building and task_state spawning.
Aug 22 03:13:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-f9abba93-c615-44b3-a812-36bd4e5a91f5 req-56e4f4f8-3a31-4953-b1e7-aa167e56bb40 service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Received event network-vif-unplugged-3f62a12a-6902-4a55-986f-728b46db9fb7 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f9abba93-c615-44b3-a812-36bd4e5a91f5 req-56e4f4f8-3a31-4953-b1e7-aa167e56bb40 service nova] Acquiring lock "228b721b-c7c4-4994-b1be-28234ea6a4fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f9abba93-c615-44b3-a812-36bd4e5a91f5 req-56e4f4f8-3a31-4953-b1e7-aa167e56bb40 service nova] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f9abba93-c615-44b3-a812-36bd4e5a91f5 req-56e4f4f8-3a31-4953-b1e7-aa167e56bb40 service nova] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-f9abba93-c615-44b3-a812-36bd4e5a91f5 req-56e4f4f8-3a31-4953-b1e7-aa167e56bb40 service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] No waiting events found dispatching network-vif-unplugged-3f62a12a-6902-4a55-986f-728b46db9fb7 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-f9abba93-c615-44b3-a812-36bd4e5a91f5 req-56e4f4f8-3a31-4953-b1e7-aa167e56bb40 service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Received event network-vif-unplugged-3f62a12a-6902-4a55-986f-728b46db9fb7 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:35 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Instance destroyed successfully.
Aug 22 03:13:35 user nova-compute[73469]: DEBUG nova.objects.instance [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'resources' on Instance uuid 228b721b-c7c4-4994-b1be-28234ea6a4fd {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1784410935',display_name='tempest-AttachVolumeNegativeTest-server-1784410935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1784410935',id=32,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbDdTYLqgIDj5qdnoVp64T6l6UgZkGmzuOJatV+bzm+O/Qd3dLAgzzy3ThnPfbcpJNAmvN0QBxTVXnO9i7z8hK/LV1zO2rBmqahIX5FXxkNTotOYk2mci8ENWvZxXcDcw==',key_name='tempest-keypair-615365274',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:07:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab150042073d4977b15414a3062d82fd',ramdisk_id='',reservation_id='r-q18miie2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-356032718',owner_user_name='tempest-AttachVolumeNegativeTest-356032718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:07:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25b830ec1451440f911d6578c8c55f3d',uuid=228b721b-c7c4-4994-b1be-28234ea6a4fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f62a12a-6902-4a55-986f-728b46db9fb7", "address": "fa:16:3e:de:94:8a", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f62a12a-69", "ovs_interfaceid": "3f62a12a-6902-4a55-986f-728b46db9fb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converting VIF {"id": "3f62a12a-6902-4a55-986f-728b46db9fb7", "address": "fa:16:3e:de:94:8a", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f62a12a-69", "ovs_interfaceid": "3f62a12a-6902-4a55-986f-728b46db9fb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:94:8a,bridge_name='br-int',has_traffic_filtering=True,id=3f62a12a-6902-4a55-986f-728b46db9fb7,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f62a12a-69') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG os_vif [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:94:8a,bridge_name='br-int',has_traffic_filtering=True,id=3f62a12a-6902-4a55-986f-728b46db9fb7,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f62a12a-69') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f62a12a-69, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:13:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:35 user nova-compute[73469]: INFO os_vif [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:94:8a,bridge_name='br-int',has_traffic_filtering=True,id=3f62a12a-6902-4a55-986f-728b46db9fb7,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f62a12a-69')
Aug 22 03:13:35 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Deleting instance files /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd_del
Aug 22 03:13:35 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Deletion of /opt/stack/data/nova/instances/228b721b-c7c4-4994-b1be-28234ea6a4fd_del complete
Aug 22 03:13:36 user nova-compute[73469]: INFO nova.compute.manager [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 22 03:13:36 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:13:36 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:13:36 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:13:36 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:13:36 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Took 0.92 seconds to deallocate network for instance.
Aug 22 03:13:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.compute.manager [req-181c4487-aa14-4dd0-88c6-482ba6c075af req-f466fd32-c275-4ac6-b4be-042a9574c4fa service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Received event network-vif-plugged-e7947445-5f12-4c43-a8c4-21c202aa5c99 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-181c4487-aa14-4dd0-88c6-482ba6c075af req-f466fd32-c275-4ac6-b4be-042a9574c4fa service nova] Acquiring lock "a0e6ef45-c52c-4b08-8541-24375cf34af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-181c4487-aa14-4dd0-88c6-482ba6c075af req-f466fd32-c275-4ac6-b4be-042a9574c4fa service nova] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-181c4487-aa14-4dd0-88c6-482ba6c075af req-f466fd32-c275-4ac6-b4be-042a9574c4fa service nova] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.compute.manager [req-181c4487-aa14-4dd0-88c6-482ba6c075af req-f466fd32-c275-4ac6-b4be-042a9574c4fa service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] No waiting events found dispatching network-vif-plugged-e7947445-5f12-4c43-a8c4-21c202aa5c99 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:13:37 user nova-compute[73469]: WARNING nova.compute.manager [req-181c4487-aa14-4dd0-88c6-482ba6c075af req-f466fd32-c275-4ac6-b4be-042a9574c4fa service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Received unexpected event network-vif-plugged-e7947445-5f12-4c43-a8c4-21c202aa5c99 for instance with vm_state building and task_state spawning.
Aug 22 03:13:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:37 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Deleted allocations for instance 228b721b-c7c4-4994-b1be-28234ea6a4fd
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674017.3415594, a0e6ef45-c52c-4b08-8541-24375cf34af1 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:13:37 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] VM Resumed (Lifecycle Event)
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.compute.manager [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:13:37 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Instance spawned successfully.
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-87a3d582-46b6-4940-844d-ce28492c898a tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.344s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:37 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674017.3418915, a0e6ef45-c52c-4b08-8541-24375cf34af1 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:13:37 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] VM Started (Lifecycle Event)
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:13:37 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:13:37 user nova-compute[73469]: INFO nova.compute.manager [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Took 6.07 seconds to spawn the instance on the hypervisor.
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.compute.manager [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:13:37 user nova-compute[73469]: INFO nova.compute.manager [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Took 6.81 seconds to build instance.
Aug 22 03:13:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-76dbf1ba-3ebc-4d27-912f-224705a4e647 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.936s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.compute.manager [req-d0bfb2ba-de0d-446b-b33b-7e8d3c7feac6 req-16966772-ecdf-43e2-bee4-de2c33915750 service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Received event network-vif-plugged-3f62a12a-6902-4a55-986f-728b46db9fb7 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d0bfb2ba-de0d-446b-b33b-7e8d3c7feac6 req-16966772-ecdf-43e2-bee4-de2c33915750 service nova] Acquiring lock "228b721b-c7c4-4994-b1be-28234ea6a4fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d0bfb2ba-de0d-446b-b33b-7e8d3c7feac6 req-16966772-ecdf-43e2-bee4-de2c33915750 service nova] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d0bfb2ba-de0d-446b-b33b-7e8d3c7feac6 req-16966772-ecdf-43e2-bee4-de2c33915750 service nova] Lock "228b721b-c7c4-4994-b1be-28234ea6a4fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.compute.manager [req-d0bfb2ba-de0d-446b-b33b-7e8d3c7feac6 req-16966772-ecdf-43e2-bee4-de2c33915750 service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] No waiting events found dispatching network-vif-plugged-3f62a12a-6902-4a55-986f-728b46db9fb7 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:13:37 user nova-compute[73469]: WARNING nova.compute.manager [req-d0bfb2ba-de0d-446b-b33b-7e8d3c7feac6 req-16966772-ecdf-43e2-bee4-de2c33915750 service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Received unexpected event network-vif-plugged-3f62a12a-6902-4a55-986f-728b46db9fb7 for instance with vm_state deleted and task_state None.
Aug 22 03:13:37 user nova-compute[73469]: DEBUG nova.compute.manager [req-d0bfb2ba-de0d-446b-b33b-7e8d3c7feac6 req-16966772-ecdf-43e2-bee4-de2c33915750 service nova] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Received event network-vif-deleted-3f62a12a-6902-4a55-986f-728b46db9fb7 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:13:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:47 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:13:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:50 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:13:50 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692674015.9033396, 228b721b-c7c4-4994-b1be-28234ea6a4fd => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:13:50 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] VM Stopped (Lifecycle Event)
Aug 22 03:13:50 user nova-compute[73469]: DEBUG nova.compute.manager [None req-f9a8cd16-9d9c-4751-b253-0afcab988726 None None] [instance: 228b721b-c7c4-4994-b1be-28234ea6a4fd] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:13:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:51 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:13:52 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:13:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:53 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:13:54 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:13:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:13:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:13:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:13:54 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:13:55 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Updating instance_info_cache with network_info: [{"id": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "address": "fa:16:3e:0d:d7:78", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ca747b-f8", "ovs_interfaceid": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:13:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:13:55 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:13:55 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:13:55 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:13:55 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:13:55 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:13:55 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 22 03:13:55 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] There are 0 instances to clean {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 22 03:13:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:56 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:13:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:13:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:13:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:13:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:13:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:13:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:13:58 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:13:58 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:13:58 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=7726MB free_disk=25.171676635742188GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:13:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:13:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:13:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Applying migration context for instance 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 as it has an incoming, in-progress migration 8fd81ceb-7ba4-44b9-8cbb-d8724dab588b. Migration status is finished {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 22 03:13:59 user nova-compute[73469]: INFO nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Updating resource usage from migration 8fd81ceb-7ba4-44b9-8cbb-d8724dab588b
Aug 22 03:13:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82e872a7-70b0-4290-9a11-5316765aed01 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:13:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a7e95a46-9a75-4b0c-a5c9-42ed521668a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:13:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 1189d718-45af-415f-bbf9-56093977b0c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:13:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Migration 8fd81ceb-7ba4-44b9-8cbb-d8724dab588b is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 22 03:13:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:13:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance c2497d75-a68e-44ed-9f12-efb73b933bf3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:13:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a0e6ef45-c52c-4b08-8541-24375cf34af1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:13:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:13:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:13:59 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:13:59 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:13:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:13:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:14:00 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:14:00 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:14:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 22 03:14:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-a4d4d412-e893-4a90-9b45-ad1be95ead3b req-ce87ca52-9c39-4694-8a74-d95a7d084edb service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Received event network-changed-11b72dfc-679a-4db6-97a0-1bf25884e4d2 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-a4d4d412-e893-4a90-9b45-ad1be95ead3b req-ce87ca52-9c39-4694-8a74-d95a7d084edb service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Refreshing instance network info cache due to event network-changed-11b72dfc-679a-4db6-97a0-1bf25884e4d2. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a4d4d412-e893-4a90-9b45-ad1be95ead3b req-ce87ca52-9c39-4694-8a74-d95a7d084edb service nova] Acquiring lock "refresh_cache-1189d718-45af-415f-bbf9-56093977b0c4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a4d4d412-e893-4a90-9b45-ad1be95ead3b req-ce87ca52-9c39-4694-8a74-d95a7d084edb service nova] Acquired lock "refresh_cache-1189d718-45af-415f-bbf9-56093977b0c4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG nova.network.neutron [req-a4d4d412-e893-4a90-9b45-ad1be95ead3b req-ce87ca52-9c39-4694-8a74-d95a7d084edb service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Refreshing network info cache for port 11b72dfc-679a-4db6-97a0-1bf25884e4d2 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "1189d718-45af-415f-bbf9-56093977b0c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1189d718-45af-415f-bbf9-56093977b0c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG nova.objects.instance [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lazy-loading 'flavor' on Instance uuid 1189d718-45af-415f-bbf9-56093977b0c4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:14:16 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Ignoring supplied device name: /dev/vdb
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1189d718-45af-415f-bbf9-56093977b0c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "1189d718-45af-415f-bbf9-56093977b0c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1189d718-45af-415f-bbf9-56093977b0c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:14:16 user nova-compute[73469]: INFO nova.compute.manager [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Attaching volume f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 to /dev/vdb
Aug 22 03:14:16 user nova-compute[73469]: DEBUG os_brick.utils [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffe8a15-3aa4-4b47-b195-184ea4bb04cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf72693-f720-4f96-b931-183e23a160e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG nova.network.neutron [req-a4d4d412-e893-4a90-9b45-ad1be95ead3b req-ce87ca52-9c39-4694-8a74-d95a7d084edb service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Updated VIF entry in instance network info cache for port 11b72dfc-679a-4db6-97a0-1bf25884e4d2. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG nova.network.neutron [req-a4d4d412-e893-4a90-9b45-ad1be95ead3b req-ce87ca52-9c39-4694-8a74-d95a7d084edb service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Updating instance_info_cache with network_info: [{"id": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "address": "fa:16:3e:d8:2e:37", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b72dfc-67", "ovs_interfaceid": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[af030085-f2be-4689-b194-16f0dff5f4bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25a231f-519b-4179-b361-cb8c8a75c695]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a4d4d412-e893-4a90-9b45-ad1be95ead3b req-ce87ca52-9c39-4694-8a74-d95a7d084edb service nova] Releasing lock "refresh_cache-1189d718-45af-415f-bbf9-56093977b0c4" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:14:16 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:14:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[504647b3-3cdb-4e37-96a6-01242e0afc10]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG os_brick.utils [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:14:16 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Updating existing volume attachment record: 089702b9-b7d6-4875-acb5-37f76fc4132c {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:14:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2627334-179d-4999-b24f-9e18b3983263 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:14:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2627334-179d-4999-b24f-9e18b3983263 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:14:20 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b2627334-179d-4999-b24f-9e18b3983263 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Going to confirm migration 2 {{(pid=73469) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 22 03:14:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2627334-179d-4999-b24f-9e18b3983263 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:14:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2627334-179d-4999-b24f-9e18b3983263 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquired lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:14:21 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b2627334-179d-4999-b24f-9e18b3983263 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:14:21 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b2627334-179d-4999-b24f-9e18b3983263 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'info_cache' on Instance uuid 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:14:21 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b2627334-179d-4999-b24f-9e18b3983263 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Updating instance_info_cache with network_info: [{"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:14:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2627334-179d-4999-b24f-9e18b3983263 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Releasing lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:14:21 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b2627334-179d-4999-b24f-9e18b3983263 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'migration_context' on Instance uuid 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:14:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2627334-179d-4999-b24f-9e18b3983263 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:14:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2627334-179d-4999-b24f-9e18b3983263 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:14:22 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-b2627334-179d-4999-b24f-9e18b3983263 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:14:22 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-b2627334-179d-4999-b24f-9e18b3983263 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:14:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2627334-179d-4999-b24f-9e18b3983263 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.315s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:14:22 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-b2627334-179d-4999-b24f-9e18b3983263 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Deleted allocation for migration 8fd81ceb-7ba4-44b9-8cbb-d8724dab588b
Aug 22 03:14:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2627334-179d-4999-b24f-9e18b3983263 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.526s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:14:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:14:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:14:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:14:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:14:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:14:29 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:14:29 user nova-compute[73469]: INFO nova.compute.claims [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Claim successful on node user
Aug 22 03:14:29 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:14:29 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:14:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:14:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:14:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:14:29 user nova-compute[73469]: DEBUG nova.network.neutron [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:14:29 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:14:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:14:29 user nova-compute[73469]: DEBUG nova.policy [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25b830ec1451440f911d6578c8c55f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab150042073d4977b15414a3062d82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:14:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:14:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:14:29 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Creating image(s)
Aug 22 03:14:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "/opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:14:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "/opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:14:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "/opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:14:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.202s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.216s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk 1073741824" returned: 0 in 0.063s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.214s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG nova.network.neutron [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Successfully created port: 6063bed8-22e5-4bf6-bcde-7628261ffd68 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Cannot resize image /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG nova.objects.instance [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'migration_context' on Instance uuid 2aa3779f-687f-414a-a31a-5e0f0b6a882f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Ensure instance console log exists: /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:14:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:14:31 user nova-compute[73469]: DEBUG nova.network.neutron [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Successfully updated port: 6063bed8-22e5-4bf6-bcde-7628261ffd68 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:14:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "refresh_cache-2aa3779f-687f-414a-a31a-5e0f0b6a882f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:14:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquired lock "refresh_cache-2aa3779f-687f-414a-a31a-5e0f0b6a882f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:14:31 user nova-compute[73469]: DEBUG nova.network.neutron [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:14:31 user nova-compute[73469]: DEBUG nova.compute.manager [req-bf67c800-13c7-4df0-a169-69351ba7e339 req-785a3756-cc30-4a1e-bce5-4d00136a5fd1 service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Received event network-changed-6063bed8-22e5-4bf6-bcde-7628261ffd68 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:14:31 user nova-compute[73469]: DEBUG nova.compute.manager [req-bf67c800-13c7-4df0-a169-69351ba7e339 req-785a3756-cc30-4a1e-bce5-4d00136a5fd1 service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Refreshing instance network info cache due to event network-changed-6063bed8-22e5-4bf6-bcde-7628261ffd68. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:14:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bf67c800-13c7-4df0-a169-69351ba7e339 req-785a3756-cc30-4a1e-bce5-4d00136a5fd1 service nova] Acquiring lock "refresh_cache-2aa3779f-687f-414a-a31a-5e0f0b6a882f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:14:31 user nova-compute[73469]: DEBUG nova.network.neutron [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:14:31 user nova-compute[73469]: DEBUG nova.network.neutron [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Updating instance_info_cache with network_info: [{"id": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "address": "fa:16:3e:4b:ed:38", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063bed8-22", "ovs_interfaceid": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:14:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Releasing lock "refresh_cache-2aa3779f-687f-414a-a31a-5e0f0b6a882f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:14:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Instance network_info: |[{"id": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "address": "fa:16:3e:4b:ed:38", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063bed8-22", "ovs_interfaceid": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:14:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bf67c800-13c7-4df0-a169-69351ba7e339 req-785a3756-cc30-4a1e-bce5-4d00136a5fd1 service nova] Acquired lock "refresh_cache-2aa3779f-687f-414a-a31a-5e0f0b6a882f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:14:31 user nova-compute[73469]: DEBUG nova.network.neutron [req-bf67c800-13c7-4df0-a169-69351ba7e339 req-785a3756-cc30-4a1e-bce5-4d00136a5fd1 service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Refreshing network info cache for port 6063bed8-22e5-4bf6-bcde-7628261ffd68 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:14:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Start _get_guest_xml network_info=[{"id": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "address": "fa:16:3e:4b:ed:38", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063bed8-22", "ovs_interfaceid": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:14:31 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:14:31 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2061992407',display_name='tempest-AttachVolumeNegativeTest-server-2061992407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2061992407',id=39,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLC7d912/654chy+SUQJV4TiT2m//pIOzUjAv6mEl83v8BJRMNuQeYSNnYiT6SOq/Y2qMG14kzxZktrsp5PRfWWh8uFFEzWcBKVnHGcqg5/vEmdRsbrOB0QBtXa/+HGFKg==',key_name='tempest-keypair-1058505087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab150042073d4977b15414a3062d82fd',ramdisk_id='',reservation_id='r-qovfy0v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-356032718',owner_user_name='tempest-AttachVolumeNegativeTest-356032718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25b830ec1451440f911d6578c8c55f3d',uuid=2aa3779f-687f-414a-a31a-5e0f0b6a882f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "address": "fa:16:3e:4b:ed:38", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063bed8-22", "ovs_interfaceid": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converting VIF {"id": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "address": "fa:16:3e:4b:ed:38", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063bed8-22", "ovs_interfaceid": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ed:38,bridge_name='br-int',has_traffic_filtering=True,id=6063bed8-22e5-4bf6-bcde-7628261ffd68,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6063bed8-22') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.objects.instance [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'pci_devices' on Instance uuid 2aa3779f-687f-414a-a31a-5e0f0b6a882f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:14:32 user nova-compute[73469]:   <uuid>2aa3779f-687f-414a-a31a-5e0f0b6a882f</uuid>
Aug 22 03:14:32 user nova-compute[73469]:   <name>instance-00000027</name>
Aug 22 03:14:32 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:14:32 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:14:32 user nova-compute[73469]:   <metadata>
Aug 22 03:14:32 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:14:32 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:14:32 user nova-compute[73469]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2061992407</nova:name>
Aug 22 03:14:32 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:14:31</nova:creationTime>
Aug 22 03:14:32 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:14:32 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:14:32 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:14:32 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:14:32 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:14:32 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:14:32 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:14:32 user nova-compute[73469]:       <nova:owner>
Aug 22 03:14:32 user nova-compute[73469]:         <nova:user uuid="25b830ec1451440f911d6578c8c55f3d">tempest-AttachVolumeNegativeTest-356032718-project-member</nova:user>
Aug 22 03:14:32 user nova-compute[73469]:         <nova:project uuid="ab150042073d4977b15414a3062d82fd">tempest-AttachVolumeNegativeTest-356032718</nova:project>
Aug 22 03:14:32 user nova-compute[73469]:       </nova:owner>
Aug 22 03:14:32 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:14:32 user nova-compute[73469]:       <nova:ports>
Aug 22 03:14:32 user nova-compute[73469]:         <nova:port uuid="6063bed8-22e5-4bf6-bcde-7628261ffd68">
Aug 22 03:14:32 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 22 03:14:32 user nova-compute[73469]:         </nova:port>
Aug 22 03:14:32 user nova-compute[73469]:       </nova:ports>
Aug 22 03:14:32 user nova-compute[73469]:     </nova:instance>
Aug 22 03:14:32 user nova-compute[73469]:   </metadata>
Aug 22 03:14:32 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:14:32 user nova-compute[73469]:     <system>
Aug 22 03:14:32 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:14:32 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:14:32 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:14:32 user nova-compute[73469]:       <entry name="serial">2aa3779f-687f-414a-a31a-5e0f0b6a882f</entry>
Aug 22 03:14:32 user nova-compute[73469]:       <entry name="uuid">2aa3779f-687f-414a-a31a-5e0f0b6a882f</entry>
Aug 22 03:14:32 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:14:32 user nova-compute[73469]:     </system>
Aug 22 03:14:32 user nova-compute[73469]:   </sysinfo>
Aug 22 03:14:32 user nova-compute[73469]:   <os>
Aug 22 03:14:32 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:14:32 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:14:32 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:14:32 user nova-compute[73469]:   </os>
Aug 22 03:14:32 user nova-compute[73469]:   <features>
Aug 22 03:14:32 user nova-compute[73469]:     <acpi/>
Aug 22 03:14:32 user nova-compute[73469]:     <apic/>
Aug 22 03:14:32 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:14:32 user nova-compute[73469]:   </features>
Aug 22 03:14:32 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:14:32 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:14:32 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:14:32 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:14:32 user nova-compute[73469]:   </clock>
Aug 22 03:14:32 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:14:32 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:14:32 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:14:32 user nova-compute[73469]:   </cpu>
Aug 22 03:14:32 user nova-compute[73469]:   <devices>
Aug 22 03:14:32 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:14:32 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:14:32 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk"/>
Aug 22 03:14:32 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:14:32 user nova-compute[73469]:     </disk>
Aug 22 03:14:32 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:14:32 user nova-compute[73469]:       <mac address="fa:16:3e:4b:ed:38"/>
Aug 22 03:14:32 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:14:32 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:14:32 user nova-compute[73469]:       <target dev="tap6063bed8-22"/>
Aug 22 03:14:32 user nova-compute[73469]:     </interface>
Aug 22 03:14:32 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:14:32 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/console.log" append="off"/>
Aug 22 03:14:32 user nova-compute[73469]:     </serial>
Aug 22 03:14:32 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:14:32 user nova-compute[73469]:     <video>
Aug 22 03:14:32 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:14:32 user nova-compute[73469]:     </video>
Aug 22 03:14:32 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:14:32 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:14:32 user nova-compute[73469]:     </rng>
Aug 22 03:14:32 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:14:32 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:14:32 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:14:32 user nova-compute[73469]:     </memballoon>
Aug 22 03:14:32 user nova-compute[73469]:   </devices>
Aug 22 03:14:32 user nova-compute[73469]: </domain>
Aug 22 03:14:32 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2061992407',display_name='tempest-AttachVolumeNegativeTest-server-2061992407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2061992407',id=39,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLC7d912/654chy+SUQJV4TiT2m//pIOzUjAv6mEl83v8BJRMNuQeYSNnYiT6SOq/Y2qMG14kzxZktrsp5PRfWWh8uFFEzWcBKVnHGcqg5/vEmdRsbrOB0QBtXa/+HGFKg==',key_name='tempest-keypair-1058505087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab150042073d4977b15414a3062d82fd',ramdisk_id='',reservation_id='r-qovfy0v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-356032718',owner_user_name='tempest-AttachVolumeNegativeTest-356032718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25b830ec1451440f911d6578c8c55f3d',uuid=2aa3779f-687f-414a-a31a-5e0f0b6a882f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "address": "fa:16:3e:4b:ed:38", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063bed8-22", "ovs_interfaceid": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converting VIF {"id": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "address": "fa:16:3e:4b:ed:38", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063bed8-22", "ovs_interfaceid": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ed:38,bridge_name='br-int',has_traffic_filtering=True,id=6063bed8-22e5-4bf6-bcde-7628261ffd68,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6063bed8-22') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG os_vif [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ed:38,bridge_name='br-int',has_traffic_filtering=True,id=6063bed8-22e5-4bf6-bcde-7628261ffd68,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6063bed8-22') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6063bed8-22, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6063bed8-22, col_values=(('external_ids', {'iface-id': '6063bed8-22e5-4bf6-bcde-7628261ffd68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:ed:38', 'vm-uuid': '2aa3779f-687f-414a-a31a-5e0f0b6a882f'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:32 user nova-compute[73469]: INFO os_vif [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ed:38,bridge_name='br-int',has_traffic_filtering=True,id=6063bed8-22e5-4bf6-bcde-7628261ffd68,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6063bed8-22')
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] No VIF found with MAC fa:16:3e:4b:ed:38, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.network.neutron [req-bf67c800-13c7-4df0-a169-69351ba7e339 req-785a3756-cc30-4a1e-bce5-4d00136a5fd1 service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Updated VIF entry in instance network info cache for port 6063bed8-22e5-4bf6-bcde-7628261ffd68. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG nova.network.neutron [req-bf67c800-13c7-4df0-a169-69351ba7e339 req-785a3756-cc30-4a1e-bce5-4d00136a5fd1 service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Updating instance_info_cache with network_info: [{"id": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "address": "fa:16:3e:4b:ed:38", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063bed8-22", "ovs_interfaceid": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:14:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bf67c800-13c7-4df0-a169-69351ba7e339 req-785a3756-cc30-4a1e-bce5-4d00136a5fd1 service nova] Releasing lock "refresh_cache-2aa3779f-687f-414a-a31a-5e0f0b6a882f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:14:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-f4a5f234-82bd-421f-80d4-b97933231ab9 req-a7d95d1a-1624-4932-972b-56ede99e01a5 service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Received event network-vif-plugged-6063bed8-22e5-4bf6-bcde-7628261ffd68 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:14:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f4a5f234-82bd-421f-80d4-b97933231ab9 req-a7d95d1a-1624-4932-972b-56ede99e01a5 service nova] Acquiring lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:14:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f4a5f234-82bd-421f-80d4-b97933231ab9 req-a7d95d1a-1624-4932-972b-56ede99e01a5 service nova] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:14:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f4a5f234-82bd-421f-80d4-b97933231ab9 req-a7d95d1a-1624-4932-972b-56ede99e01a5 service nova] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:14:33 user nova-compute[73469]: DEBUG nova.compute.manager [req-f4a5f234-82bd-421f-80d4-b97933231ab9 req-a7d95d1a-1624-4932-972b-56ede99e01a5 service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] No waiting events found dispatching network-vif-plugged-6063bed8-22e5-4bf6-bcde-7628261ffd68 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:14:33 user nova-compute[73469]: WARNING nova.compute.manager [req-f4a5f234-82bd-421f-80d4-b97933231ab9 req-a7d95d1a-1624-4932-972b-56ede99e01a5 service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Received unexpected event network-vif-plugged-6063bed8-22e5-4bf6-bcde-7628261ffd68 for instance with vm_state building and task_state spawning.
Aug 22 03:14:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:35 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674075.69887, 2aa3779f-687f-414a-a31a-5e0f0b6a882f => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:14:35 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] VM Resumed (Lifecycle Event)
Aug 22 03:14:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:14:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:14:35 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Instance spawned successfully.
Aug 22 03:14:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:14:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:14:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:14:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:14:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:14:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:14:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:14:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:14:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:14:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-dd0a20b9-7e66-4046-9946-335fec64af36 req-70904a61-a0d5-4da9-9639-ebbf9e10ecf0 service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Received event network-vif-plugged-6063bed8-22e5-4bf6-bcde-7628261ffd68 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:14:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dd0a20b9-7e66-4046-9946-335fec64af36 req-70904a61-a0d5-4da9-9639-ebbf9e10ecf0 service nova] Acquiring lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:14:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dd0a20b9-7e66-4046-9946-335fec64af36 req-70904a61-a0d5-4da9-9639-ebbf9e10ecf0 service nova] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:14:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dd0a20b9-7e66-4046-9946-335fec64af36 req-70904a61-a0d5-4da9-9639-ebbf9e10ecf0 service nova] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:14:35 user nova-compute[73469]: DEBUG nova.compute.manager [req-dd0a20b9-7e66-4046-9946-335fec64af36 req-70904a61-a0d5-4da9-9639-ebbf9e10ecf0 service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] No waiting events found dispatching network-vif-plugged-6063bed8-22e5-4bf6-bcde-7628261ffd68 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:14:35 user nova-compute[73469]: WARNING nova.compute.manager [req-dd0a20b9-7e66-4046-9946-335fec64af36 req-70904a61-a0d5-4da9-9639-ebbf9e10ecf0 service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Received unexpected event network-vif-plugged-6063bed8-22e5-4bf6-bcde-7628261ffd68 for instance with vm_state building and task_state spawning.
Aug 22 03:14:35 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:14:35 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674075.700722, 2aa3779f-687f-414a-a31a-5e0f0b6a882f => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:14:35 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] VM Started (Lifecycle Event)
Aug 22 03:14:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:14:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:14:35 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:14:35 user nova-compute[73469]: INFO nova.compute.manager [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Took 5.97 seconds to spawn the instance on the hypervisor.
Aug 22 03:14:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:14:35 user nova-compute[73469]: INFO nova.compute.manager [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Took 6.65 seconds to build instance.
Aug 22 03:14:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-715accf3-ae5c-47d1-982b-563bcde4760d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.804s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHOowpql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:14:36 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:14:36 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:14:36 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c4aabb-da6d-46b3-a01a-1e8060c602c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:14:36 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[14453694-415c-44aa-a208-704d096e01e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6] added
Aug 22 03:14:36 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7a4138-39f5-436c-a21a-15f8fb35eac6]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ed08fa-c7ab-4dca-a83f-aacb4d58e1a9]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nHOowpql {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nHOowpql" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dc4a06-25b4-46cd-8c54-326a1d5d9989]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nHOowpql'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5723bf0-a45c-4fac-967f-fea024b23294]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ed16e4-29cd-48a6-b258-dfb1b3084a8f]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:14:36 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:14:36 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4460e1-8c61-4bea-b462-30fa3ce0abcb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6, portal: 172.16.0.220,3260]
Aug 22 03:14:36 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6, portal: 172.16.0.220,3260] successful.
Aug 22 03:14:36 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed237c0-7af5-4e7e-83a1-061e5d591ae3]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e48bf4-58a6-4e4c-bd45-f9fb2486b9fa]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:14:36 user nova-compute[73469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 (non-flash)
Aug 22 03:14:36 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:14:36 user nova-compute[73469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 (non-flash)
Aug 22 03:14:36 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8ca0e1-9e8f-4dda-9397-9436cda90bec]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:14:36 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: None {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:14:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:37 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:14:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHOowpql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:14:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:14:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26335663233376661', 'path': '/dev/sdc'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:14:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335663233376661', 'path': '/dev/sdc'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:14:37 user nova-compute[73469]: DEBUG nova.objects.instance [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lazy-loading 'flavor' on Instance uuid 1189d718-45af-415f-bbf9-56093977b0c4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:14:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:14:37 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:14:37 user nova-compute[73469]:   <source dev="/dev/sdc"/>
Aug 22 03:14:37 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:14:37 user nova-compute[73469]:   <serial>f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6</serial>
Aug 22 03:14:37 user nova-compute[73469]: </disk>
Aug 22 03:14:37 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:14:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:14:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:14:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] No VIF found with MAC fa:16:3e:d8:2e:37, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:14:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-3c9b2d4f-f197-4311-a828-7c6ec420c1d3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1189d718-45af-415f-bbf9-56093977b0c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.386s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:14:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:14:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:50 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:14:51 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:14:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:53 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:14:53 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:14:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:55 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:14:55 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:14:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-a7e95a46-9a75-4b0c-a5c9-42ed521668a5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:14:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-a7e95a46-9a75-4b0c-a5c9-42ed521668a5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:14:55 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:14:55 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Updating instance_info_cache with network_info: [{"id": "026b74ec-ba11-459e-aa62-77923404317c", "address": "fa:16:3e:eb:a5:97", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026b74ec-ba", "ovs_interfaceid": "026b74ec-ba11-459e-aa62-77923404317c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:14:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-a7e95a46-9a75-4b0c-a5c9-42ed521668a5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:14:55 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:14:55 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:14:56 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:14:56 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:14:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:14:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:14:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:14:56 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:14:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:14:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:14:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:14:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:14:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:14:59 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:14:59 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:14:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=7695MB free_disk=25.132030487060547GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:14:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:14:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:14:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82e872a7-70b0-4290-9a11-5316765aed01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:14:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a7e95a46-9a75-4b0c-a5c9-42ed521668a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:14:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 1189d718-45af-415f-bbf9-56093977b0c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:14:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:14:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance c2497d75-a68e-44ed-9f12-efb73b933bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:14:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a0e6ef45-c52c-4b08-8541-24375cf34af1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:14:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 2aa3779f-687f-414a-a31a-5e0f0b6a882f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:14:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:14:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:14:59 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing inventories for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 22 03:15:00 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Updating ProviderTree inventory for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 22 03:15:00 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Updating inventory in ProviderTree for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 22 03:15:00 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing aggregate associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, aggregates: None {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 22 03:15:00 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing trait associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 22 03:15:00 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:15:00 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:15:00 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:15:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:01 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:15:01 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:15:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:15:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:15:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:15:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:15:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:15:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:15:22 user nova-compute[73469]: DEBUG nova.compute.manager [req-aa1463d3-a415-4585-b95f-1c2ff1047d3e req-a802d2f0-179e-4b9e-bc14-45066648e650 service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Received event network-changed-e7947445-5f12-4c43-a8c4-21c202aa5c99 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:15:22 user nova-compute[73469]: DEBUG nova.compute.manager [req-aa1463d3-a415-4585-b95f-1c2ff1047d3e req-a802d2f0-179e-4b9e-bc14-45066648e650 service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Refreshing instance network info cache due to event network-changed-e7947445-5f12-4c43-a8c4-21c202aa5c99. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:15:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-aa1463d3-a415-4585-b95f-1c2ff1047d3e req-a802d2f0-179e-4b9e-bc14-45066648e650 service nova] Acquiring lock "refresh_cache-a0e6ef45-c52c-4b08-8541-24375cf34af1" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:15:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-aa1463d3-a415-4585-b95f-1c2ff1047d3e req-a802d2f0-179e-4b9e-bc14-45066648e650 service nova] Acquired lock "refresh_cache-a0e6ef45-c52c-4b08-8541-24375cf34af1" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:15:22 user nova-compute[73469]: DEBUG nova.network.neutron [req-aa1463d3-a415-4585-b95f-1c2ff1047d3e req-a802d2f0-179e-4b9e-bc14-45066648e650 service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Refreshing network info cache for port e7947445-5f12-4c43-a8c4-21c202aa5c99 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG nova.network.neutron [req-aa1463d3-a415-4585-b95f-1c2ff1047d3e req-a802d2f0-179e-4b9e-bc14-45066648e650 service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Updated VIF entry in instance network info cache for port e7947445-5f12-4c43-a8c4-21c202aa5c99. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG nova.network.neutron [req-aa1463d3-a415-4585-b95f-1c2ff1047d3e req-a802d2f0-179e-4b9e-bc14-45066648e650 service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Updating instance_info_cache with network_info: [{"id": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "address": "fa:16:3e:da:f7:e9", "network": {"id": "eb8cebc6-eef2-44f3-8cd2-de7239131b70", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1082345691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d94885e479743cfa031cb6d9ecff20d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947445-5f", "ovs_interfaceid": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-aa1463d3-a415-4585-b95f-1c2ff1047d3e req-a802d2f0-179e-4b9e-bc14-45066648e650 service nova] Releasing lock "refresh_cache-a0e6ef45-c52c-4b08-8541-24375cf34af1" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG nova.objects.instance [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lazy-loading 'flavor' on Instance uuid a0e6ef45-c52c-4b08-8541-24375cf34af1 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:23 user nova-compute[73469]: INFO nova.compute.manager [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Attaching volume 97056637-e5a2-4a36-950e-68f425173e2a to /dev/vdb
Aug 22 03:15:23 user nova-compute[73469]: DEBUG os_brick.utils [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[075f6eae-72df-42d4-a8f8-2445de528911]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[33173690-86fb-45f1-bcf8-9eb8c645d163]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e5635c-e000-42c0-8bba-2577d26f46d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9b1513-a8ea-4a2a-9a16-53efcd30d2c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:15:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:15:24 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:15:24 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43c61ee-f3ca-4120-b8d7-5f455dfb3887]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG os_brick.utils [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Updating existing volume attachment record: 2ff2b6fc-b155-44ce-8185-b4553c0a2771 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Acquiring lock "c2497d75-a68e-44ed-9f12-efb73b933bf3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Lock "c2497d75-a68e-44ed-9f12-efb73b933bf3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Acquiring lock "c2497d75-a68e-44ed-9f12-efb73b933bf3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Lock "c2497d75-a68e-44ed-9f12-efb73b933bf3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Lock "c2497d75-a68e-44ed-9f12-efb73b933bf3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:24 user nova-compute[73469]: INFO nova.compute.manager [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Terminating instance
Aug 22 03:15:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-4c62dae6-ea15-412f-a3e1-05af35eaf0da req-589763bf-f62c-47a8-9cac-114c9c77129e service nova] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Received event network-vif-unplugged-ccee7d66-b060-4ba1-9c0a-e17a25a7bd07 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4c62dae6-ea15-412f-a3e1-05af35eaf0da req-589763bf-f62c-47a8-9cac-114c9c77129e service nova] Acquiring lock "c2497d75-a68e-44ed-9f12-efb73b933bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4c62dae6-ea15-412f-a3e1-05af35eaf0da req-589763bf-f62c-47a8-9cac-114c9c77129e service nova] Lock "c2497d75-a68e-44ed-9f12-efb73b933bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4c62dae6-ea15-412f-a3e1-05af35eaf0da req-589763bf-f62c-47a8-9cac-114c9c77129e service nova] Lock "c2497d75-a68e-44ed-9f12-efb73b933bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-4c62dae6-ea15-412f-a3e1-05af35eaf0da req-589763bf-f62c-47a8-9cac-114c9c77129e service nova] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] No waiting events found dispatching network-vif-unplugged-ccee7d66-b060-4ba1-9c0a-e17a25a7bd07 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-4c62dae6-ea15-412f-a3e1-05af35eaf0da req-589763bf-f62c-47a8-9cac-114c9c77129e service nova] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Received event network-vif-unplugged-ccee7d66-b060-4ba1-9c0a-e17a25a7bd07 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:15:24 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Instance destroyed successfully.
Aug 22 03:15:24 user nova-compute[73469]: DEBUG nova.objects.instance [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Lazy-loading 'resources' on Instance uuid c2497d75-a68e-44ed-9f12-efb73b933bf3 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-940629221',display_name='tempest-VolumesActionsTest-instance-940629221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-940629221',id=37,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:13:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db81e49cdb3e45918600fbe15131a8e2',ramdisk_id='',reservation_id='r-60gf518o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-778029228',owner_user_name='tempest-VolumesActionsTest-778029228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:13:27Z,user_data=None,user_id='82b0db7bcddf45e5ab7d8d434dec4834',uuid=c2497d75-a68e-44ed-9f12-efb73b933bf3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "address": "fa:16:3e:6e:12:29", "network": {"id": "c90e7c67-e16e-421c-919c-69255250d9ee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db81e49cdb3e45918600fbe15131a8e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee7d66-b0", "ovs_interfaceid": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Converting VIF {"id": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "address": "fa:16:3e:6e:12:29", "network": {"id": "c90e7c67-e16e-421c-919c-69255250d9ee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476925757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db81e49cdb3e45918600fbe15131a8e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee7d66-b0", "ovs_interfaceid": "ccee7d66-b060-4ba1-9c0a-e17a25a7bd07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:12:29,bridge_name='br-int',has_traffic_filtering=True,id=ccee7d66-b060-4ba1-9c0a-e17a25a7bd07,network=Network(c90e7c67-e16e-421c-919c-69255250d9ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccee7d66-b0') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG os_vif [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:12:29,bridge_name='br-int',has_traffic_filtering=True,id=ccee7d66-b060-4ba1-9c0a-e17a25a7bd07,network=Network(c90e7c67-e16e-421c-919c-69255250d9ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccee7d66-b0') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccee7d66-b0, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:24 user nova-compute[73469]: INFO os_vif [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:12:29,bridge_name='br-int',has_traffic_filtering=True,id=ccee7d66-b060-4ba1-9c0a-e17a25a7bd07,network=Network(c90e7c67-e16e-421c-919c-69255250d9ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccee7d66-b0')
Aug 22 03:15:24 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Deleting instance files /opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3_del
Aug 22 03:15:24 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Deletion of /opt/stack/data/nova/instances/c2497d75-a68e-44ed-9f12-efb73b933bf3_del complete
Aug 22 03:15:24 user nova-compute[73469]: INFO nova.compute.manager [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 22 03:15:24 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:15:24 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:15:25 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:15:25 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Took 0.70 seconds to deallocate network for instance.
Aug 22 03:15:25 user nova-compute[73469]: DEBUG nova.compute.manager [req-d1d8ace8-1caf-4c68-8073-ef3b20210004 req-e3c8ec15-c7ea-44a7-82b1-0dcf3d9f279c service nova] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Received event network-vif-deleted-ccee7d66-b060-4ba1-9c0a-e17a25a7bd07 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:15:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:25 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:15:25 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:15:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:25 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Deleted allocations for instance c2497d75-a68e-44ed-9f12-efb73b933bf3
Aug 22 03:15:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f107acca-32dc-4e82-a93c-57a15c43ef40 tempest-VolumesActionsTest-778029228 tempest-VolumesActionsTest-778029228-project-member] Lock "c2497d75-a68e-44ed-9f12-efb73b933bf3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.018s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-df6a9c84-d8ec-4b28-a955-d2f3c11646dc req-66a41b36-aa2b-48e7-909c-0d197c4fb3e2 service nova] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Received event network-vif-plugged-ccee7d66-b060-4ba1-9c0a-e17a25a7bd07 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:15:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-df6a9c84-d8ec-4b28-a955-d2f3c11646dc req-66a41b36-aa2b-48e7-909c-0d197c4fb3e2 service nova] Acquiring lock "c2497d75-a68e-44ed-9f12-efb73b933bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-df6a9c84-d8ec-4b28-a955-d2f3c11646dc req-66a41b36-aa2b-48e7-909c-0d197c4fb3e2 service nova] Lock "c2497d75-a68e-44ed-9f12-efb73b933bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-df6a9c84-d8ec-4b28-a955-d2f3c11646dc req-66a41b36-aa2b-48e7-909c-0d197c4fb3e2 service nova] Lock "c2497d75-a68e-44ed-9f12-efb73b933bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-df6a9c84-d8ec-4b28-a955-d2f3c11646dc req-66a41b36-aa2b-48e7-909c-0d197c4fb3e2 service nova] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] No waiting events found dispatching network-vif-plugged-ccee7d66-b060-4ba1-9c0a-e17a25a7bd07 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:15:26 user nova-compute[73469]: WARNING nova.compute.manager [req-df6a9c84-d8ec-4b28-a955-d2f3c11646dc req-66a41b36-aa2b-48e7-909c-0d197c4fb3e2 service nova] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Received unexpected event network-vif-plugged-ccee7d66-b060-4ba1-9c0a-e17a25a7bd07 for instance with vm_state deleted and task_state None.
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "1189d718-45af-415f-bbf9-56093977b0c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1189d718-45af-415f-bbf9-56093977b0c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:27 user nova-compute[73469]: INFO nova.compute.manager [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Detaching volume f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6
Aug 22 03:15:27 user nova-compute[73469]: INFO nova.virt.block_device [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Attempting to driver detach volume f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 from mountpoint /dev/vdb
Aug 22 03:15:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Attempting to detach device vdb from instance 1189d718-45af-415f-bbf9-56093977b0c4 from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:15:27 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:15:27 user nova-compute[73469]:   <source dev="/dev/sdc"/>
Aug 22 03:15:27 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:15:27 user nova-compute[73469]:   <serial>f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6</serial>
Aug 22 03:15:27 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:15:27 user nova-compute[73469]: </disk>
Aug 22 03:15:27 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:15:27 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Successfully detached device vdb from instance 1189d718-45af-415f-bbf9-56093977b0c4 from the persistent domain config.
Aug 22 03:15:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1189d718-45af-415f-bbf9-56093977b0c4 from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:15:27 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:15:27 user nova-compute[73469]:   <source dev="/dev/sdc"/>
Aug 22 03:15:27 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:15:27 user nova-compute[73469]:   <serial>f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6</serial>
Aug 22 03:15:27 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:15:27 user nova-compute[73469]: </disk>
Aug 22 03:15:27 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "1189d718-45af-415f-bbf9-56093977b0c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692674127.718496, 1189d718-45af-415f-bbf9-56093977b0c4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1189d718-45af-415f-bbf9-56093977b0c4 {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:15:27 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Successfully detached device vdb from instance 1189d718-45af-415f-bbf9-56093977b0c4 from the live domain config.
Aug 22 03:15:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHOowpql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:15:27 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:15:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3a6140-fe15-4b1b-8107-68f4a977fee5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[292cf8ca-f519-45d5-93c0-78b077c877e6]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:15:27 user nova-compute[73469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 (non-flash)
Aug 22 03:15:27 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:15:27 user nova-compute[73469]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 (non-flash)
Aug 22 03:15:27 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7980780430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6'): ({'sdc'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Removing single pathed devices sdc {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[763f63a0-3e7a-49ef-a6ce-7d375cda58ad]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1c4584-4811-4b4a-ad14-14cb023e39a7]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Flushing IO for device /dev/sdc {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f426915-e555-4665-aac8-28c16fef1e33]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dffbc6a-66d3-41b8-b428-698d1351554f]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1812627f-4450-4532-82b1-264d9029c83f]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afacffb-02a8-470a-bd84-c18f029f308c]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6, portal: 172.16.0.220,3260]
Aug 22 03:15:27 user nova-compute[73469]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6, portal: 172.16.0.220,3260] successful.
Aug 22 03:15:27 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:28 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e25432-c499-473a-af6c-316fa1c7cd03]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:15:28 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] <== disconnect_volume: return (277ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:15:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:15:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IOiFhxyJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:15:35 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:15:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:15:35 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:15:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:15:35 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fb08fd-f518-4b9e-ad85-e0700e198120]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:15:35 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[72155884-c56b-4b0f-84e3-677ac286120c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a] added
Aug 22 03:15:35 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[81450d37-7100-455d-8811-be309fed17f3]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[899c25bb-21dd-4d4b-adb0-753c8614e023]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IOiFhxyJ {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IOiFhxyJ" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e414358-9af4-4ac7-be17-72a5897b105d]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IOiFhxyJ'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[396adfb0-6efa-4a28-bee6-02bdd4abd83d]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96e9955-d4bf-4b38-a063-55d518d99a2c]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:15:35 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:15:35 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:15:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ed6c7d-3ab0-43bb-8ed6-bf3631c92951]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a, portal: 172.16.0.220,3260]
Aug 22 03:15:36 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a, portal: 172.16.0.220,3260] successful.
Aug 22 03:15:36 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf8121e-d53b-4aff-a6f1-b8f811269bf3]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG nova.objects.instance [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lazy-loading 'flavor' on Instance uuid 1189d718-45af-415f-bbf9-56093977b0c4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a680e1f4-0d00-4cf3-92cd-d53f2db2d1a8]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:15:36 user nova-compute[73469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)
Aug 22 03:15:36 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:15:36 user nova-compute[73469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)
Aug 22 03:15:36 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74f5f56-6d46-47dd-9019-80a9c56ad8f2]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IOiFhxyJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-0df4c130-5800-4d81-99d3-323cca38ae7e tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1189d718-45af-415f-bbf9-56093977b0c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 9.007s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1189d718-45af-415f-bbf9-56093977b0c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 8.834s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "1189d718-45af-415f-bbf9-56093977b0c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1189d718-45af-415f-bbf9-56093977b0c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1189d718-45af-415f-bbf9-56093977b0c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:36 user nova-compute[73469]: INFO nova.compute.manager [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Terminating instance
Aug 22 03:15:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-bfea735e-3c97-4972-bcc3-e5ea078dc4a7 req-4a1a0089-632d-4faa-bebc-7cbcc66ee199 service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Received event network-vif-unplugged-11b72dfc-679a-4db6-97a0-1bf25884e4d2 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bfea735e-3c97-4972-bcc3-e5ea078dc4a7 req-4a1a0089-632d-4faa-bebc-7cbcc66ee199 service nova] Acquiring lock "1189d718-45af-415f-bbf9-56093977b0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bfea735e-3c97-4972-bcc3-e5ea078dc4a7 req-4a1a0089-632d-4faa-bebc-7cbcc66ee199 service nova] Lock "1189d718-45af-415f-bbf9-56093977b0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bfea735e-3c97-4972-bcc3-e5ea078dc4a7 req-4a1a0089-632d-4faa-bebc-7cbcc66ee199 service nova] Lock "1189d718-45af-415f-bbf9-56093977b0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-bfea735e-3c97-4972-bcc3-e5ea078dc4a7 req-4a1a0089-632d-4faa-bebc-7cbcc66ee199 service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] No waiting events found dispatching network-vif-unplugged-11b72dfc-679a-4db6-97a0-1bf25884e4d2 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-bfea735e-3c97-4972-bcc3-e5ea078dc4a7 req-4a1a0089-632d-4faa-bebc-7cbcc66ee199 service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Received event network-vif-unplugged-11b72dfc-679a-4db6-97a0-1bf25884e4d2 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:36 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Instance destroyed successfully.
Aug 22 03:15:36 user nova-compute[73469]: DEBUG nova.objects.instance [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lazy-loading 'resources' on Instance uuid 1189d718-45af-415f-bbf9-56093977b0c4 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:12:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-171839715',display_name='tempest-VolumesSnapshotTestJSON-instance-171839715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-171839715',id=36,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAq69m6plub00DIN8gd0PDZ9Md+9R0vOcTNORvcvqu0+1xj1fk1xK5O0H4xfAsClWOfxmdEAQaDq/OTdgLblobst+7sOpdN2brh1sTGQpNewNH2U9t2GHToNbDdXfDFi7A==',key_name='tempest-keypair-837758461',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:12:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db3173cbd63e4552b2cd30afd9d5f222',ramdisk_id='',reservation_id='r-ytbmf3g3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1072377725',owner_user_name='tempest-VolumesSnapshotTestJSON-1072377725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:12:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eb46fb485964d14b308dfbb74c034c0',uuid=1189d718-45af-415f-bbf9-56093977b0c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "address": "fa:16:3e:d8:2e:37", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b72dfc-67", "ovs_interfaceid": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Converting VIF {"id": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "address": "fa:16:3e:d8:2e:37", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b72dfc-67", "ovs_interfaceid": "11b72dfc-679a-4db6-97a0-1bf25884e4d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:2e:37,bridge_name='br-int',has_traffic_filtering=True,id=11b72dfc-679a-4db6-97a0-1bf25884e4d2,network=Network(f2fb8b83-b1db-45fd-8a84-230e5333ebef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b72dfc-67') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG os_vif [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:2e:37,bridge_name='br-int',has_traffic_filtering=True,id=11b72dfc-679a-4db6-97a0-1bf25884e4d2,network=Network(f2fb8b83-b1db-45fd-8a84-230e5333ebef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b72dfc-67') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11b72dfc-67, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:36 user nova-compute[73469]: INFO os_vif [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:2e:37,bridge_name='br-int',has_traffic_filtering=True,id=11b72dfc-679a-4db6-97a0-1bf25884e4d2,network=Network(f2fb8b83-b1db-45fd-8a84-230e5333ebef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b72dfc-67')
Aug 22 03:15:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:15:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHOowpql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:15:36 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:15:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23865366664626164', 'path': '/dev/sdc'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865366664626164', 'path': '/dev/sdc'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.167s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2a72475-74ae-4220-9cd8-dc0e5cf0b3c6', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG nova.objects.instance [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lazy-loading 'flavor' on Instance uuid a0e6ef45-c52c-4b08-8541-24375cf34af1 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ff728c-e730-43eb-9067-f17c84dffa53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:15:37 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:15:37 user nova-compute[73469]:   <source dev="/dev/sdc"/>
Aug 22 03:15:37 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:15:37 user nova-compute[73469]:   <serial>97056637-e5a2-4a36-950e-68f425173e2a</serial>
Aug 22 03:15:37 user nova-compute[73469]: </disk>
Aug 22 03:15:37 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e566f09-6bad-469d-b2b6-2210dc95bf17]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:15:37 user nova-compute[73469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)
Aug 22 03:15:37 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:15:37 user nova-compute[73469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)
Aug 22 03:15:37 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a41eecb0>, {}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Disconnecting from: [] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.052s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] <== disconnect_volume: return (218ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:15:37 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Deleting instance files /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4_del
Aug 22 03:15:37 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Deletion of /opt/stack/data/nova/instances/1189d718-45af-415f-bbf9-56093977b0c4_del complete
Aug 22 03:15:37 user nova-compute[73469]: INFO nova.compute.manager [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 22 03:15:37 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] No VIF found with MAC fa:16:3e:da:f7:e9, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:15:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cfcecaee-2f77-415a-a647-d7b2def2300d tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.875s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:38 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:15:38 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Took 1.13 seconds to deallocate network for instance.
Aug 22 03:15:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-e15035ab-a7b8-4f6d-8799-85a232ec9826 req-c6a7fe36-2687-4e1b-a819-8d543e0268e7 service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Received event network-vif-deleted-11b72dfc-679a-4db6-97a0-1bf25884e4d2 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:15:38 user nova-compute[73469]: INFO nova.compute.manager [req-e15035ab-a7b8-4f6d-8799-85a232ec9826 req-c6a7fe36-2687-4e1b-a819-8d543e0268e7 service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Neutron deleted interface 11b72dfc-679a-4db6-97a0-1bf25884e4d2; detaching it from the instance and deleting it from the info cache
Aug 22 03:15:38 user nova-compute[73469]: DEBUG nova.network.neutron [req-e15035ab-a7b8-4f6d-8799-85a232ec9826 req-c6a7fe36-2687-4e1b-a819-8d543e0268e7 service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:15:38 user nova-compute[73469]: WARNING nova.volume.cinder [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Attachment 089702b9-b7d6-4875-acb5-37f76fc4132c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 089702b9-b7d6-4875-acb5-37f76fc4132c. (HTTP 404) (Request-ID: req-6d2170c2-f11e-42f4-b1ff-819f1833f765)
Aug 22 03:15:38 user nova-compute[73469]: INFO nova.compute.manager [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Took 0.03 seconds to detach 1 volumes for instance.
Aug 22 03:15:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-e15035ab-a7b8-4f6d-8799-85a232ec9826 req-c6a7fe36-2687-4e1b-a819-8d543e0268e7 service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Detach interface failed, port_id=11b72dfc-679a-4db6-97a0-1bf25884e4d2, reason: Instance 1189d718-45af-415f-bbf9-56093977b0c4 could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 03:15:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-dff14e77-2c1d-48f1-8fa8-a879e5d92ee1 req-5f663bb9-a0c2-4714-b279-298ec963e26d service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Received event network-vif-plugged-11b72dfc-679a-4db6-97a0-1bf25884e4d2 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:15:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dff14e77-2c1d-48f1-8fa8-a879e5d92ee1 req-5f663bb9-a0c2-4714-b279-298ec963e26d service nova] Acquiring lock "1189d718-45af-415f-bbf9-56093977b0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dff14e77-2c1d-48f1-8fa8-a879e5d92ee1 req-5f663bb9-a0c2-4714-b279-298ec963e26d service nova] Lock "1189d718-45af-415f-bbf9-56093977b0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dff14e77-2c1d-48f1-8fa8-a879e5d92ee1 req-5f663bb9-a0c2-4714-b279-298ec963e26d service nova] Lock "1189d718-45af-415f-bbf9-56093977b0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-dff14e77-2c1d-48f1-8fa8-a879e5d92ee1 req-5f663bb9-a0c2-4714-b279-298ec963e26d service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] No waiting events found dispatching network-vif-plugged-11b72dfc-679a-4db6-97a0-1bf25884e4d2 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:15:38 user nova-compute[73469]: WARNING nova.compute.manager [req-dff14e77-2c1d-48f1-8fa8-a879e5d92ee1 req-5f663bb9-a0c2-4714-b279-298ec963e26d service nova] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Received unexpected event network-vif-plugged-11b72dfc-679a-4db6-97a0-1bf25884e4d2 for instance with vm_state deleted and task_state None.
Aug 22 03:15:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:38 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:15:38 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:15:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:38 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Deleted allocations for instance 1189d718-45af-415f-bbf9-56093977b0c4
Aug 22 03:15:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f7ea2ad1-72ae-4252-b6c9-1697269104e3 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1189d718-45af-415f-bbf9-56093977b0c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.701s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:39 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692674124.6832895, c2497d75-a68e-44ed-9f12-efb73b933bf3 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:15:39 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] VM Stopped (Lifecycle Event)
Aug 22 03:15:39 user nova-compute[73469]: DEBUG nova.compute.manager [None req-2198e3ef-8b9c-42c8-a406-6f687719e575 None None] [instance: c2497d75-a68e-44ed-9f12-efb73b933bf3] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG nova.objects.instance [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lazy-loading 'flavor' on Instance uuid a0e6ef45-c52c-4b08-8541-24375cf34af1 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:40 user nova-compute[73469]: INFO nova.compute.manager [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Attaching volume a546fa30-3319-4eae-bac0-3e00af376fd8 to /dev/vdc
Aug 22 03:15:40 user nova-compute[73469]: DEBUG os_brick.utils [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[23611aa1-68f2-4a4a-8dbf-6204e3b56a50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee3b8c0-050e-40c8-98c5-a27048e2f214]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6f5d56-a4aa-4316-a085-9025d71e8aa8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dea7006-c33e-4451-94dd-c9cd3a9fd68a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:15:40 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:15:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e4160f-91b4-498e-b05f-10c96e3a9d17]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG os_brick.utils [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:15:40 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Updating existing volume attachment record: 3c639123-f11f-47bc-8b94-75b3f69e842e {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:15:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquiring lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquiring lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:43 user nova-compute[73469]: INFO nova.compute.manager [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Terminating instance
Aug 22 03:15:43 user nova-compute[73469]: DEBUG nova.compute.manager [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:15:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:43 user nova-compute[73469]: DEBUG nova.compute.manager [req-f1a1f5ed-5393-47e4-9169-4bc39533d10d req-af3941ab-f207-4623-a640-c32036c58748 service nova] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Received event network-vif-unplugged-026b74ec-ba11-459e-aa62-77923404317c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:15:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f1a1f5ed-5393-47e4-9169-4bc39533d10d req-af3941ab-f207-4623-a640-c32036c58748 service nova] Acquiring lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f1a1f5ed-5393-47e4-9169-4bc39533d10d req-af3941ab-f207-4623-a640-c32036c58748 service nova] Lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f1a1f5ed-5393-47e4-9169-4bc39533d10d req-af3941ab-f207-4623-a640-c32036c58748 service nova] Lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:43 user nova-compute[73469]: DEBUG nova.compute.manager [req-f1a1f5ed-5393-47e4-9169-4bc39533d10d req-af3941ab-f207-4623-a640-c32036c58748 service nova] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] No waiting events found dispatching network-vif-unplugged-026b74ec-ba11-459e-aa62-77923404317c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:15:43 user nova-compute[73469]: DEBUG nova.compute.manager [req-f1a1f5ed-5393-47e4-9169-4bc39533d10d req-af3941ab-f207-4623-a640-c32036c58748 service nova] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Received event network-vif-unplugged-026b74ec-ba11-459e-aa62-77923404317c for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:15:43 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Instance destroyed successfully.
Aug 22 03:15:43 user nova-compute[73469]: DEBUG nova.objects.instance [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lazy-loading 'resources' on Instance uuid a7e95a46-9a75-4b0c-a5c9-42ed521668a5 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:15:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1710254852',display_name='tempest-ServersNegativeTestJSON-server-1710254852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1710254852',id=30,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:06:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cec2ad0547114410a036090a792d0645',ramdisk_id='',reservation_id='r-feuvqv38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1709480953',owner_user_name='tempest-ServersNegativeTestJSON-1709480953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:06:49Z,user_data=None,user_id='635f762a1488400fa57a6a9e244ddb42',uuid=a7e95a46-9a75-4b0c-a5c9-42ed521668a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "026b74ec-ba11-459e-aa62-77923404317c", "address": "fa:16:3e:eb:a5:97", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026b74ec-ba", "ovs_interfaceid": "026b74ec-ba11-459e-aa62-77923404317c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:15:43 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Converting VIF {"id": "026b74ec-ba11-459e-aa62-77923404317c", "address": "fa:16:3e:eb:a5:97", "network": {"id": "b1119133-216d-41a0-b227-d1e9e4aed153", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510944563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec2ad0547114410a036090a792d0645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026b74ec-ba", "ovs_interfaceid": "026b74ec-ba11-459e-aa62-77923404317c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:15:43 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a5:97,bridge_name='br-int',has_traffic_filtering=True,id=026b74ec-ba11-459e-aa62-77923404317c,network=Network(b1119133-216d-41a0-b227-d1e9e4aed153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026b74ec-ba') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:15:43 user nova-compute[73469]: DEBUG os_vif [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a5:97,bridge_name='br-int',has_traffic_filtering=True,id=026b74ec-ba11-459e-aa62-77923404317c,network=Network(b1119133-216d-41a0-b227-d1e9e4aed153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026b74ec-ba') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:15:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap026b74ec-ba, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:15:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:15:44 user nova-compute[73469]: INFO os_vif [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a5:97,bridge_name='br-int',has_traffic_filtering=True,id=026b74ec-ba11-459e-aa62-77923404317c,network=Network(b1119133-216d-41a0-b227-d1e9e4aed153),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026b74ec-ba')
Aug 22 03:15:44 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Deleting instance files /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5_del
Aug 22 03:15:44 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Deletion of /opt/stack/data/nova/instances/a7e95a46-9a75-4b0c-a5c9-42ed521668a5_del complete
Aug 22 03:15:44 user nova-compute[73469]: INFO nova.compute.manager [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 22 03:15:44 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:15:44 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:15:44 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:15:44 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:15:44 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Took 0.60 seconds to deallocate network for instance.
Aug 22 03:15:44 user nova-compute[73469]: DEBUG nova.compute.manager [req-05ea5436-e543-4667-926f-9bf1ea0a5242 req-4c186cc8-670a-44aa-88ab-4104bece2baa service nova] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Received event network-vif-deleted-026b74ec-ba11-459e-aa62-77923404317c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:15:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:44 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:15:44 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:15:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:45 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Deleted allocations for instance a7e95a46-9a75-4b0c-a5c9-42ed521668a5
Aug 22 03:15:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-796b9f4e-bdd9-41f0-96f2-f96ce8c638d6 tempest-ServersNegativeTestJSON-1709480953 tempest-ServersNegativeTestJSON-1709480953-project-member] Lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.896s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-e23344d9-c761-407a-bad0-5e2d20c1afc5 req-4455264c-89fd-433b-b56e-ea55903ef653 service nova] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Received event network-vif-plugged-026b74ec-ba11-459e-aa62-77923404317c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:15:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e23344d9-c761-407a-bad0-5e2d20c1afc5 req-4455264c-89fd-433b-b56e-ea55903ef653 service nova] Acquiring lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e23344d9-c761-407a-bad0-5e2d20c1afc5 req-4455264c-89fd-433b-b56e-ea55903ef653 service nova] Lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e23344d9-c761-407a-bad0-5e2d20c1afc5 req-4455264c-89fd-433b-b56e-ea55903ef653 service nova] Lock "a7e95a46-9a75-4b0c-a5c9-42ed521668a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-e23344d9-c761-407a-bad0-5e2d20c1afc5 req-4455264c-89fd-433b-b56e-ea55903ef653 service nova] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] No waiting events found dispatching network-vif-plugged-026b74ec-ba11-459e-aa62-77923404317c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:15:45 user nova-compute[73469]: WARNING nova.compute.manager [req-e23344d9-c761-407a-bad0-5e2d20c1afc5 req-4455264c-89fd-433b-b56e-ea55903ef653 service nova] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Received unexpected event network-vif-plugged-026b74ec-ba11-459e-aa62-77923404317c for instance with vm_state deleted and task_state None.
Aug 22 03:15:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cHkrABDv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:15:51 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:15:51 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:15:51 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[921e7aca-120c-402e-afc7-96fb6f788123]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:15:51 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cce55f5-f6fe-405d-9ef4-e6d1632f3cf0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8] added
Aug 22 03:15:51 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ffdfff-04e8-44bc-9dc8-f16597a7b39d]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acd652f-8d70-46fe-a3a4-66ecd6a49c9e]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cHkrABDv {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cHkrABDv" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae85e0e-23b7-4d52-8c44-ca6e4e9a08f5]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cHkrABDv'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f3d6ec-f980-482e-88ef-f3fecee69ee2]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccf5f9e-04db-40cd-bb24-431bf8f81453]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:15:51 user nova-compute[73469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)
Aug 22 03:15:51 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:15:51 user nova-compute[73469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)
Aug 22 03:15:51 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692674136.9025261, 1189d718-45af-415f-bbf9-56093977b0c4 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:15:51 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] VM Stopped (Lifecycle Event)
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44c52ca-f191-42ea-b1c1-1f37c6d6e9c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8, portal: 172.16.0.220,3260]
Aug 22 03:15:51 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8, portal: 172.16.0.220,3260] successful.
Aug 22 03:15:51 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG nova.compute.manager [None req-61e6cb21-58ef-4939-95a6-d19899e1dd85 None None] [instance: 1189d718-45af-415f-bbf9-56093977b0c4] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c787d9fc-5197-4929-8783-89ea6d46ad19]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc07bbef-01ae-40bb-a94b-f2624bc9cbb9]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:15:51 user nova-compute[73469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)
Aug 22 03:15:51 user nova-compute[73469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 (non-flash)
Aug 22 03:15:51 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:15:51 user nova-compute[73469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)
Aug 22 03:15:51 user nova-compute[73469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 (non-flash)
Aug 22 03:15:51 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:51 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3a6f4d-22c7-4988-818d-7af3ff182b41]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:52 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:15:52 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cHkrABDv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:15:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:15:53 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23736333833323930', 'path': '/dev/sdd'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:15:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736333833323930', 'path': '/dev/sdd'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:15:53 user nova-compute[73469]: DEBUG nova.objects.instance [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lazy-loading 'flavor' on Instance uuid a0e6ef45-c52c-4b08-8541-24375cf34af1 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:15:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:15:53 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:15:53 user nova-compute[73469]:   <source dev="/dev/sdd"/>
Aug 22 03:15:53 user nova-compute[73469]:   <target dev="vdc" bus="virtio"/>
Aug 22 03:15:53 user nova-compute[73469]:   <serial>a546fa30-3319-4eae-bac0-3e00af376fd8</serial>
Aug 22 03:15:53 user nova-compute[73469]: </disk>
Aug 22 03:15:53 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:15:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:15:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:15:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:15:53 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] No VIF found with MAC fa:16:3e:da:f7:e9, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:15:53 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:15:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-443525b1-f4a0-4302-8960-5a4d09a05d21 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.996s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:54 user nova-compute[73469]: INFO nova.compute.manager [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Detaching volume a546fa30-3319-4eae-bac0-3e00af376fd8
Aug 22 03:15:54 user nova-compute[73469]: INFO nova.virt.block_device [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Attempting to driver detach volume a546fa30-3319-4eae-bac0-3e00af376fd8 from mountpoint /dev/vdc
Aug 22 03:15:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Attempting to detach device vdc from instance a0e6ef45-c52c-4b08-8541-24375cf34af1 from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:15:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:15:54 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:15:54 user nova-compute[73469]:   <source dev="/dev/sdd"/>
Aug 22 03:15:54 user nova-compute[73469]:   <target dev="vdc" bus="virtio"/>
Aug 22 03:15:54 user nova-compute[73469]:   <serial>a546fa30-3319-4eae-bac0-3e00af376fd8</serial>
Aug 22 03:15:54 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 22 03:15:54 user nova-compute[73469]: </disk>
Aug 22 03:15:54 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:15:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Successfully detached device vdc from instance a0e6ef45-c52c-4b08-8541-24375cf34af1 from the persistent domain config.
Aug 22 03:15:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a0e6ef45-c52c-4b08-8541-24375cf34af1 from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:15:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:15:54 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:15:54 user nova-compute[73469]:   <source dev="/dev/sdd"/>
Aug 22 03:15:54 user nova-compute[73469]:   <target dev="vdc" bus="virtio"/>
Aug 22 03:15:54 user nova-compute[73469]:   <serial>a546fa30-3319-4eae-bac0-3e00af376fd8</serial>
Aug 22 03:15:54 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 22 03:15:54 user nova-compute[73469]: </disk>
Aug 22 03:15:54 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692674155.305202, a0e6ef45-c52c-4b08-8541-24375cf34af1 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a0e6ef45-c52c-4b08-8541-24375cf34af1 {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:15:55 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Successfully detached device vdc from instance a0e6ef45-c52c-4b08-8541-24375cf34af1 from the live domain config.
Aug 22 03:15:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cHkrABDv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:15:55 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:15:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c06551d-1c3e-4f13-8f7a-41e8ae2a0a34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8e508a-a51c-46de-a457-53ad0ec536b4]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:15:55 user nova-compute[73469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)
Aug 22 03:15:55 user nova-compute[73469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 (non-flash)
Aug 22 03:15:55 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:15:55 user nova-compute[73469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)
Aug 22 03:15:55 user nova-compute[73469]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 (non-flash)
Aug 22 03:15:55 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f798051c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8'): ({'sdd'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Removing single pathed devices sdd {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f88f866-bebf-4d27-95ec-78571b2d1a53]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[367e243a-0aa2-4112-9c82-113b2ed132a4]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Flushing IO for device /dev/sdd {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da66f5f-1a72-4285-8b36-513f5ab9442b]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.031s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bbe1f0-224a-4f41-8d78-cd3bc053e26e]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2223fc-e98e-47ec-9693-acb33db4d768]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[12328d55-4aca-4ce0-9386-76ec0b8bc14f]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8, portal: 172.16.0.220,3260]
Aug 22 03:15:55 user nova-compute[73469]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8, portal: 172.16.0.220,3260] successful.
Aug 22 03:15:55 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a546fa30-3319-4eae-bac0-3e00af376fd8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2dd48a-3c1b-49dc-b0dc-ead1a343e315]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] <== disconnect_volume: return (264ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:15:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:15:56 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Updating instance_info_cache with network_info: [{"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:15:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:15:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:15:56 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:15:56 user nova-compute[73469]: DEBUG nova.objects.instance [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lazy-loading 'flavor' on Instance uuid a0e6ef45-c52c-4b08-8541-24375cf34af1 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:15:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-48638e4a-f4a9-4e97-809a-b8a19a9f9353 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.701s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:56 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:15:57 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:15:57 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:15:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:15:57 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:15:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:15:57 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:15:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:15:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:15:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:15:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:15:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:15:59 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692674143.9730144, a7e95a46-9a75-4b0c-a5c9-42ed521668a5 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:15:59 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] VM Stopped (Lifecycle Event)
Aug 22 03:15:59 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:15:59 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:15:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8150MB free_disk=25.210487365722656GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:15:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:15:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:15:59 user nova-compute[73469]: DEBUG nova.compute.manager [None req-37788005-cc53-4991-acdc-3abd257f59cb None None] [instance: a7e95a46-9a75-4b0c-a5c9-42ed521668a5] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:15:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82e872a7-70b0-4290-9a11-5316765aed01 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:15:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:15:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a0e6ef45-c52c-4b08-8541-24375cf34af1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:15:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 2aa3779f-687f-414a-a31a-5e0f0b6a882f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:15:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:15:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:15:59 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:15:59 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:15:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:15:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:16:01 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:16:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:16:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:16:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:16:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:16:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:16:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:12 user nova-compute[73469]: INFO nova.compute.manager [None req-5e973b1a-189d-4a09-8eb3-82b0e96af151 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Get console output
Aug 22 03:16:12 user nova-compute[73469]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 22 03:16:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:20 user nova-compute[73469]: DEBUG nova.compute.manager [req-6cd998f1-34db-42df-8e18-2e55aa07d849 req-90e5b1a5-a5fe-4476-80ea-ca53c4684d03 service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Received event network-changed-6063bed8-22e5-4bf6-bcde-7628261ffd68 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:16:20 user nova-compute[73469]: DEBUG nova.compute.manager [req-6cd998f1-34db-42df-8e18-2e55aa07d849 req-90e5b1a5-a5fe-4476-80ea-ca53c4684d03 service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Refreshing instance network info cache due to event network-changed-6063bed8-22e5-4bf6-bcde-7628261ffd68. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:16:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6cd998f1-34db-42df-8e18-2e55aa07d849 req-90e5b1a5-a5fe-4476-80ea-ca53c4684d03 service nova] Acquiring lock "refresh_cache-2aa3779f-687f-414a-a31a-5e0f0b6a882f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:16:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6cd998f1-34db-42df-8e18-2e55aa07d849 req-90e5b1a5-a5fe-4476-80ea-ca53c4684d03 service nova] Acquired lock "refresh_cache-2aa3779f-687f-414a-a31a-5e0f0b6a882f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:16:20 user nova-compute[73469]: DEBUG nova.network.neutron [req-6cd998f1-34db-42df-8e18-2e55aa07d849 req-90e5b1a5-a5fe-4476-80ea-ca53c4684d03 service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Refreshing network info cache for port 6063bed8-22e5-4bf6-bcde-7628261ffd68 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:16:21 user nova-compute[73469]: DEBUG nova.network.neutron [req-6cd998f1-34db-42df-8e18-2e55aa07d849 req-90e5b1a5-a5fe-4476-80ea-ca53c4684d03 service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Updated VIF entry in instance network info cache for port 6063bed8-22e5-4bf6-bcde-7628261ffd68. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:16:21 user nova-compute[73469]: DEBUG nova.network.neutron [req-6cd998f1-34db-42df-8e18-2e55aa07d849 req-90e5b1a5-a5fe-4476-80ea-ca53c4684d03 service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Updating instance_info_cache with network_info: [{"id": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "address": "fa:16:3e:4b:ed:38", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063bed8-22", "ovs_interfaceid": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:16:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6cd998f1-34db-42df-8e18-2e55aa07d849 req-90e5b1a5-a5fe-4476-80ea-ca53c4684d03 service nova] Releasing lock "refresh_cache-2aa3779f-687f-414a-a31a-5e0f0b6a882f" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:16:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'flavor' on Instance uuid 2aa3779f-687f-414a-a31a-5e0f0b6a882f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:16:25 user nova-compute[73469]: INFO nova.compute.manager [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Attaching volume 3f50fa0f-0333-4caf-96d9-9bf65be0bb7a to /dev/vdb
Aug 22 03:16:25 user nova-compute[73469]: DEBUG os_brick.utils [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab20f93d-950b-416e-a3a8-ea95b4b0c611]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ad3e22-1446-4641-8567-25ad3831a937]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0946429-d2cb-4311-ad82-19ac29da1df0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92db8d6-aadf-497e-8fcd-6906c2dc124f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:16:25 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:16:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5b4962-a4e8-43fb-9015-26a849e81b2e]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG os_brick.utils [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:16:25 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Updating existing volume attachment record: a77be836-0cda-4bce-b74a-ee917cda68ca {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:16:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajwPhXgl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:16:37 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:16:37 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:16:37 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbd63cc-1131-4cf7-b502-91df3a59bf89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:16:37 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d05f26-de8c-442e-ace2-e09b3a6fef44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a] added
Aug 22 03:16:37 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[af449c3b-4f0c-46df-afd2-fd4029e40795]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6db920-efda-46e5-9dea-175c4b7f4bd7]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ajwPhXgl {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ajwPhXgl" returned: 0 in 0.052s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[82141c03-8b90-458b-87f5-242a3febf1f7]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ajwPhXgl'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9435c963-2b55-4125-ad99-4b6fcfe1ff93]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f72d0fb-d059-4a83-8517-654b4eaf59fe]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:16:37 user nova-compute[73469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)
Aug 22 03:16:37 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:16:37 user nova-compute[73469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)
Aug 22 03:16:37 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec90a715-0a68-4537-85d2-129056cc022f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a, portal: 172.16.0.220,3260]
Aug 22 03:16:37 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a, portal: 172.16.0.220,3260] successful.
Aug 22 03:16:37 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe44a32-3e47-47ca-aa72-0db552ea16d0]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5519a0a0-ff5a-4652-a973-2b7d6dd653f2]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:16:37 user nova-compute[73469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)
Aug 22 03:16:37 user nova-compute[73469]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a (non-flash)
Aug 22 03:16:37 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:16:37 user nova-compute[73469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)
Aug 22 03:16:37 user nova-compute[73469]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a (non-flash)
Aug 22 03:16:37 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1444dd7c-4c8f-43d5-999d-d752055bd705]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:16:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajwPhXgl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:16:38 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:16:38 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23036306132383663', 'path': '/dev/sdd'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:16:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036306132383663', 'path': '/dev/sdd'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:16:38 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'flavor' on Instance uuid 2aa3779f-687f-414a-a31a-5e0f0b6a882f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:16:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:16:38 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:16:38 user nova-compute[73469]:   <source dev="/dev/sdd"/>
Aug 22 03:16:38 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:16:38 user nova-compute[73469]:   <serial>3f50fa0f-0333-4caf-96d9-9bf65be0bb7a</serial>
Aug 22 03:16:38 user nova-compute[73469]: </disk>
Aug 22 03:16:38 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:16:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:16:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:16:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] No VIF found with MAC fa:16:3e:4b:ed:38, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:16:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1b05510b-198b-4200-9e88-f68cc7222c0f tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.381s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:16:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:16:40 user nova-compute[73469]: INFO nova.compute.manager [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Detaching volume 3f50fa0f-0333-4caf-96d9-9bf65be0bb7a
Aug 22 03:16:40 user nova-compute[73469]: INFO nova.virt.block_device [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Attempting to driver detach volume 3f50fa0f-0333-4caf-96d9-9bf65be0bb7a from mountpoint /dev/vdb
Aug 22 03:16:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Attempting to detach device vdb from instance 2aa3779f-687f-414a-a31a-5e0f0b6a882f from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:16:40 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:16:40 user nova-compute[73469]:   <source dev="/dev/sdd"/>
Aug 22 03:16:40 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:16:40 user nova-compute[73469]:   <serial>3f50fa0f-0333-4caf-96d9-9bf65be0bb7a</serial>
Aug 22 03:16:40 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:16:40 user nova-compute[73469]: </disk>
Aug 22 03:16:40 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:16:40 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Successfully detached device vdb from instance 2aa3779f-687f-414a-a31a-5e0f0b6a882f from the persistent domain config.
Aug 22 03:16:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2aa3779f-687f-414a-a31a-5e0f0b6a882f from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:16:40 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:16:40 user nova-compute[73469]:   <source dev="/dev/sdd"/>
Aug 22 03:16:40 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:16:40 user nova-compute[73469]:   <serial>3f50fa0f-0333-4caf-96d9-9bf65be0bb7a</serial>
Aug 22 03:16:40 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:16:40 user nova-compute[73469]: </disk>
Aug 22 03:16:40 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692674200.684289, 2aa3779f-687f-414a-a31a-5e0f0b6a882f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2aa3779f-687f-414a-a31a-5e0f0b6a882f {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:16:40 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Successfully detached device vdb from instance 2aa3779f-687f-414a-a31a-5e0f0b6a882f from the live domain config.
Aug 22 03:16:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajwPhXgl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:16:40 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:16:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f31c2d-80b1-477d-a56c-90e441335585]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9dfe5d-5b0f-468e-af5a-339027a0d04e]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:16:40 user nova-compute[73469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)
Aug 22 03:16:40 user nova-compute[73469]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a (non-flash)
Aug 22 03:16:40 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:16:40 user nova-compute[73469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)
Aug 22 03:16:40 user nova-compute[73469]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a (non-flash)
Aug 22 03:16:40 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f798079c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a'): ({'sdd'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Removing single pathed devices sdd {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[331693f3-39b8-4cf4-951d-d9fbf47d5faf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05f8f6d-4a9f-4da0-8fd4-55dbfa2c54d5]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Flushing IO for device /dev/sdd {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eab6538-9c04-4aaa-bcae-e475a1062a3c]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ad944b-dc3e-4e1c-8125-17caf3367777]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] SCSI volumes sdd have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffca06ab-cfa6-49c7-bc6a-15f6de19beb9]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:16:40 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:41 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[29346be9-d9b7-445d-a858-c2e7b41b6cde]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a, portal: 172.16.0.220,3260]
Aug 22 03:16:41 user nova-compute[73469]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a, portal: 172.16.0.220,3260] successful.
Aug 22 03:16:41 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:16:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:41 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50fa0f-0333-4caf-96d9-9bf65be0bb7a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:41 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1849d537-65e7-4010-9d14-5ca6c991f235]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:16:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:16:41 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] <== disconnect_volume: return (337ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:16:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:16:43 user nova-compute[73469]: DEBUG nova.objects.instance [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'flavor' on Instance uuid 2aa3779f-687f-414a-a31a-5e0f0b6a882f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:16:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f7b1f25b-5c26-4775-ae13-5b697b76c24d tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.236s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:16:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:16:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:16:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:16:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:16:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:16:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:16:45 user nova-compute[73469]: INFO nova.compute.manager [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Detaching volume 97056637-e5a2-4a36-950e-68f425173e2a
Aug 22 03:16:45 user nova-compute[73469]: INFO nova.virt.block_device [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Attempting to driver detach volume 97056637-e5a2-4a36-950e-68f425173e2a from mountpoint /dev/vdb
Aug 22 03:16:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Attempting to detach device vdb from instance a0e6ef45-c52c-4b08-8541-24375cf34af1 from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:16:45 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:16:45 user nova-compute[73469]:   <source dev="/dev/sdc"/>
Aug 22 03:16:45 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:16:45 user nova-compute[73469]:   <serial>97056637-e5a2-4a36-950e-68f425173e2a</serial>
Aug 22 03:16:45 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:16:45 user nova-compute[73469]: </disk>
Aug 22 03:16:45 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:16:45 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Successfully detached device vdb from instance a0e6ef45-c52c-4b08-8541-24375cf34af1 from the persistent domain config.
Aug 22 03:16:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a0e6ef45-c52c-4b08-8541-24375cf34af1 from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:16:45 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:16:45 user nova-compute[73469]:   <source dev="/dev/sdc"/>
Aug 22 03:16:45 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:16:45 user nova-compute[73469]:   <serial>97056637-e5a2-4a36-950e-68f425173e2a</serial>
Aug 22 03:16:45 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:16:45 user nova-compute[73469]: </disk>
Aug 22 03:16:45 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692674205.86124, a0e6ef45-c52c-4b08-8541-24375cf34af1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a0e6ef45-c52c-4b08-8541-24375cf34af1 {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:16:45 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Successfully detached device vdb from instance a0e6ef45-c52c-4b08-8541-24375cf34af1 from the live domain config.
Aug 22 03:16:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IOiFhxyJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:16:45 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:16:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b7197e-d2aa-4eab-b862-4a5182aa1215]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[19016a50-e934-4ef3-90e4-2daed173033b]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:16:45 user nova-compute[73469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)
Aug 22 03:16:45 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:16:45 user nova-compute[73469]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a (non-flash)
Aug 22 03:16:45 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f798079e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a'): ({'sdc'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Removing single pathed devices sdc {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f4738a-7355-4daa-b76e-6c2ec825880f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[037ef2d4-b131-4813-997b-54793d88c267]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Flushing IO for device /dev/sdc {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:16:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[131f2157-2a1f-4bd7-9f5f-5557bee380ad]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[889e48f0-c52d-40d5-bd24-2409f361953a]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[80140f62-c73e-4aee-8c86-a77d7a98a09c]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4916715-b014-4009-8028-34335173cfb7]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a, portal: 172.16.0.220,3260]
Aug 22 03:16:46 user nova-compute[73469]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a, portal: 172.16.0.220,3260] successful.
Aug 22 03:16:46 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97056637-e5a2-4a36-950e-68f425173e2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2e474f-de8e-4dba-93e8-609c6f632176]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] <== disconnect_volume: return (300ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:16:46 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:16:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:51 user nova-compute[73469]: DEBUG nova.objects.instance [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lazy-loading 'flavor' on Instance uuid a0e6ef45-c52c-4b08-8541-24375cf34af1 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:16:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cb19da3f-0563-498c-aad7-6481297e11e5 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.668s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:16:52 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:16:53 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:16:53 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:16:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "1d2fe450-442f-4722-b187-2f75655c2b52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:16:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1d2fe450-442f-4722-b187-2f75655c2b52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:16:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:16:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:16:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:16:54 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:16:54 user nova-compute[73469]: INFO nova.compute.claims [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Claim successful on node user
Aug 22 03:16:54 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:16:54 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:16:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:16:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:16:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:16:54 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:16:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:16:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:16:54 user nova-compute[73469]: DEBUG nova.policy [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6eb46fb485964d14b308dfbb74c034c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3173cbd63e4552b2cd30afd9d5f222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:16:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:16:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:16:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Creating image(s)
Aug 22 03:16:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:16:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "/opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:16:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "/opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:16:54 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.214s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.205s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk 1073741824" returned: 0 in 0.133s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.348s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Successfully created port: 6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Didn't find any instances for network info cache update. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.190s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Cannot resize image /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lazy-loading 'migration_context' on Instance uuid 1d2fe450-442f-4722-b187-2f75655c2b52 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Ensure instance console log exists: /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:16:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Successfully updated port: 6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "refresh_cache-1d2fe450-442f-4722-b187-2f75655c2b52" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquired lock "refresh_cache-1d2fe450-442f-4722-b187-2f75655c2b52" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.compute.manager [req-ecaa9aa9-35ab-4e5e-8243-4917a4e103ed req-797e7131-c6ae-4198-a893-dc7ee1257ade service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Received event network-changed-6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.compute.manager [req-ecaa9aa9-35ab-4e5e-8243-4917a4e103ed req-797e7131-c6ae-4198-a893-dc7ee1257ade service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Refreshing instance network info cache due to event network-changed-6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ecaa9aa9-35ab-4e5e-8243-4917a4e103ed req-797e7131-c6ae-4198-a893-dc7ee1257ade service nova] Acquiring lock "refresh_cache-1d2fe450-442f-4722-b187-2f75655c2b52" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Updating instance_info_cache with network_info: [{"id": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "address": "fa:16:3e:b3:2e:19", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3a0bc-eb", "ovs_interfaceid": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Releasing lock "refresh_cache-1d2fe450-442f-4722-b187-2f75655c2b52" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Instance network_info: |[{"id": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "address": "fa:16:3e:b3:2e:19", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3a0bc-eb", "ovs_interfaceid": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ecaa9aa9-35ab-4e5e-8243-4917a4e103ed req-797e7131-c6ae-4198-a893-dc7ee1257ade service nova] Acquired lock "refresh_cache-1d2fe450-442f-4722-b187-2f75655c2b52" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.network.neutron [req-ecaa9aa9-35ab-4e5e-8243-4917a4e103ed req-797e7131-c6ae-4198-a893-dc7ee1257ade service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Refreshing network info cache for port 6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Start _get_guest_xml network_info=[{"id": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "address": "fa:16:3e:b3:2e:19", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3a0bc-eb", "ovs_interfaceid": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:16:56 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:16:56 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1175779084',display_name='tempest-VolumesSnapshotTestJSON-instance-1175779084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1175779084',id=40,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhpSXJ4NGyAbnQSiZbvDd3cHjNEYm56/V1kKoT2otc/YyXROkGcD6IL/VfBHdAaANREcla5n/aIdutwSDqFHZuMDKb/Z7/zG39Z8zihXRLAeRBCxl6+UfZxsj8k89+DIQ==',key_name='tempest-keypair-867076957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db3173cbd63e4552b2cd30afd9d5f222',ramdisk_id='',reservation_id='r-pjsa75qv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1072377725',owner_user_name='tempest-VolumesSnapshotTestJSON-1072377725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:16:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eb46fb485964d14b308dfbb74c034c0',uuid=1d2fe450-442f-4722-b187-2f75655c2b52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "address": "fa:16:3e:b3:2e:19", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3a0bc-eb", "ovs_interfaceid": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Converting VIF {"id": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "address": "fa:16:3e:b3:2e:19", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3a0bc-eb", "ovs_interfaceid": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2e:19,bridge_name='br-int',has_traffic_filtering=True,id=6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c,network=Network(f2fb8b83-b1db-45fd-8a84-230e5333ebef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc3a0bc-eb') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d2fe450-442f-4722-b187-2f75655c2b52 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:16:56 user nova-compute[73469]:   <uuid>1d2fe450-442f-4722-b187-2f75655c2b52</uuid>
Aug 22 03:16:56 user nova-compute[73469]:   <name>instance-00000028</name>
Aug 22 03:16:56 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:16:56 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:16:56 user nova-compute[73469]:   <metadata>
Aug 22 03:16:56 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:16:56 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:16:56 user nova-compute[73469]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1175779084</nova:name>
Aug 22 03:16:56 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:16:56</nova:creationTime>
Aug 22 03:16:56 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:16:56 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:16:56 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:16:56 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:16:56 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:16:56 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:16:56 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:16:56 user nova-compute[73469]:       <nova:owner>
Aug 22 03:16:56 user nova-compute[73469]:         <nova:user uuid="6eb46fb485964d14b308dfbb74c034c0">tempest-VolumesSnapshotTestJSON-1072377725-project-member</nova:user>
Aug 22 03:16:56 user nova-compute[73469]:         <nova:project uuid="db3173cbd63e4552b2cd30afd9d5f222">tempest-VolumesSnapshotTestJSON-1072377725</nova:project>
Aug 22 03:16:56 user nova-compute[73469]:       </nova:owner>
Aug 22 03:16:56 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:16:56 user nova-compute[73469]:       <nova:ports>
Aug 22 03:16:56 user nova-compute[73469]:         <nova:port uuid="6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c">
Aug 22 03:16:56 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 22 03:16:56 user nova-compute[73469]:         </nova:port>
Aug 22 03:16:56 user nova-compute[73469]:       </nova:ports>
Aug 22 03:16:56 user nova-compute[73469]:     </nova:instance>
Aug 22 03:16:56 user nova-compute[73469]:   </metadata>
Aug 22 03:16:56 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:16:56 user nova-compute[73469]:     <system>
Aug 22 03:16:56 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:16:56 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:16:56 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:16:56 user nova-compute[73469]:       <entry name="serial">1d2fe450-442f-4722-b187-2f75655c2b52</entry>
Aug 22 03:16:56 user nova-compute[73469]:       <entry name="uuid">1d2fe450-442f-4722-b187-2f75655c2b52</entry>
Aug 22 03:16:56 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:16:56 user nova-compute[73469]:     </system>
Aug 22 03:16:56 user nova-compute[73469]:   </sysinfo>
Aug 22 03:16:56 user nova-compute[73469]:   <os>
Aug 22 03:16:56 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:16:56 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:16:56 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:16:56 user nova-compute[73469]:   </os>
Aug 22 03:16:56 user nova-compute[73469]:   <features>
Aug 22 03:16:56 user nova-compute[73469]:     <acpi/>
Aug 22 03:16:56 user nova-compute[73469]:     <apic/>
Aug 22 03:16:56 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:16:56 user nova-compute[73469]:   </features>
Aug 22 03:16:56 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:16:56 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:16:56 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:16:56 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:16:56 user nova-compute[73469]:   </clock>
Aug 22 03:16:56 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:16:56 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:16:56 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:16:56 user nova-compute[73469]:   </cpu>
Aug 22 03:16:56 user nova-compute[73469]:   <devices>
Aug 22 03:16:56 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:16:56 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:16:56 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk"/>
Aug 22 03:16:56 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:16:56 user nova-compute[73469]:     </disk>
Aug 22 03:16:56 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:16:56 user nova-compute[73469]:       <mac address="fa:16:3e:b3:2e:19"/>
Aug 22 03:16:56 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:16:56 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:16:56 user nova-compute[73469]:       <target dev="tap6bc3a0bc-eb"/>
Aug 22 03:16:56 user nova-compute[73469]:     </interface>
Aug 22 03:16:56 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:16:56 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/console.log" append="off"/>
Aug 22 03:16:56 user nova-compute[73469]:     </serial>
Aug 22 03:16:56 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:16:56 user nova-compute[73469]:     <video>
Aug 22 03:16:56 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:16:56 user nova-compute[73469]:     </video>
Aug 22 03:16:56 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:16:56 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:16:56 user nova-compute[73469]:     </rng>
Aug 22 03:16:56 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:16:56 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:16:56 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:16:56 user nova-compute[73469]:     </memballoon>
Aug 22 03:16:56 user nova-compute[73469]:   </devices>
Aug 22 03:16:56 user nova-compute[73469]: </domain>
Aug 22 03:16:56 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1175779084',display_name='tempest-VolumesSnapshotTestJSON-instance-1175779084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1175779084',id=40,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhpSXJ4NGyAbnQSiZbvDd3cHjNEYm56/V1kKoT2otc/YyXROkGcD6IL/VfBHdAaANREcla5n/aIdutwSDqFHZuMDKb/Z7/zG39Z8zihXRLAeRBCxl6+UfZxsj8k89+DIQ==',key_name='tempest-keypair-867076957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db3173cbd63e4552b2cd30afd9d5f222',ramdisk_id='',reservation_id='r-pjsa75qv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1072377725',owner_user_name='tempest-VolumesSnapshotTestJSON-1072377725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:16:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eb46fb485964d14b308dfbb74c034c0',uuid=1d2fe450-442f-4722-b187-2f75655c2b52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "address": "fa:16:3e:b3:2e:19", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3a0bc-eb", "ovs_interfaceid": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Converting VIF {"id": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "address": "fa:16:3e:b3:2e:19", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3a0bc-eb", "ovs_interfaceid": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2e:19,bridge_name='br-int',has_traffic_filtering=True,id=6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c,network=Network(f2fb8b83-b1db-45fd-8a84-230e5333ebef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc3a0bc-eb') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG os_vif [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2e:19,bridge_name='br-int',has_traffic_filtering=True,id=6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c,network=Network(f2fb8b83-b1db-45fd-8a84-230e5333ebef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc3a0bc-eb') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6bc3a0bc-eb, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6bc3a0bc-eb, col_values=(('external_ids', {'iface-id': '6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:2e:19', 'vm-uuid': '1d2fe450-442f-4722-b187-2f75655c2b52'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:56 user nova-compute[73469]: INFO os_vif [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2e:19,bridge_name='br-int',has_traffic_filtering=True,id=6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c,network=Network(f2fb8b83-b1db-45fd-8a84-230e5333ebef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc3a0bc-eb')
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:16:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] No VIF found with MAC fa:16:3e:b3:2e:19, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:16:57 user nova-compute[73469]: DEBUG nova.network.neutron [req-ecaa9aa9-35ab-4e5e-8243-4917a4e103ed req-797e7131-c6ae-4198-a893-dc7ee1257ade service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Updated VIF entry in instance network info cache for port 6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:16:57 user nova-compute[73469]: DEBUG nova.network.neutron [req-ecaa9aa9-35ab-4e5e-8243-4917a4e103ed req-797e7131-c6ae-4198-a893-dc7ee1257ade service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Updating instance_info_cache with network_info: [{"id": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "address": "fa:16:3e:b3:2e:19", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3a0bc-eb", "ovs_interfaceid": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:16:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ecaa9aa9-35ab-4e5e-8243-4917a4e103ed req-797e7131-c6ae-4198-a893-dc7ee1257ade service nova] Releasing lock "refresh_cache-1d2fe450-442f-4722-b187-2f75655c2b52" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:16:57 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:16:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:16:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:16:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:16:57 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:16:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:58 user nova-compute[73469]: DEBUG nova.compute.manager [req-04e58476-6c4a-45a1-b766-381384dd2f3d req-d8b80a44-55e7-425f-ab9e-d5af5969fce5 service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Received event network-vif-plugged-6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:16:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-04e58476-6c4a-45a1-b766-381384dd2f3d req-d8b80a44-55e7-425f-ab9e-d5af5969fce5 service nova] Acquiring lock "1d2fe450-442f-4722-b187-2f75655c2b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:16:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-04e58476-6c4a-45a1-b766-381384dd2f3d req-d8b80a44-55e7-425f-ab9e-d5af5969fce5 service nova] Lock "1d2fe450-442f-4722-b187-2f75655c2b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:16:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-04e58476-6c4a-45a1-b766-381384dd2f3d req-d8b80a44-55e7-425f-ab9e-d5af5969fce5 service nova] Lock "1d2fe450-442f-4722-b187-2f75655c2b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:16:58 user nova-compute[73469]: DEBUG nova.compute.manager [req-04e58476-6c4a-45a1-b766-381384dd2f3d req-d8b80a44-55e7-425f-ab9e-d5af5969fce5 service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] No waiting events found dispatching network-vif-plugged-6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:16:58 user nova-compute[73469]: WARNING nova.compute.manager [req-04e58476-6c4a-45a1-b766-381384dd2f3d req-d8b80a44-55e7-425f-ab9e-d5af5969fce5 service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Received unexpected event network-vif-plugged-6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c for instance with vm_state building and task_state spawning.
Aug 22 03:16:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:16:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:16:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:16:59 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:16:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:17:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:17:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:17:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:17:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:17:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:17:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:17:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674220.7092917, 1d2fe450-442f-4722-b187-2f75655c2b52 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:17:01 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] VM Resumed (Lifecycle Event)
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.compute.manager [req-0a6c5314-408b-43cb-b7fd-76ccd79ac3d6 req-fa5686e0-5ebc-4a74-ad6e-5c4b035d7ff0 service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Received event network-vif-plugged-6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0a6c5314-408b-43cb-b7fd-76ccd79ac3d6 req-fa5686e0-5ebc-4a74-ad6e-5c4b035d7ff0 service nova] Acquiring lock "1d2fe450-442f-4722-b187-2f75655c2b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0a6c5314-408b-43cb-b7fd-76ccd79ac3d6 req-fa5686e0-5ebc-4a74-ad6e-5c4b035d7ff0 service nova] Lock "1d2fe450-442f-4722-b187-2f75655c2b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0a6c5314-408b-43cb-b7fd-76ccd79ac3d6 req-fa5686e0-5ebc-4a74-ad6e-5c4b035d7ff0 service nova] Lock "1d2fe450-442f-4722-b187-2f75655c2b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.compute.manager [req-0a6c5314-408b-43cb-b7fd-76ccd79ac3d6 req-fa5686e0-5ebc-4a74-ad6e-5c4b035d7ff0 service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] No waiting events found dispatching network-vif-plugged-6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:17:01 user nova-compute[73469]: WARNING nova.compute.manager [req-0a6c5314-408b-43cb-b7fd-76ccd79ac3d6 req-fa5686e0-5ebc-4a74-ad6e-5c4b035d7ff0 service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Received unexpected event network-vif-plugged-6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c for instance with vm_state building and task_state spawning.
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:17:01 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:17:01 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8144MB free_disk=25.197406768798828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:17:01 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Instance spawned successfully.
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:17:01 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674220.7096024, 1d2fe450-442f-4722-b187-2f75655c2b52 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:17:01 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] VM Started (Lifecycle Event)
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82e872a7-70b0-4290-9a11-5316765aed01 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a0e6ef45-c52c-4b08-8541-24375cf34af1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 2aa3779f-687f-414a-a31a-5e0f0b6a882f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 1d2fe450-442f-4722-b187-2f75655c2b52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:17:01 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:17:01 user nova-compute[73469]: INFO nova.compute.manager [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Took 6.34 seconds to spawn the instance on the hypervisor.
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:17:01 user nova-compute[73469]: INFO nova.compute.manager [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Took 7.03 seconds to build instance.
Aug 22 03:17:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ac305f66-b1d2-4c3f-842c-1c7cdcbaecb8 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1d2fe450-442f-4722-b187-2f75655c2b52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.147s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:17:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:02 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:17:02 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:17:02 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:17:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:17:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:17:13 user nova-compute[73469]: INFO nova.compute.manager [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Terminating instance
Aug 22 03:17:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-08b00c77-f383-40ce-920d-5d77797de65b req-b0cdbf36-4ea1-49f4-afba-e72c77c1af7f service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Received event network-vif-unplugged-869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-08b00c77-f383-40ce-920d-5d77797de65b req-b0cdbf36-4ea1-49f4-afba-e72c77c1af7f service nova] Acquiring lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-08b00c77-f383-40ce-920d-5d77797de65b req-b0cdbf36-4ea1-49f4-afba-e72c77c1af7f service nova] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-08b00c77-f383-40ce-920d-5d77797de65b req-b0cdbf36-4ea1-49f4-afba-e72c77c1af7f service nova] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-08b00c77-f383-40ce-920d-5d77797de65b req-b0cdbf36-4ea1-49f4-afba-e72c77c1af7f service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] No waiting events found dispatching network-vif-unplugged-869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-08b00c77-f383-40ce-920d-5d77797de65b req-b0cdbf36-4ea1-49f4-afba-e72c77c1af7f service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Received event network-vif-unplugged-869bff62-e3a4-4403-af83-7434b36b53ed for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:13 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Instance destroyed successfully.
Aug 22 03:17:13 user nova-compute[73469]: DEBUG nova.objects.instance [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'resources' on Instance uuid 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:10:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-15753066',display_name='tempest-ServerActionsTestOtherA-server-15753066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-15753066',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqna53ychrrpICcXpgxhDHdrzJyFFu88HUxTxIQK5z+xOZfcw7kHrC8QJBeI4lEfQOxVPYITpSoaAG4B9QNlgmIHoEX0gtT1wKkQ7bp7nCHyaP40f+//buUPKlKHlWXEA==',key_name='tempest-keypair-651522654',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:13:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d1c312e979e47558b06d4fa70bc103a',ramdisk_id='',reservation_id='r-g82q5n0v',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1751677379',owner_user_name='tempest-ServerActionsTestOtherA-1751677379-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:14:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b47d6cefd0d4949bf4c3c0fc72a9cd5',uuid=9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converting VIF {"id": "869bff62-e3a4-4403-af83-7434b36b53ed", "address": "fa:16:3e:c4:97:9c", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap869bff62-e3", "ovs_interfaceid": "869bff62-e3a4-4403-af83-7434b36b53ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:97:9c,bridge_name='br-int',has_traffic_filtering=True,id=869bff62-e3a4-4403-af83-7434b36b53ed,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869bff62-e3') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG os_vif [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:97:9c,bridge_name='br-int',has_traffic_filtering=True,id=869bff62-e3a4-4403-af83-7434b36b53ed,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869bff62-e3') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap869bff62-e3, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:17:13 user nova-compute[73469]: INFO os_vif [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:97:9c,bridge_name='br-int',has_traffic_filtering=True,id=869bff62-e3a4-4403-af83-7434b36b53ed,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap869bff62-e3')
Aug 22 03:17:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTPihObH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:17:14 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:17:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[071e326d-d350-44b1-88b6-4548ecaf0f4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0c0448-6b7e-4862-9225-dbbc13629a70]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:17:14 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 (non-flash)
Aug 22 03:17:14 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4661510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[de661a52-8626-4e36-87c0-8c5ad29b02c6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[34eb74f5-731e-4de1-98bb-6887014c5c6e]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3418116-4f83-438d-9edd-46460f4b84e7]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfb48a7-dcf3-43b7-8988-95dbe5f95256]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf3674d56-9295928dcc0f701a', '/dev/disk/by-id/scsi-23932393539323864', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f3674d56') {{(pid=84378) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b38180-3b5d-48b7-9b15-20e5692a2538]: (4, None) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd1d81d-c851-4eb1-a5b8-6d69b7215556]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed5b0e4-cd3e-45fd-9fa8-bd421df27ab2]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6, portal: 172.16.0.220,3260]
Aug 22 03:17:14 user nova-compute[73469]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6, portal: 172.16.0.220,3260] successful.
Aug 22 03:17:14 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2d9588-7a08-4e9c-8aea-98b5448ddca6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2f5694-7782-458a-8775-8ba8f599f7b3]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] <== disconnect_volume: return (293ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:17:14 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Deleting instance files /opt/stack/data/nova/instances/9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00_del
Aug 22 03:17:14 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Deletion of /opt/stack/data/nova/instances/9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00_del complete
Aug 22 03:17:14 user nova-compute[73469]: INFO nova.compute.manager [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 22 03:17:14 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:17:14 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:17:15 user nova-compute[73469]: DEBUG nova.compute.manager [req-ce4b245e-2b30-45b0-aad9-b5c87d819824 req-4837ba00-0db1-415e-bbe9-434c0da35c20 service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Received event network-vif-plugged-869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:17:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ce4b245e-2b30-45b0-aad9-b5c87d819824 req-4837ba00-0db1-415e-bbe9-434c0da35c20 service nova] Acquiring lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:17:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ce4b245e-2b30-45b0-aad9-b5c87d819824 req-4837ba00-0db1-415e-bbe9-434c0da35c20 service nova] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:17:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ce4b245e-2b30-45b0-aad9-b5c87d819824 req-4837ba00-0db1-415e-bbe9-434c0da35c20 service nova] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:17:15 user nova-compute[73469]: DEBUG nova.compute.manager [req-ce4b245e-2b30-45b0-aad9-b5c87d819824 req-4837ba00-0db1-415e-bbe9-434c0da35c20 service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] No waiting events found dispatching network-vif-plugged-869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:17:15 user nova-compute[73469]: WARNING nova.compute.manager [req-ce4b245e-2b30-45b0-aad9-b5c87d819824 req-4837ba00-0db1-415e-bbe9-434c0da35c20 service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Received unexpected event network-vif-plugged-869bff62-e3a4-4403-af83-7434b36b53ed for instance with vm_state active and task_state deleting.
Aug 22 03:17:15 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:17:15 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Took 1.42 seconds to deallocate network for instance.
Aug 22 03:17:16 user nova-compute[73469]: INFO nova.compute.manager [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Took 0.77 seconds to detach 1 volumes for instance.
Aug 22 03:17:16 user nova-compute[73469]: DEBUG nova.compute.manager [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Deleting volume: 9e2d9588-7a08-4e9c-8aea-98b5448ddca6 {{(pid=73469) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 22 03:17:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:17:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:17:16 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:17:16 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:17:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:17:16 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Deleted allocations for instance 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00
Aug 22 03:17:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-415c1f30-c4a5-477b-a844-83f026f96921 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.835s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:17:17 user nova-compute[73469]: DEBUG nova.compute.manager [req-76718bfa-2c8c-4734-b21d-a6051891b307 req-50ec4862-9d05-454c-b34d-6751d123744c service nova] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Received event network-vif-deleted-869bff62-e3a4-4403-af83-7434b36b53ed {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:17:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:28 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692674233.9462, 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:17:28 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] VM Stopped (Lifecycle Event)
Aug 22 03:17:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-991e7421-5875-4df7-9fdc-5629a29c1508 None None] [instance: 9d6be8ff-ec3c-41fe-a93d-7d2bc8138e00] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:17:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:17:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:17:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:17:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:17:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:17:30 user nova-compute[73469]: INFO nova.compute.manager [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Terminating instance
Aug 22 03:17:30 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:17:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-0f3c6b76-e1dd-4421-9a83-bc113cbcfaa5 req-2aaddef1-22a9-4e61-b6c4-a922323ff7e2 service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Received event network-vif-unplugged-6063bed8-22e5-4bf6-bcde-7628261ffd68 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:17:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0f3c6b76-e1dd-4421-9a83-bc113cbcfaa5 req-2aaddef1-22a9-4e61-b6c4-a922323ff7e2 service nova] Acquiring lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:17:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0f3c6b76-e1dd-4421-9a83-bc113cbcfaa5 req-2aaddef1-22a9-4e61-b6c4-a922323ff7e2 service nova] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:17:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0f3c6b76-e1dd-4421-9a83-bc113cbcfaa5 req-2aaddef1-22a9-4e61-b6c4-a922323ff7e2 service nova] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:17:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-0f3c6b76-e1dd-4421-9a83-bc113cbcfaa5 req-2aaddef1-22a9-4e61-b6c4-a922323ff7e2 service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] No waiting events found dispatching network-vif-unplugged-6063bed8-22e5-4bf6-bcde-7628261ffd68 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:17:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-0f3c6b76-e1dd-4421-9a83-bc113cbcfaa5 req-2aaddef1-22a9-4e61-b6c4-a922323ff7e2 service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Received event network-vif-unplugged-6063bed8-22e5-4bf6-bcde-7628261ffd68 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:17:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Instance destroyed successfully.
Aug 22 03:17:31 user nova-compute[73469]: DEBUG nova.objects.instance [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'resources' on Instance uuid 2aa3779f-687f-414a-a31a-5e0f0b6a882f {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:17:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2061992407',display_name='tempest-AttachVolumeNegativeTest-server-2061992407',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2061992407',id=39,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLC7d912/654chy+SUQJV4TiT2m//pIOzUjAv6mEl83v8BJRMNuQeYSNnYiT6SOq/Y2qMG14kzxZktrsp5PRfWWh8uFFEzWcBKVnHGcqg5/vEmdRsbrOB0QBtXa/+HGFKg==',key_name='tempest-keypair-1058505087',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:14:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab150042073d4977b15414a3062d82fd',ramdisk_id='',reservation_id='r-qovfy0v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-356032718',owner_user_name='tempest-AttachVolumeNegativeTest-356032718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:14:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25b830ec1451440f911d6578c8c55f3d',uuid=2aa3779f-687f-414a-a31a-5e0f0b6a882f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "address": "fa:16:3e:4b:ed:38", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063bed8-22", "ovs_interfaceid": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:17:31 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converting VIF {"id": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "address": "fa:16:3e:4b:ed:38", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063bed8-22", "ovs_interfaceid": "6063bed8-22e5-4bf6-bcde-7628261ffd68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:17:31 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:ed:38,bridge_name='br-int',has_traffic_filtering=True,id=6063bed8-22e5-4bf6-bcde-7628261ffd68,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6063bed8-22') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:17:31 user nova-compute[73469]: DEBUG os_vif [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:ed:38,bridge_name='br-int',has_traffic_filtering=True,id=6063bed8-22e5-4bf6-bcde-7628261ffd68,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6063bed8-22') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:17:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6063bed8-22, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:17:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:17:31 user nova-compute[73469]: INFO os_vif [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:ed:38,bridge_name='br-int',has_traffic_filtering=True,id=6063bed8-22e5-4bf6-bcde-7628261ffd68,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6063bed8-22')
Aug 22 03:17:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Deleting instance files /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f_del
Aug 22 03:17:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Deletion of /opt/stack/data/nova/instances/2aa3779f-687f-414a-a31a-5e0f0b6a882f_del complete
Aug 22 03:17:31 user nova-compute[73469]: INFO nova.compute.manager [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 22 03:17:31 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:17:31 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:17:31 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:17:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:32 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:17:32 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Took 1.02 seconds to deallocate network for instance.
Aug 22 03:17:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:17:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:17:32 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:17:32 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:17:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:17:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-d94d71d1-c224-48c9-bf88-a4ccc9d304fc req-acbbcffb-1e97-42f7-8c8a-d78377db0d1e service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Received event network-vif-plugged-6063bed8-22e5-4bf6-bcde-7628261ffd68 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:17:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d94d71d1-c224-48c9-bf88-a4ccc9d304fc req-acbbcffb-1e97-42f7-8c8a-d78377db0d1e service nova] Acquiring lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:17:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d94d71d1-c224-48c9-bf88-a4ccc9d304fc req-acbbcffb-1e97-42f7-8c8a-d78377db0d1e service nova] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:17:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d94d71d1-c224-48c9-bf88-a4ccc9d304fc req-acbbcffb-1e97-42f7-8c8a-d78377db0d1e service nova] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:17:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-d94d71d1-c224-48c9-bf88-a4ccc9d304fc req-acbbcffb-1e97-42f7-8c8a-d78377db0d1e service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] No waiting events found dispatching network-vif-plugged-6063bed8-22e5-4bf6-bcde-7628261ffd68 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:17:32 user nova-compute[73469]: WARNING nova.compute.manager [req-d94d71d1-c224-48c9-bf88-a4ccc9d304fc req-acbbcffb-1e97-42f7-8c8a-d78377db0d1e service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Received unexpected event network-vif-plugged-6063bed8-22e5-4bf6-bcde-7628261ffd68 for instance with vm_state deleted and task_state None.
Aug 22 03:17:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-d94d71d1-c224-48c9-bf88-a4ccc9d304fc req-acbbcffb-1e97-42f7-8c8a-d78377db0d1e service nova] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Received event network-vif-deleted-6063bed8-22e5-4bf6-bcde-7628261ffd68 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:17:32 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Deleted allocations for instance 2aa3779f-687f-414a-a31a-5e0f0b6a882f
Aug 22 03:17:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-e4907349-ac0c-434b-b93d-3c6ebba48b3b tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "2aa3779f-687f-414a-a31a-5e0f0b6a882f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.476s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:17:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:17:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:17:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "a0e6ef45-c52c-4b08-8541-24375cf34af1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:17:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:17:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:17:35 user nova-compute[73469]: INFO nova.compute.manager [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Terminating instance
Aug 22 03:17:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:17:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-679eaa5c-9aaa-4700-8736-97d2751a4b0e req-241e61db-c9c3-46b3-91b8-dcda2020019f service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Received event network-vif-unplugged-e7947445-5f12-4c43-a8c4-21c202aa5c99 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-679eaa5c-9aaa-4700-8736-97d2751a4b0e req-241e61db-c9c3-46b3-91b8-dcda2020019f service nova] Acquiring lock "a0e6ef45-c52c-4b08-8541-24375cf34af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-679eaa5c-9aaa-4700-8736-97d2751a4b0e req-241e61db-c9c3-46b3-91b8-dcda2020019f service nova] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-679eaa5c-9aaa-4700-8736-97d2751a4b0e req-241e61db-c9c3-46b3-91b8-dcda2020019f service nova] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-679eaa5c-9aaa-4700-8736-97d2751a4b0e req-241e61db-c9c3-46b3-91b8-dcda2020019f service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] No waiting events found dispatching network-vif-unplugged-e7947445-5f12-4c43-a8c4-21c202aa5c99 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-679eaa5c-9aaa-4700-8736-97d2751a4b0e req-241e61db-c9c3-46b3-91b8-dcda2020019f service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Received event network-vif-unplugged-e7947445-5f12-4c43-a8c4-21c202aa5c99 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:36 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Instance destroyed successfully.
Aug 22 03:17:36 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lazy-loading 'resources' on Instance uuid a0e6ef45-c52c-4b08-8541-24375cf34af1 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:13:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-257607089',display_name='tempest-TestServerVolumeAttachmentScenario-server-257607089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-257607089',id=38,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKp3HPhvMrkpv+qCjNg2ZHrujFsFAXzrDT/zGAD5/Sjj6zbsN8iQYXHMVoqwSZ2FfPB/IGvs8jhN89Id+Dve9v2c8X6Syow+l5t5+IoBEOnaZTUf2IPTwC22xfLj1FyFbA==',key_name='tempest-keypair-1015068162',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:13:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d94885e479743cfa031cb6d9ecff20d',ramdisk_id='',reservation_id='r-jdpur6ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-899685905',owner_user_name='tempest-TestServerVolumeAttachmentScenario-899685905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:13:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d28ae61412174d8eb44ce47db982482b',uuid=a0e6ef45-c52c-4b08-8541-24375cf34af1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "address": "fa:16:3e:da:f7:e9", "network": {"id": "eb8cebc6-eef2-44f3-8cd2-de7239131b70", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1082345691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d94885e479743cfa031cb6d9ecff20d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947445-5f", "ovs_interfaceid": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Converting VIF {"id": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "address": "fa:16:3e:da:f7:e9", "network": {"id": "eb8cebc6-eef2-44f3-8cd2-de7239131b70", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1082345691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d94885e479743cfa031cb6d9ecff20d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947445-5f", "ovs_interfaceid": "e7947445-5f12-4c43-a8c4-21c202aa5c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:f7:e9,bridge_name='br-int',has_traffic_filtering=True,id=e7947445-5f12-4c43-a8c4-21c202aa5c99,network=Network(eb8cebc6-eef2-44f3-8cd2-de7239131b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7947445-5f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG os_vif [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:f7:e9,bridge_name='br-int',has_traffic_filtering=True,id=e7947445-5f12-4c43-a8c4-21c202aa5c99,network=Network(eb8cebc6-eef2-44f3-8cd2-de7239131b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7947445-5f') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7947445-5f, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:17:36 user nova-compute[73469]: INFO os_vif [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:f7:e9,bridge_name='br-int',has_traffic_filtering=True,id=e7947445-5f12-4c43-a8c4-21c202aa5c99,network=Network(eb8cebc6-eef2-44f3-8cd2-de7239131b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7947445-5f')
Aug 22 03:17:36 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Deleting instance files /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1_del
Aug 22 03:17:36 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Deletion of /opt/stack/data/nova/instances/a0e6ef45-c52c-4b08-8541-24375cf34af1_del complete
Aug 22 03:17:36 user nova-compute[73469]: INFO nova.compute.manager [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 22 03:17:36 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:17:36 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:17:37 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:17:37 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Took 0.87 seconds to deallocate network for instance.
Aug 22 03:17:37 user nova-compute[73469]: DEBUG nova.compute.manager [req-25eab991-e4fb-435e-a0f4-ff4644f7f26b req-818e86c0-f7ea-4586-8fad-dc7bf856448f service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Received event network-vif-deleted-e7947445-5f12-4c43-a8c4-21c202aa5c99 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:17:37 user nova-compute[73469]: INFO nova.compute.manager [req-25eab991-e4fb-435e-a0f4-ff4644f7f26b req-818e86c0-f7ea-4586-8fad-dc7bf856448f service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Neutron deleted interface e7947445-5f12-4c43-a8c4-21c202aa5c99; detaching it from the instance and deleting it from the info cache
Aug 22 03:17:37 user nova-compute[73469]: DEBUG nova.network.neutron [req-25eab991-e4fb-435e-a0f4-ff4644f7f26b req-818e86c0-f7ea-4586-8fad-dc7bf856448f service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:17:37 user nova-compute[73469]: DEBUG nova.compute.manager [req-25eab991-e4fb-435e-a0f4-ff4644f7f26b req-818e86c0-f7ea-4586-8fad-dc7bf856448f service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Detach interface failed, port_id=e7947445-5f12-4c43-a8c4-21c202aa5c99, reason: Instance a0e6ef45-c52c-4b08-8541-24375cf34af1 could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 03:17:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:17:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:17:37 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:17:37 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:17:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:17:37 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Deleted allocations for instance a0e6ef45-c52c-4b08-8541-24375cf34af1
Aug 22 03:17:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2a8470d-a81f-4412-9b5e-1071464c14e1 tempest-TestServerVolumeAttachmentScenario-899685905 tempest-TestServerVolumeAttachmentScenario-899685905-project-member] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.198s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:17:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-9241ae11-9797-48d9-af77-57f780a4f217 req-bf0f13e1-7756-4e59-94d1-f224c959c84a service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Received event network-vif-plugged-e7947445-5f12-4c43-a8c4-21c202aa5c99 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:17:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9241ae11-9797-48d9-af77-57f780a4f217 req-bf0f13e1-7756-4e59-94d1-f224c959c84a service nova] Acquiring lock "a0e6ef45-c52c-4b08-8541-24375cf34af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:17:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9241ae11-9797-48d9-af77-57f780a4f217 req-bf0f13e1-7756-4e59-94d1-f224c959c84a service nova] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:17:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9241ae11-9797-48d9-af77-57f780a4f217 req-bf0f13e1-7756-4e59-94d1-f224c959c84a service nova] Lock "a0e6ef45-c52c-4b08-8541-24375cf34af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:17:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-9241ae11-9797-48d9-af77-57f780a4f217 req-bf0f13e1-7756-4e59-94d1-f224c959c84a service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] No waiting events found dispatching network-vif-plugged-e7947445-5f12-4c43-a8c4-21c202aa5c99 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:17:38 user nova-compute[73469]: WARNING nova.compute.manager [req-9241ae11-9797-48d9-af77-57f780a4f217 req-bf0f13e1-7756-4e59-94d1-f224c959c84a service nova] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Received unexpected event network-vif-plugged-e7947445-5f12-4c43-a8c4-21c202aa5c99 for instance with vm_state deleted and task_state None.
Aug 22 03:17:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:46 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692674251.3316226, 2aa3779f-687f-414a-a31a-5e0f0b6a882f => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:17:46 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] VM Stopped (Lifecycle Event)
Aug 22 03:17:46 user nova-compute[73469]: DEBUG nova.compute.manager [None req-96d1adef-61a9-48d4-9c37-4e8c86a1a958 None None] [instance: 2aa3779f-687f-414a-a31a-5e0f0b6a882f] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:17:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:51 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692674256.482089, a0e6ef45-c52c-4b08-8541-24375cf34af1 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:17:51 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] VM Stopped (Lifecycle Event)
Aug 22 03:17:51 user nova-compute[73469]: DEBUG nova.compute.manager [None req-402675fb-025f-45db-97af-61786d14fee3 None None] [instance: a0e6ef45-c52c-4b08-8541-24375cf34af1] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:17:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:17:53 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:17:54 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:17:55 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:17:55 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:17:55 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:17:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:17:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:17:55 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:17:55 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid 82e872a7-70b0-4290-9a11-5316765aed01 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:17:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:17:56 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Updating instance_info_cache with network_info: [{"id": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "address": "fa:16:3e:0d:d7:78", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ca747b-f8", "ovs_interfaceid": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:17:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-82e872a7-70b0-4290-9a11-5316765aed01" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:17:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:17:56 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:17:57 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:17:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:17:59 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:17:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:17:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:17:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:17:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:17:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:17:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:17:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:17:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:17:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:17:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:00 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:18:00 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:18:00 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8358MB free_disk=25.220203399658203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:18:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:18:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:18:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 82e872a7-70b0-4290-9a11-5316765aed01 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:18:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 1d2fe450-442f-4722-b187-2f75655c2b52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:18:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:18:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:18:01 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:18:01 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:18:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:18:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:18:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:02 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:18:03 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:18:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "82e872a7-70b0-4290-9a11-5316765aed01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:18:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "82e872a7-70b0-4290-9a11-5316765aed01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:18:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "82e872a7-70b0-4290-9a11-5316765aed01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:18:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "82e872a7-70b0-4290-9a11-5316765aed01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:18:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "82e872a7-70b0-4290-9a11-5316765aed01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:18:11 user nova-compute[73469]: INFO nova.compute.manager [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Terminating instance
Aug 22 03:18:11 user nova-compute[73469]: DEBUG nova.compute.manager [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:18:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:11 user nova-compute[73469]: DEBUG nova.compute.manager [req-ca0954dc-9ae1-43b6-bccd-6446e2cfe55c req-eb00bfc8-fa0a-4af4-9f50-9c7066204d79 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Received event network-vif-unplugged-78ca747b-f8a3-4bde-8c6d-bfd860eca41b {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:18:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ca0954dc-9ae1-43b6-bccd-6446e2cfe55c req-eb00bfc8-fa0a-4af4-9f50-9c7066204d79 service nova] Acquiring lock "82e872a7-70b0-4290-9a11-5316765aed01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:18:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ca0954dc-9ae1-43b6-bccd-6446e2cfe55c req-eb00bfc8-fa0a-4af4-9f50-9c7066204d79 service nova] Lock "82e872a7-70b0-4290-9a11-5316765aed01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:18:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ca0954dc-9ae1-43b6-bccd-6446e2cfe55c req-eb00bfc8-fa0a-4af4-9f50-9c7066204d79 service nova] Lock "82e872a7-70b0-4290-9a11-5316765aed01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:18:11 user nova-compute[73469]: DEBUG nova.compute.manager [req-ca0954dc-9ae1-43b6-bccd-6446e2cfe55c req-eb00bfc8-fa0a-4af4-9f50-9c7066204d79 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] No waiting events found dispatching network-vif-unplugged-78ca747b-f8a3-4bde-8c6d-bfd860eca41b {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:18:11 user nova-compute[73469]: DEBUG nova.compute.manager [req-ca0954dc-9ae1-43b6-bccd-6446e2cfe55c req-eb00bfc8-fa0a-4af4-9f50-9c7066204d79 service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Received event network-vif-unplugged-78ca747b-f8a3-4bde-8c6d-bfd860eca41b for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:18:12 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Instance destroyed successfully.
Aug 22 03:18:12 user nova-compute[73469]: DEBUG nova.objects.instance [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lazy-loading 'resources' on Instance uuid 82e872a7-70b0-4290-9a11-5316765aed01 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:18:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T02:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-692250773',display_name='tempest-ServerActionsTestOtherA-server-692250773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-692250773',id=20,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqna53ychrrpICcXpgxhDHdrzJyFFu88HUxTxIQK5z+xOZfcw7kHrC8QJBeI4lEfQOxVPYITpSoaAG4B9QNlgmIHoEX0gtT1wKkQ7bp7nCHyaP40f+//buUPKlKHlWXEA==',key_name='tempest-keypair-651522654',keypairs=<?>,launch_index=0,launched_at=2023-08-22T02:59:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d1c312e979e47558b06d4fa70bc103a',ramdisk_id='',reservation_id='r-ovyefov7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1751677379',owner_user_name='tempest-ServerActionsTestOtherA-1751677379-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T02:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b47d6cefd0d4949bf4c3c0fc72a9cd5',uuid=82e872a7-70b0-4290-9a11-5316765aed01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "address": "fa:16:3e:0d:d7:78", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ca747b-f8", "ovs_interfaceid": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:18:12 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converting VIF {"id": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "address": "fa:16:3e:0d:d7:78", "network": {"id": "437e17a9-fc09-45c3-8979-05f4d168d323", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-357776005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d1c312e979e47558b06d4fa70bc103a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ca747b-f8", "ovs_interfaceid": "78ca747b-f8a3-4bde-8c6d-bfd860eca41b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:18:12 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:d7:78,bridge_name='br-int',has_traffic_filtering=True,id=78ca747b-f8a3-4bde-8c6d-bfd860eca41b,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ca747b-f8') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:18:12 user nova-compute[73469]: DEBUG os_vif [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:d7:78,bridge_name='br-int',has_traffic_filtering=True,id=78ca747b-f8a3-4bde-8c6d-bfd860eca41b,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ca747b-f8') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:18:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78ca747b-f8, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:18:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:18:12 user nova-compute[73469]: INFO os_vif [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:d7:78,bridge_name='br-int',has_traffic_filtering=True,id=78ca747b-f8a3-4bde-8c6d-bfd860eca41b,network=Network(437e17a9-fc09-45c3-8979-05f4d168d323),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ca747b-f8')
Aug 22 03:18:12 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Deleting instance files /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01_del
Aug 22 03:18:12 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Deletion of /opt/stack/data/nova/instances/82e872a7-70b0-4290-9a11-5316765aed01_del complete
Aug 22 03:18:12 user nova-compute[73469]: INFO nova.compute.manager [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 22 03:18:12 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:18:12 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:18:12 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:18:12 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:18:12 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Took 0.46 seconds to deallocate network for instance.
Aug 22 03:18:12 user nova-compute[73469]: DEBUG nova.compute.manager [req-119bb220-c2e8-441d-af93-179ef8b82937 req-24a6fe63-2f99-4ce4-b4e0-835d115adbaa service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Received event network-vif-deleted-78ca747b-f8a3-4bde-8c6d-bfd860eca41b {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:18:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:18:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:18:13 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:18:13 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:18:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:18:13 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Deleted allocations for instance 82e872a7-70b0-4290-9a11-5316765aed01
Aug 22 03:18:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-95c15ea7-cde0-42f2-a084-f70ccedc5662 tempest-ServerActionsTestOtherA-1751677379 tempest-ServerActionsTestOtherA-1751677379-project-member] Lock "82e872a7-70b0-4290-9a11-5316765aed01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.781s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:18:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-ef1ddc1c-9670-4199-83b9-26c9f4b1094a req-c1184aca-db14-46a6-a9db-e98176b1f9dc service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Received event network-vif-plugged-78ca747b-f8a3-4bde-8c6d-bfd860eca41b {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:18:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ef1ddc1c-9670-4199-83b9-26c9f4b1094a req-c1184aca-db14-46a6-a9db-e98176b1f9dc service nova] Acquiring lock "82e872a7-70b0-4290-9a11-5316765aed01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:18:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ef1ddc1c-9670-4199-83b9-26c9f4b1094a req-c1184aca-db14-46a6-a9db-e98176b1f9dc service nova] Lock "82e872a7-70b0-4290-9a11-5316765aed01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:18:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ef1ddc1c-9670-4199-83b9-26c9f4b1094a req-c1184aca-db14-46a6-a9db-e98176b1f9dc service nova] Lock "82e872a7-70b0-4290-9a11-5316765aed01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:18:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-ef1ddc1c-9670-4199-83b9-26c9f4b1094a req-c1184aca-db14-46a6-a9db-e98176b1f9dc service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] No waiting events found dispatching network-vif-plugged-78ca747b-f8a3-4bde-8c6d-bfd860eca41b {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:18:13 user nova-compute[73469]: WARNING nova.compute.manager [req-ef1ddc1c-9670-4199-83b9-26c9f4b1094a req-c1184aca-db14-46a6-a9db-e98176b1f9dc service nova] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Received unexpected event network-vif-plugged-78ca747b-f8a3-4bde-8c6d-bfd860eca41b for instance with vm_state deleted and task_state None.
Aug 22 03:18:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:18:25 user nova-compute[73469]: INFO nova.compute.claims [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Claim successful on node user
Aug 22 03:18:25 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG nova.network.neutron [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:18:25 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:18:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG nova.policy [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25b830ec1451440f911d6578c8c55f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab150042073d4977b15414a3062d82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:18:25 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Creating image(s)
Aug 22 03:18:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "/opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "/opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "/opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.193s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:18:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk 1073741824" returned: 0 in 0.062s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:18:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.183s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:26 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:18:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:26 user nova-compute[73469]: DEBUG nova.network.neutron [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Successfully created port: 471ddb2d-7086-42f3-ab67-6a08a38d0585 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:18:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:26 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Cannot resize image /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:18:26 user nova-compute[73469]: DEBUG nova.objects.instance [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'migration_context' on Instance uuid b01e4c17-2e37-4c89-9827-4d89f4a0b8ad {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:18:26 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:18:26 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Ensure instance console log exists: /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:18:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:18:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:18:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692674292.3361254, 82e872a7-70b0-4290-9a11-5316765aed01 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:18:27 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] VM Stopped (Lifecycle Event)
Aug 22 03:18:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.network.neutron [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Successfully updated port: 471ddb2d-7086-42f3-ab67-6a08a38d0585 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e5d6f997-1575-482f-8436-696ae33bbc0a None None] [instance: 82e872a7-70b0-4290-9a11-5316765aed01] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "refresh_cache-b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquired lock "refresh_cache-b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.network.neutron [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-fcae196a-4db7-4e2f-9bd8-0406600015ff req-1a5c90f5-2c47-41bb-9dde-6311a83883fd service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Received event network-changed-471ddb2d-7086-42f3-ab67-6a08a38d0585 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-fcae196a-4db7-4e2f-9bd8-0406600015ff req-1a5c90f5-2c47-41bb-9dde-6311a83883fd service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Refreshing instance network info cache due to event network-changed-471ddb2d-7086-42f3-ab67-6a08a38d0585. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fcae196a-4db7-4e2f-9bd8-0406600015ff req-1a5c90f5-2c47-41bb-9dde-6311a83883fd service nova] Acquiring lock "refresh_cache-b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.network.neutron [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.network.neutron [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Updating instance_info_cache with network_info: [{"id": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "address": "fa:16:3e:68:31:19", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ddb2d-70", "ovs_interfaceid": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Releasing lock "refresh_cache-b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Instance network_info: |[{"id": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "address": "fa:16:3e:68:31:19", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ddb2d-70", "ovs_interfaceid": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fcae196a-4db7-4e2f-9bd8-0406600015ff req-1a5c90f5-2c47-41bb-9dde-6311a83883fd service nova] Acquired lock "refresh_cache-b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.network.neutron [req-fcae196a-4db7-4e2f-9bd8-0406600015ff req-1a5c90f5-2c47-41bb-9dde-6311a83883fd service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Refreshing network info cache for port 471ddb2d-7086-42f3-ab67-6a08a38d0585 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Start _get_guest_xml network_info=[{"id": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "address": "fa:16:3e:68:31:19", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ddb2d-70", "ovs_interfaceid": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:18:27 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:18:27 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:18:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-897364723',display_name='tempest-AttachVolumeNegativeTest-server-897364723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-897364723',id=41,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBwJrX9Ku/2C3IIx62t6RzPvda/207lPihK6pdddLjuut+hdp+3C2rR5gUBEiDAEX8SHQRjZ421wOvzH6N3XVGqrm822n5sughxmJXPMWjmbxMKjI937F873qaKgXYMyg==',key_name='tempest-keypair-9834392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab150042073d4977b15414a3062d82fd',ramdisk_id='',reservation_id='r-blt4fg20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-356032718',owner_user_name='tempest-AttachVolumeNegativeTest-356032718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25b830ec1451440f911d6578c8c55f3d',uuid=b01e4c17-2e37-4c89-9827-4d89f4a0b8ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "address": "fa:16:3e:68:31:19", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ddb2d-70", "ovs_interfaceid": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converting VIF {"id": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "address": "fa:16:3e:68:31:19", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ddb2d-70", "ovs_interfaceid": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:31:19,bridge_name='br-int',has_traffic_filtering=True,id=471ddb2d-7086-42f3-ab67-6a08a38d0585,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ddb2d-70') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.objects.instance [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'pci_devices' on Instance uuid b01e4c17-2e37-4c89-9827-4d89f4a0b8ad {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:18:27 user nova-compute[73469]:   <uuid>b01e4c17-2e37-4c89-9827-4d89f4a0b8ad</uuid>
Aug 22 03:18:27 user nova-compute[73469]:   <name>instance-00000029</name>
Aug 22 03:18:27 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:18:27 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:18:27 user nova-compute[73469]:   <metadata>
Aug 22 03:18:27 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:18:27 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:18:27 user nova-compute[73469]:       <nova:name>tempest-AttachVolumeNegativeTest-server-897364723</nova:name>
Aug 22 03:18:27 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:18:27</nova:creationTime>
Aug 22 03:18:27 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:18:27 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:18:27 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:18:27 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:18:27 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:18:27 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:18:27 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:18:27 user nova-compute[73469]:       <nova:owner>
Aug 22 03:18:27 user nova-compute[73469]:         <nova:user uuid="25b830ec1451440f911d6578c8c55f3d">tempest-AttachVolumeNegativeTest-356032718-project-member</nova:user>
Aug 22 03:18:27 user nova-compute[73469]:         <nova:project uuid="ab150042073d4977b15414a3062d82fd">tempest-AttachVolumeNegativeTest-356032718</nova:project>
Aug 22 03:18:27 user nova-compute[73469]:       </nova:owner>
Aug 22 03:18:27 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:18:27 user nova-compute[73469]:       <nova:ports>
Aug 22 03:18:27 user nova-compute[73469]:         <nova:port uuid="471ddb2d-7086-42f3-ab67-6a08a38d0585">
Aug 22 03:18:27 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 22 03:18:27 user nova-compute[73469]:         </nova:port>
Aug 22 03:18:27 user nova-compute[73469]:       </nova:ports>
Aug 22 03:18:27 user nova-compute[73469]:     </nova:instance>
Aug 22 03:18:27 user nova-compute[73469]:   </metadata>
Aug 22 03:18:27 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:18:27 user nova-compute[73469]:     <system>
Aug 22 03:18:27 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:18:27 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:18:27 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:18:27 user nova-compute[73469]:       <entry name="serial">b01e4c17-2e37-4c89-9827-4d89f4a0b8ad</entry>
Aug 22 03:18:27 user nova-compute[73469]:       <entry name="uuid">b01e4c17-2e37-4c89-9827-4d89f4a0b8ad</entry>
Aug 22 03:18:27 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:18:27 user nova-compute[73469]:     </system>
Aug 22 03:18:27 user nova-compute[73469]:   </sysinfo>
Aug 22 03:18:27 user nova-compute[73469]:   <os>
Aug 22 03:18:27 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:18:27 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:18:27 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:18:27 user nova-compute[73469]:   </os>
Aug 22 03:18:27 user nova-compute[73469]:   <features>
Aug 22 03:18:27 user nova-compute[73469]:     <acpi/>
Aug 22 03:18:27 user nova-compute[73469]:     <apic/>
Aug 22 03:18:27 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:18:27 user nova-compute[73469]:   </features>
Aug 22 03:18:27 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:18:27 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:18:27 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:18:27 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:18:27 user nova-compute[73469]:   </clock>
Aug 22 03:18:27 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:18:27 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:18:27 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:18:27 user nova-compute[73469]:   </cpu>
Aug 22 03:18:27 user nova-compute[73469]:   <devices>
Aug 22 03:18:27 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:18:27 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:18:27 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk"/>
Aug 22 03:18:27 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:18:27 user nova-compute[73469]:     </disk>
Aug 22 03:18:27 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:18:27 user nova-compute[73469]:       <mac address="fa:16:3e:68:31:19"/>
Aug 22 03:18:27 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:18:27 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:18:27 user nova-compute[73469]:       <target dev="tap471ddb2d-70"/>
Aug 22 03:18:27 user nova-compute[73469]:     </interface>
Aug 22 03:18:27 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:18:27 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/console.log" append="off"/>
Aug 22 03:18:27 user nova-compute[73469]:     </serial>
Aug 22 03:18:27 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:18:27 user nova-compute[73469]:     <video>
Aug 22 03:18:27 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:18:27 user nova-compute[73469]:     </video>
Aug 22 03:18:27 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:18:27 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:18:27 user nova-compute[73469]:     </rng>
Aug 22 03:18:27 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:18:27 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:18:27 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:18:27 user nova-compute[73469]:     </memballoon>
Aug 22 03:18:27 user nova-compute[73469]:   </devices>
Aug 22 03:18:27 user nova-compute[73469]: </domain>
Aug 22 03:18:27 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:18:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-897364723',display_name='tempest-AttachVolumeNegativeTest-server-897364723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-897364723',id=41,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBwJrX9Ku/2C3IIx62t6RzPvda/207lPihK6pdddLjuut+hdp+3C2rR5gUBEiDAEX8SHQRjZ421wOvzH6N3XVGqrm822n5sughxmJXPMWjmbxMKjI937F873qaKgXYMyg==',key_name='tempest-keypair-9834392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab150042073d4977b15414a3062d82fd',ramdisk_id='',reservation_id='r-blt4fg20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-356032718',owner_user_name='tempest-AttachVolumeNegativeTest-356032718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25b830ec1451440f911d6578c8c55f3d',uuid=b01e4c17-2e37-4c89-9827-4d89f4a0b8ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "address": "fa:16:3e:68:31:19", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ddb2d-70", "ovs_interfaceid": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converting VIF {"id": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "address": "fa:16:3e:68:31:19", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ddb2d-70", "ovs_interfaceid": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:31:19,bridge_name='br-int',has_traffic_filtering=True,id=471ddb2d-7086-42f3-ab67-6a08a38d0585,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ddb2d-70') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG os_vif [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:31:19,bridge_name='br-int',has_traffic_filtering=True,id=471ddb2d-7086-42f3-ab67-6a08a38d0585,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ddb2d-70') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap471ddb2d-70, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap471ddb2d-70, col_values=(('external_ids', {'iface-id': '471ddb2d-7086-42f3-ab67-6a08a38d0585', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:31:19', 'vm-uuid': 'b01e4c17-2e37-4c89-9827-4d89f4a0b8ad'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:18:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:27 user nova-compute[73469]: INFO os_vif [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:31:19,bridge_name='br-int',has_traffic_filtering=True,id=471ddb2d-7086-42f3-ab67-6a08a38d0585,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ddb2d-70')
Aug 22 03:18:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:18:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] No VIF found with MAC fa:16:3e:68:31:19, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:18:28 user nova-compute[73469]: DEBUG nova.network.neutron [req-fcae196a-4db7-4e2f-9bd8-0406600015ff req-1a5c90f5-2c47-41bb-9dde-6311a83883fd service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Updated VIF entry in instance network info cache for port 471ddb2d-7086-42f3-ab67-6a08a38d0585. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:18:28 user nova-compute[73469]: DEBUG nova.network.neutron [req-fcae196a-4db7-4e2f-9bd8-0406600015ff req-1a5c90f5-2c47-41bb-9dde-6311a83883fd service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Updating instance_info_cache with network_info: [{"id": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "address": "fa:16:3e:68:31:19", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ddb2d-70", "ovs_interfaceid": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:18:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-fcae196a-4db7-4e2f-9bd8-0406600015ff req-1a5c90f5-2c47-41bb-9dde-6311a83883fd service nova] Releasing lock "refresh_cache-b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:18:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:29 user nova-compute[73469]: DEBUG nova.compute.manager [req-6884ae1a-899e-40be-bde4-bbe668234b2c req-8c4dc5cc-5345-4719-953b-71c4bb1232b3 service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Received event network-vif-plugged-471ddb2d-7086-42f3-ab67-6a08a38d0585 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:18:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6884ae1a-899e-40be-bde4-bbe668234b2c req-8c4dc5cc-5345-4719-953b-71c4bb1232b3 service nova] Acquiring lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:18:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6884ae1a-899e-40be-bde4-bbe668234b2c req-8c4dc5cc-5345-4719-953b-71c4bb1232b3 service nova] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:18:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6884ae1a-899e-40be-bde4-bbe668234b2c req-8c4dc5cc-5345-4719-953b-71c4bb1232b3 service nova] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:18:29 user nova-compute[73469]: DEBUG nova.compute.manager [req-6884ae1a-899e-40be-bde4-bbe668234b2c req-8c4dc5cc-5345-4719-953b-71c4bb1232b3 service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] No waiting events found dispatching network-vif-plugged-471ddb2d-7086-42f3-ab67-6a08a38d0585 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:18:29 user nova-compute[73469]: WARNING nova.compute.manager [req-6884ae1a-899e-40be-bde4-bbe668234b2c req-8c4dc5cc-5345-4719-953b-71c4bb1232b3 service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Received unexpected event network-vif-plugged-471ddb2d-7086-42f3-ab67-6a08a38d0585 for instance with vm_state building and task_state spawning.
Aug 22 03:18:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:31 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674311.5786068, b01e4c17-2e37-4c89-9827-4d89f4a0b8ad => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:18:31 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] VM Resumed (Lifecycle Event)
Aug 22 03:18:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:18:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:18:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Instance spawned successfully.
Aug 22 03:18:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:18:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:18:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:18:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:18:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:18:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:18:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:18:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:18:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:18:31 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:18:31 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674311.5867078, b01e4c17-2e37-4c89-9827-4d89f4a0b8ad => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:18:31 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] VM Started (Lifecycle Event)
Aug 22 03:18:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:18:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:18:31 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:18:31 user nova-compute[73469]: DEBUG nova.compute.manager [req-5166c687-0888-4ac3-bd87-a25c3625af88 req-ee0aff73-8a33-4192-820d-c9851b82dbb0 service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Received event network-vif-plugged-471ddb2d-7086-42f3-ab67-6a08a38d0585 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:18:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5166c687-0888-4ac3-bd87-a25c3625af88 req-ee0aff73-8a33-4192-820d-c9851b82dbb0 service nova] Acquiring lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:18:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5166c687-0888-4ac3-bd87-a25c3625af88 req-ee0aff73-8a33-4192-820d-c9851b82dbb0 service nova] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:18:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5166c687-0888-4ac3-bd87-a25c3625af88 req-ee0aff73-8a33-4192-820d-c9851b82dbb0 service nova] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:18:31 user nova-compute[73469]: DEBUG nova.compute.manager [req-5166c687-0888-4ac3-bd87-a25c3625af88 req-ee0aff73-8a33-4192-820d-c9851b82dbb0 service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] No waiting events found dispatching network-vif-plugged-471ddb2d-7086-42f3-ab67-6a08a38d0585 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:18:31 user nova-compute[73469]: WARNING nova.compute.manager [req-5166c687-0888-4ac3-bd87-a25c3625af88 req-ee0aff73-8a33-4192-820d-c9851b82dbb0 service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Received unexpected event network-vif-plugged-471ddb2d-7086-42f3-ab67-6a08a38d0585 for instance with vm_state building and task_state spawning.
Aug 22 03:18:31 user nova-compute[73469]: INFO nova.compute.manager [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Took 6.08 seconds to spawn the instance on the hypervisor.
Aug 22 03:18:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:18:31 user nova-compute[73469]: INFO nova.compute.manager [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Took 6.78 seconds to build instance.
Aug 22 03:18:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-620bb103-65de-4d81-83bd-e13680b5cd35 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.879s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:18:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:18:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:18:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:18:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:18:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-987bb31e-0377-4d36-96bf-96482608bdb0 req-63a444b0-c772-4121-8cc7-9fe1b9919e5b service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Received event network-changed-6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-987bb31e-0377-4d36-96bf-96482608bdb0 req-63a444b0-c772-4121-8cc7-9fe1b9919e5b service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Refreshing instance network info cache due to event network-changed-6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-987bb31e-0377-4d36-96bf-96482608bdb0 req-63a444b0-c772-4121-8cc7-9fe1b9919e5b service nova] Acquiring lock "refresh_cache-1d2fe450-442f-4722-b187-2f75655c2b52" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-987bb31e-0377-4d36-96bf-96482608bdb0 req-63a444b0-c772-4121-8cc7-9fe1b9919e5b service nova] Acquired lock "refresh_cache-1d2fe450-442f-4722-b187-2f75655c2b52" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG nova.network.neutron [req-987bb31e-0377-4d36-96bf-96482608bdb0 req-63a444b0-c772-4121-8cc7-9fe1b9919e5b service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Refreshing network info cache for port 6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "1d2fe450-442f-4722-b187-2f75655c2b52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1d2fe450-442f-4722-b187-2f75655c2b52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG nova.objects.instance [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lazy-loading 'flavor' on Instance uuid 1d2fe450-442f-4722-b187-2f75655c2b52 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:18:45 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Ignoring supplied device name: /dev/vdb
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1d2fe450-442f-4722-b187-2f75655c2b52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "1d2fe450-442f-4722-b187-2f75655c2b52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1d2fe450-442f-4722-b187-2f75655c2b52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:18:45 user nova-compute[73469]: INFO nova.compute.manager [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Attaching volume 7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 to /dev/vdb
Aug 22 03:18:45 user nova-compute[73469]: DEBUG os_brick.utils [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG nova.network.neutron [req-987bb31e-0377-4d36-96bf-96482608bdb0 req-63a444b0-c772-4121-8cc7-9fe1b9919e5b service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Updated VIF entry in instance network info cache for port 6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG nova.network.neutron [req-987bb31e-0377-4d36-96bf-96482608bdb0 req-63a444b0-c772-4121-8cc7-9fe1b9919e5b service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Updating instance_info_cache with network_info: [{"id": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "address": "fa:16:3e:b3:2e:19", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3a0bc-eb", "ovs_interfaceid": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ad26eb-d105-4a6e-bf8c-99fd59daa284]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-987bb31e-0377-4d36-96bf-96482608bdb0 req-63a444b0-c772-4121-8cc7-9fe1b9919e5b service nova] Releasing lock "refresh_cache-1d2fe450-442f-4722-b187-2f75655c2b52" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3913fc4-6635-4a64-b4c1-200a0afb85e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daa22a3-2819-4cff-913c-6158aabb4e6b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[06904dde-dfe4-434c-b6b9-5762574aae4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:18:45 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:18:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7aea07e-b4d5-4de9-afcc-a1fd83bb30b9]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG os_brick.utils [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:18:45 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Updating existing volume attachment record: 74dc1593-860e-42ff-9fc8-cd5973b69973 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:18:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:50 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:18:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:55 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:18:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-1d2fe450-442f-4722-b187-2f75655c2b52" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-1d2fe450-442f-4722-b187-2f75655c2b52" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUFyDfQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:18:56 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:18:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:18:56 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:18:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:18:56 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:18:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b4c04d-0dad-4155-ba82-8cf76e421324]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:18:56 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f4fac3-be04-4226-93f0-8b4d0ed463ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5] added
Aug 22 03:18:56 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0629c292-2537-400d-bb6b-4eb8195750a7]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcb99b5-a89a-4a9b-8893-0ad1208996fc]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:18:56 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aUFyDfQT {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aUFyDfQT" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb8f159-5f7a-4b33-aaa8-8077bab4d8d7]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aUFyDfQT'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0911740c-e0c0-4fc3-94f0-57eba243f86c]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93512ac-b8d8-4bc8-9739-cf3cca917fcf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:18:57 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:18:57 user nova-compute[73469]:  {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:18:57 user nova-compute[73469]: WARNING os_brick.initiator.connectors.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 22 03:18:57 user nova-compute[73469]: 
Aug 22 03:18:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Updating instance_info_cache with network_info: [{"id": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "address": "fa:16:3e:b3:2e:19", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3a0bc-eb", "ovs_interfaceid": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-1d2fe450-442f-4722-b187-2f75655c2b52" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] There are 0 instances to clean {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:18:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:58 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:18:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --login" returned: 0 in 2.050s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a08cd0-bd55-4eb4-9378-bad93ea7a428]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5, portal: 172.16.0.220,3260]
Aug 22 03:18:59 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5, portal: 172.16.0.220,3260] successful.
Aug 22 03:18:59 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c277e987-211e-44bd-87b9-b6dedfc92803]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bcc00a-e2ce-475b-8683-5eef64d8f158]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 (non-flash)
Aug 22 03:18:59 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 (non-flash)
Aug 22 03:18:59 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.302s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dcf0ea-9ae6-4396-a7a6-7bf2ce17d481]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:18:59 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUFyDfQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.380s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] <== connect_volume: return (3382ms) {'type': 'block', 'scsi_wwn': '23539366236393862', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539366236393862', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG nova.objects.instance [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lazy-loading 'flavor' on Instance uuid 1d2fe450-442f-4722-b187-2f75655c2b52 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:19:00 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:19:00 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:19:00 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:19:00 user nova-compute[73469]:   <serial>7a244b45-dcfa-40c9-9178-cc9f05b6b0a5</serial>
Aug 22 03:19:00 user nova-compute[73469]: </disk>
Aug 22 03:19:00 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:00 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:19:00 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:19:00 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8393MB free_disk=25.191349029541016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] No VIF found with MAC fa:16:3e:b3:2e:19, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 1d2fe450-442f-4722-b187-2f75655c2b52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance b01e4c17-2e37-4c89-9827-4d89f4a0b8ad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:19:00 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:19:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2113b410-8385-4784-b22f-96aadbfb175a tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1d2fe450-442f-4722-b187-2f75655c2b52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.305s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:01 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:19:01 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:19:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:19:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:02 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:19:02 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:19:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 22 03:19:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:05 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:19:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:20 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:19:20 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid 1d2fe450-442f-4722-b187-2f75655c2b52 {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 03:19:20 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid b01e4c17-2e37-4c89-9827-4d89f4a0b8ad {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 03:19:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "1d2fe450-442f-4722-b187-2f75655c2b52" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "1d2fe450-442f-4722-b187-2f75655c2b52" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "1d2fe450-442f-4722-b187-2f75655c2b52" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Acquiring lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:19:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:21 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:19:21 user nova-compute[73469]: INFO nova.compute.claims [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Claim successful on node user
Aug 22 03:19:22 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG nova.network.neutron [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:19:22 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:19:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG nova.policy [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fd15d338f304d51aadd43537558d88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f44e4e3e8b4ddd93458eafb5dea5dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:19:22 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Creating image(s)
Aug 22 03:19:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Lock "/opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Lock "/opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.188s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.220s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/disk 1073741824" returned: 0 in 0.060s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:23 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:19:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:23 user nova-compute[73469]: DEBUG nova.network.neutron [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Successfully created port: d513f095-ab50-446d-8ef4-b291e33ba3f0 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:19:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:23 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Cannot resize image /opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:19:23 user nova-compute[73469]: DEBUG nova.objects.instance [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Lazy-loading 'migration_context' on Instance uuid fc2d4944-90fa-4b9c-b94d-2bcab9078708 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:19:23 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:19:23 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Ensure instance console log exists: /opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:19:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.network.neutron [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Successfully updated port: d513f095-ab50-446d-8ef4-b291e33ba3f0 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Acquiring lock "refresh_cache-fc2d4944-90fa-4b9c-b94d-2bcab9078708" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Acquired lock "refresh_cache-fc2d4944-90fa-4b9c-b94d-2bcab9078708" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.network.neutron [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.network.neutron [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-565e8d05-25e1-45b8-acac-2056cc122740 req-3f65b614-4bc7-4da3-bc37-ce48b9ded2d9 service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Received event network-changed-d513f095-ab50-446d-8ef4-b291e33ba3f0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.compute.manager [req-565e8d05-25e1-45b8-acac-2056cc122740 req-3f65b614-4bc7-4da3-bc37-ce48b9ded2d9 service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Refreshing instance network info cache due to event network-changed-d513f095-ab50-446d-8ef4-b291e33ba3f0. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-565e8d05-25e1-45b8-acac-2056cc122740 req-3f65b614-4bc7-4da3-bc37-ce48b9ded2d9 service nova] Acquiring lock "refresh_cache-fc2d4944-90fa-4b9c-b94d-2bcab9078708" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.network.neutron [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Updating instance_info_cache with network_info: [{"id": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "address": "fa:16:3e:b5:3f:54", "network": {"id": "39acbbc6-2fd4-44ee-8aa0-8931baff1f3b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c3ce6b6b36b4531a48d91ae3d6ed128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd513f095-ab", "ovs_interfaceid": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Releasing lock "refresh_cache-fc2d4944-90fa-4b9c-b94d-2bcab9078708" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Instance network_info: |[{"id": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "address": "fa:16:3e:b5:3f:54", "network": {"id": "39acbbc6-2fd4-44ee-8aa0-8931baff1f3b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c3ce6b6b36b4531a48d91ae3d6ed128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd513f095-ab", "ovs_interfaceid": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-565e8d05-25e1-45b8-acac-2056cc122740 req-3f65b614-4bc7-4da3-bc37-ce48b9ded2d9 service nova] Acquired lock "refresh_cache-fc2d4944-90fa-4b9c-b94d-2bcab9078708" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.network.neutron [req-565e8d05-25e1-45b8-acac-2056cc122740 req-3f65b614-4bc7-4da3-bc37-ce48b9ded2d9 service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Refreshing network info cache for port d513f095-ab50-446d-8ef4-b291e33ba3f0 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Start _get_guest_xml network_info=[{"id": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "address": "fa:16:3e:b5:3f:54", "network": {"id": "39acbbc6-2fd4-44ee-8aa0-8931baff1f3b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c3ce6b6b36b4531a48d91ae3d6ed128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd513f095-ab", "ovs_interfaceid": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:19:24 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:19:24 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:19:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1740021099',display_name='tempest-VolumesNegativeTest-instance-1740021099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1740021099',id=42,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66f44e4e3e8b4ddd93458eafb5dea5dd',ramdisk_id='',reservation_id='r-90y4tde4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-413750711',owner_user_name='tempest-VolumesNegativeTest-413750711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:19:22Z,user_data=None,user_id='3fd15d338f304d51aadd43537558d88f',uuid=fc2d4944-90fa-4b9c-b94d-2bcab9078708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "address": "fa:16:3e:b5:3f:54", "network": {"id": "39acbbc6-2fd4-44ee-8aa0-8931baff1f3b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c3ce6b6b36b4531a48d91ae3d6ed128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd513f095-ab", "ovs_interfaceid": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Converting VIF {"id": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "address": "fa:16:3e:b5:3f:54", "network": {"id": "39acbbc6-2fd4-44ee-8aa0-8931baff1f3b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c3ce6b6b36b4531a48d91ae3d6ed128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd513f095-ab", "ovs_interfaceid": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:3f:54,bridge_name='br-int',has_traffic_filtering=True,id=d513f095-ab50-446d-8ef4-b291e33ba3f0,network=Network(39acbbc6-2fd4-44ee-8aa0-8931baff1f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd513f095-ab') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.objects.instance [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Lazy-loading 'pci_devices' on Instance uuid fc2d4944-90fa-4b9c-b94d-2bcab9078708 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:19:24 user nova-compute[73469]:   <uuid>fc2d4944-90fa-4b9c-b94d-2bcab9078708</uuid>
Aug 22 03:19:24 user nova-compute[73469]:   <name>instance-0000002a</name>
Aug 22 03:19:24 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:19:24 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:19:24 user nova-compute[73469]:   <metadata>
Aug 22 03:19:24 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:19:24 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:19:24 user nova-compute[73469]:       <nova:name>tempest-VolumesNegativeTest-instance-1740021099</nova:name>
Aug 22 03:19:24 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:19:24</nova:creationTime>
Aug 22 03:19:24 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:19:24 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:19:24 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:19:24 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:19:24 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:19:24 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:19:24 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:19:24 user nova-compute[73469]:       <nova:owner>
Aug 22 03:19:24 user nova-compute[73469]:         <nova:user uuid="3fd15d338f304d51aadd43537558d88f">tempest-VolumesNegativeTest-413750711-project-member</nova:user>
Aug 22 03:19:24 user nova-compute[73469]:         <nova:project uuid="66f44e4e3e8b4ddd93458eafb5dea5dd">tempest-VolumesNegativeTest-413750711</nova:project>
Aug 22 03:19:24 user nova-compute[73469]:       </nova:owner>
Aug 22 03:19:24 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:19:24 user nova-compute[73469]:       <nova:ports>
Aug 22 03:19:24 user nova-compute[73469]:         <nova:port uuid="d513f095-ab50-446d-8ef4-b291e33ba3f0">
Aug 22 03:19:24 user nova-compute[73469]:           <nova:ip type="fixed" address="192.168.233.153" ipVersion="4"/>
Aug 22 03:19:24 user nova-compute[73469]:         </nova:port>
Aug 22 03:19:24 user nova-compute[73469]:       </nova:ports>
Aug 22 03:19:24 user nova-compute[73469]:     </nova:instance>
Aug 22 03:19:24 user nova-compute[73469]:   </metadata>
Aug 22 03:19:24 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:19:24 user nova-compute[73469]:     <system>
Aug 22 03:19:24 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:19:24 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:19:24 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:19:24 user nova-compute[73469]:       <entry name="serial">fc2d4944-90fa-4b9c-b94d-2bcab9078708</entry>
Aug 22 03:19:24 user nova-compute[73469]:       <entry name="uuid">fc2d4944-90fa-4b9c-b94d-2bcab9078708</entry>
Aug 22 03:19:24 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:19:24 user nova-compute[73469]:     </system>
Aug 22 03:19:24 user nova-compute[73469]:   </sysinfo>
Aug 22 03:19:24 user nova-compute[73469]:   <os>
Aug 22 03:19:24 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:19:24 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:19:24 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:19:24 user nova-compute[73469]:   </os>
Aug 22 03:19:24 user nova-compute[73469]:   <features>
Aug 22 03:19:24 user nova-compute[73469]:     <acpi/>
Aug 22 03:19:24 user nova-compute[73469]:     <apic/>
Aug 22 03:19:24 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:19:24 user nova-compute[73469]:   </features>
Aug 22 03:19:24 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:19:24 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:19:24 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:19:24 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:19:24 user nova-compute[73469]:   </clock>
Aug 22 03:19:24 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:19:24 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:19:24 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:19:24 user nova-compute[73469]:   </cpu>
Aug 22 03:19:24 user nova-compute[73469]:   <devices>
Aug 22 03:19:24 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:19:24 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:19:24 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/disk"/>
Aug 22 03:19:24 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:19:24 user nova-compute[73469]:     </disk>
Aug 22 03:19:24 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:19:24 user nova-compute[73469]:       <mac address="fa:16:3e:b5:3f:54"/>
Aug 22 03:19:24 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:19:24 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:19:24 user nova-compute[73469]:       <target dev="tapd513f095-ab"/>
Aug 22 03:19:24 user nova-compute[73469]:     </interface>
Aug 22 03:19:24 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:19:24 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/console.log" append="off"/>
Aug 22 03:19:24 user nova-compute[73469]:     </serial>
Aug 22 03:19:24 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:19:24 user nova-compute[73469]:     <video>
Aug 22 03:19:24 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:19:24 user nova-compute[73469]:     </video>
Aug 22 03:19:24 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:19:24 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:19:24 user nova-compute[73469]:     </rng>
Aug 22 03:19:24 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:19:24 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:19:24 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:19:24 user nova-compute[73469]:     </memballoon>
Aug 22 03:19:24 user nova-compute[73469]:   </devices>
Aug 22 03:19:24 user nova-compute[73469]: </domain>
Aug 22 03:19:24 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:19:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1740021099',display_name='tempest-VolumesNegativeTest-instance-1740021099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1740021099',id=42,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66f44e4e3e8b4ddd93458eafb5dea5dd',ramdisk_id='',reservation_id='r-90y4tde4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-413750711',owner_user_name='tempest-VolumesNegativeTest-413750711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:19:22Z,user_data=None,user_id='3fd15d338f304d51aadd43537558d88f',uuid=fc2d4944-90fa-4b9c-b94d-2bcab9078708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "address": "fa:16:3e:b5:3f:54", "network": {"id": "39acbbc6-2fd4-44ee-8aa0-8931baff1f3b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c3ce6b6b36b4531a48d91ae3d6ed128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd513f095-ab", "ovs_interfaceid": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Converting VIF {"id": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "address": "fa:16:3e:b5:3f:54", "network": {"id": "39acbbc6-2fd4-44ee-8aa0-8931baff1f3b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c3ce6b6b36b4531a48d91ae3d6ed128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd513f095-ab", "ovs_interfaceid": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:3f:54,bridge_name='br-int',has_traffic_filtering=True,id=d513f095-ab50-446d-8ef4-b291e33ba3f0,network=Network(39acbbc6-2fd4-44ee-8aa0-8931baff1f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd513f095-ab') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG os_vif [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:3f:54,bridge_name='br-int',has_traffic_filtering=True,id=d513f095-ab50-446d-8ef4-b291e33ba3f0,network=Network(39acbbc6-2fd4-44ee-8aa0-8931baff1f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd513f095-ab') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd513f095-ab, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd513f095-ab, col_values=(('external_ids', {'iface-id': 'd513f095-ab50-446d-8ef4-b291e33ba3f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:3f:54', 'vm-uuid': 'fc2d4944-90fa-4b9c-b94d-2bcab9078708'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:24 user nova-compute[73469]: INFO os_vif [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:3f:54,bridge_name='br-int',has_traffic_filtering=True,id=d513f095-ab50-446d-8ef4-b291e33ba3f0,network=Network(39acbbc6-2fd4-44ee-8aa0-8931baff1f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd513f095-ab')
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:19:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] No VIF found with MAC fa:16:3e:b5:3f:54, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:19:25 user nova-compute[73469]: DEBUG nova.network.neutron [req-565e8d05-25e1-45b8-acac-2056cc122740 req-3f65b614-4bc7-4da3-bc37-ce48b9ded2d9 service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Updated VIF entry in instance network info cache for port d513f095-ab50-446d-8ef4-b291e33ba3f0. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:19:25 user nova-compute[73469]: DEBUG nova.network.neutron [req-565e8d05-25e1-45b8-acac-2056cc122740 req-3f65b614-4bc7-4da3-bc37-ce48b9ded2d9 service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Updating instance_info_cache with network_info: [{"id": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "address": "fa:16:3e:b5:3f:54", "network": {"id": "39acbbc6-2fd4-44ee-8aa0-8931baff1f3b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c3ce6b6b36b4531a48d91ae3d6ed128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd513f095-ab", "ovs_interfaceid": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:19:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-565e8d05-25e1-45b8-acac-2056cc122740 req-3f65b614-4bc7-4da3-bc37-ce48b9ded2d9 service nova] Releasing lock "refresh_cache-fc2d4944-90fa-4b9c-b94d-2bcab9078708" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:19:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-46ab20e0-57bc-45ae-a212-6ce4c324caeb req-27edae45-2f66-4e54-9d26-2a5cec48bc7c service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Received event network-vif-plugged-d513f095-ab50-446d-8ef4-b291e33ba3f0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:19:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-46ab20e0-57bc-45ae-a212-6ce4c324caeb req-27edae45-2f66-4e54-9d26-2a5cec48bc7c service nova] Acquiring lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-46ab20e0-57bc-45ae-a212-6ce4c324caeb req-27edae45-2f66-4e54-9d26-2a5cec48bc7c service nova] Lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-46ab20e0-57bc-45ae-a212-6ce4c324caeb req-27edae45-2f66-4e54-9d26-2a5cec48bc7c service nova] Lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-46ab20e0-57bc-45ae-a212-6ce4c324caeb req-27edae45-2f66-4e54-9d26-2a5cec48bc7c service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] No waiting events found dispatching network-vif-plugged-d513f095-ab50-446d-8ef4-b291e33ba3f0 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:19:26 user nova-compute[73469]: WARNING nova.compute.manager [req-46ab20e0-57bc-45ae-a212-6ce4c324caeb req-27edae45-2f66-4e54-9d26-2a5cec48bc7c service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Received unexpected event network-vif-plugged-d513f095-ab50-446d-8ef4-b291e33ba3f0 for instance with vm_state building and task_state spawning.
Aug 22 03:19:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:28 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674368.7312462, fc2d4944-90fa-4b9c-b94d-2bcab9078708 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:19:28 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] VM Resumed (Lifecycle Event)
Aug 22 03:19:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:19:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:19:28 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Instance spawned successfully.
Aug 22 03:19:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:19:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:19:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-cf585faa-7c29-48bc-8f7d-ebcd0142b01b req-442cc1b0-9f22-4443-83cc-f6bd371177a4 service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Received event network-vif-plugged-d513f095-ab50-446d-8ef4-b291e33ba3f0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:19:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cf585faa-7c29-48bc-8f7d-ebcd0142b01b req-442cc1b0-9f22-4443-83cc-f6bd371177a4 service nova] Acquiring lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cf585faa-7c29-48bc-8f7d-ebcd0142b01b req-442cc1b0-9f22-4443-83cc-f6bd371177a4 service nova] Lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cf585faa-7c29-48bc-8f7d-ebcd0142b01b req-442cc1b0-9f22-4443-83cc-f6bd371177a4 service nova] Lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-cf585faa-7c29-48bc-8f7d-ebcd0142b01b req-442cc1b0-9f22-4443-83cc-f6bd371177a4 service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] No waiting events found dispatching network-vif-plugged-d513f095-ab50-446d-8ef4-b291e33ba3f0 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:19:28 user nova-compute[73469]: WARNING nova.compute.manager [req-cf585faa-7c29-48bc-8f7d-ebcd0142b01b req-442cc1b0-9f22-4443-83cc-f6bd371177a4 service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Received unexpected event network-vif-plugged-d513f095-ab50-446d-8ef4-b291e33ba3f0 for instance with vm_state building and task_state spawning.
Aug 22 03:19:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:19:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:19:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:19:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:19:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:19:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:19:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:19:28 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:19:28 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674368.737004, fc2d4944-90fa-4b9c-b94d-2bcab9078708 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:19:28 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] VM Started (Lifecycle Event)
Aug 22 03:19:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:19:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:19:28 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:19:28 user nova-compute[73469]: INFO nova.compute.manager [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Took 6.39 seconds to spawn the instance on the hypervisor.
Aug 22 03:19:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:19:28 user nova-compute[73469]: INFO nova.compute.manager [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Took 7.10 seconds to build instance.
Aug 22 03:19:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-c0d7cc11-c80a-4410-a06a-59e75c37bf5b tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.206s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "2bcb99db-a352-4c77-a316-4152e82338c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "2bcb99db-a352-4c77-a316-4152e82338c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:19:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:36 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:19:36 user nova-compute[73469]: INFO nova.compute.claims [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Claim successful on node user
Aug 22 03:19:36 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:19:36 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:19:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:19:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:19:36 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:19:36 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:19:36 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:19:36 user nova-compute[73469]: DEBUG nova.policy [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39da6c4b4af346adb57ef59ed72d6336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a535e1201fc482fb98a779de2f2eb22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:19:36 user nova-compute[73469]: INFO nova.virt.block_device [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Booting with volume 7ff20bb8-f4f1-4996-88b1-3af0822feb8b at /dev/vda
Aug 22 03:19:36 user nova-compute[73469]: DEBUG os_brick.utils [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:19:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54691fe-3fc7-467a-8cf5-742c0eff37db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:36 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaff56eb-f5e2-432f-a897-451f7086fd81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1647af4c-8616-44f0-a2c1-85054c896109]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0341df8a-2492-4e31-8a3e-7be240a1a838]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:19:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:19:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:19:37 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:19:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76d8fb2-7035-4c00-8567-8cec3c1efb27]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:19:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:19:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:19:37 user nova-compute[73469]: DEBUG os_brick.utils [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:19:37 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Updating existing volume attachment record: b4e91d6b-58fb-4d31-b39e-838cf64704a5 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:19:37 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Successfully created port: 127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:19:38 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Successfully updated port: 127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:19:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:19:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquired lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:19:38 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:19:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-7940daa0-d963-497c-913d-a54cad67a86a req-f452d1ab-5b31-431e-9544-7cf420b86fea service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-changed-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:19:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-7940daa0-d963-497c-913d-a54cad67a86a req-f452d1ab-5b31-431e-9544-7cf420b86fea service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Refreshing instance network info cache due to event network-changed-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:19:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7940daa0-d963-497c-913d-a54cad67a86a req-f452d1ab-5b31-431e-9544-7cf420b86fea service nova] Acquiring lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:19:38 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:19:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:38 user nova-compute[73469]: DEBUG nova.network.neutron [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Updating instance_info_cache with network_info: [{"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:19:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Releasing lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:19:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Instance network_info: |[{"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:19:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7940daa0-d963-497c-913d-a54cad67a86a req-f452d1ab-5b31-431e-9544-7cf420b86fea service nova] Acquired lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:19:38 user nova-compute[73469]: DEBUG nova.network.neutron [req-7940daa0-d963-497c-913d-a54cad67a86a req-f452d1ab-5b31-431e-9544-7cf420b86fea service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Refreshing network info cache for port 127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:19:39 user nova-compute[73469]: DEBUG nova.network.neutron [req-7940daa0-d963-497c-913d-a54cad67a86a req-f452d1ab-5b31-431e-9544-7cf420b86fea service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Updated VIF entry in instance network info cache for port 127c6ea8-1f9e-43ed-8bf1-aeeda044ddce. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:19:39 user nova-compute[73469]: DEBUG nova.network.neutron [req-7940daa0-d963-497c-913d-a54cad67a86a req-f452d1ab-5b31-431e-9544-7cf420b86fea service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Updating instance_info_cache with network_info: [{"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:19:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7940daa0-d963-497c-913d-a54cad67a86a req-f452d1ab-5b31-431e-9544-7cf420b86fea service nova] Releasing lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:19:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "1d2fe450-442f-4722-b187-2f75655c2b52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1d2fe450-442f-4722-b187-2f75655c2b52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:44 user nova-compute[73469]: INFO nova.compute.manager [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Detaching volume 7a244b45-dcfa-40c9-9178-cc9f05b6b0a5
Aug 22 03:19:44 user nova-compute[73469]: INFO nova.virt.block_device [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Attempting to driver detach volume 7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 from mountpoint /dev/vdb
Aug 22 03:19:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Attempting to detach device vdb from instance 1d2fe450-442f-4722-b187-2f75655c2b52 from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:19:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:19:44 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:19:44 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:19:44 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:19:44 user nova-compute[73469]:   <serial>7a244b45-dcfa-40c9-9178-cc9f05b6b0a5</serial>
Aug 22 03:19:44 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:19:44 user nova-compute[73469]: </disk>
Aug 22 03:19:44 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:19:44 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Successfully detached device vdb from instance 1d2fe450-442f-4722-b187-2f75655c2b52 from the persistent domain config.
Aug 22 03:19:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1d2fe450-442f-4722-b187-2f75655c2b52 from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:19:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:19:44 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:19:44 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:19:44 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:19:44 user nova-compute[73469]:   <serial>7a244b45-dcfa-40c9-9178-cc9f05b6b0a5</serial>
Aug 22 03:19:44 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:19:44 user nova-compute[73469]: </disk>
Aug 22 03:19:44 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:19:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "1d2fe450-442f-4722-b187-2f75655c2b52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692674385.042326, 1d2fe450-442f-4722-b187-2f75655c2b52 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1d2fe450-442f-4722-b187-2f75655c2b52 {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:19:45 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Successfully detached device vdb from instance 1d2fe450-442f-4722-b187-2f75655c2b52 from the live domain config.
Aug 22 03:19:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUFyDfQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:19:45 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:19:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77455c6-fefb-43f5-bb7a-5a2a13ef09cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[11deb094-a658-4295-bf9b-2a6ff051096b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 (non-flash)
Aug 22 03:19:45 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 (non-flash)
Aug 22 03:19:45 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4426b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92e7b41-8671-4191-bb3e-c22b8bbfe067]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6446e29a-0b1b-4e26-a0a0-e2198f24b3e0]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9eaf3c2-4a62-4d49-84c1-4d66031cd25d]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[883f8a9f-6adf-4b61-9833-f04173f727bf]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8990f9a2-41c4-4926-a4c2-2783f472a89b]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bb5bb5-33b4-47c1-b0d3-0aa4478dead0]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5, portal: 172.16.0.220,3260]
Aug 22 03:19:45 user nova-compute[73469]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5, portal: 172.16.0.220,3260] successful.
Aug 22 03:19:45 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[561e7f18-dd9f-4812-ad62-7efe4112587c]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] <== disconnect_volume: return (289ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:19:45 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:19:46 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lazy-loading 'flavor' on Instance uuid 1d2fe450-442f-4722-b187-2f75655c2b52 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:19:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b475a9ec-8717-4b9c-a0cb-871fb0125cef tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1d2fe450-442f-4722-b187-2f75655c2b52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.830s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1d2fe450-442f-4722-b187-2f75655c2b52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.695s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "1d2fe450-442f-4722-b187-2f75655c2b52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1d2fe450-442f-4722-b187-2f75655c2b52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1d2fe450-442f-4722-b187-2f75655c2b52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:46 user nova-compute[73469]: INFO nova.compute.manager [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Terminating instance
Aug 22 03:19:46 user nova-compute[73469]: DEBUG nova.compute.manager [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:19:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:46 user nova-compute[73469]: DEBUG nova.compute.manager [req-b63fbec9-fa2c-4334-a100-febd1b8baf05 req-d8a88160-4f75-4be2-8c3a-03bab11c71e8 service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Received event network-vif-unplugged-6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:19:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b63fbec9-fa2c-4334-a100-febd1b8baf05 req-d8a88160-4f75-4be2-8c3a-03bab11c71e8 service nova] Acquiring lock "1d2fe450-442f-4722-b187-2f75655c2b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b63fbec9-fa2c-4334-a100-febd1b8baf05 req-d8a88160-4f75-4be2-8c3a-03bab11c71e8 service nova] Lock "1d2fe450-442f-4722-b187-2f75655c2b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b63fbec9-fa2c-4334-a100-febd1b8baf05 req-d8a88160-4f75-4be2-8c3a-03bab11c71e8 service nova] Lock "1d2fe450-442f-4722-b187-2f75655c2b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:46 user nova-compute[73469]: DEBUG nova.compute.manager [req-b63fbec9-fa2c-4334-a100-febd1b8baf05 req-d8a88160-4f75-4be2-8c3a-03bab11c71e8 service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] No waiting events found dispatching network-vif-unplugged-6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:19:46 user nova-compute[73469]: DEBUG nova.compute.manager [req-b63fbec9-fa2c-4334-a100-febd1b8baf05 req-d8a88160-4f75-4be2-8c3a-03bab11c71e8 service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Received event network-vif-unplugged-6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:19:47 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Instance destroyed successfully.
Aug 22 03:19:47 user nova-compute[73469]: DEBUG nova.objects.instance [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lazy-loading 'resources' on Instance uuid 1d2fe450-442f-4722-b187-2f75655c2b52 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1175779084',display_name='tempest-VolumesSnapshotTestJSON-instance-1175779084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1175779084',id=40,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhpSXJ4NGyAbnQSiZbvDd3cHjNEYm56/V1kKoT2otc/YyXROkGcD6IL/VfBHdAaANREcla5n/aIdutwSDqFHZuMDKb/Z7/zG39Z8zihXRLAeRBCxl6+UfZxsj8k89+DIQ==',key_name='tempest-keypair-867076957',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:17:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db3173cbd63e4552b2cd30afd9d5f222',ramdisk_id='',reservation_id='r-pjsa75qv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1072377725',owner_user_name='tempest-VolumesSnapshotTestJSON-1072377725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:17:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eb46fb485964d14b308dfbb74c034c0',uuid=1d2fe450-442f-4722-b187-2f75655c2b52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "address": "fa:16:3e:b3:2e:19", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3a0bc-eb", "ovs_interfaceid": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Converting VIF {"id": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "address": "fa:16:3e:b3:2e:19", "network": {"id": "f2fb8b83-b1db-45fd-8a84-230e5333ebef", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1223208162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db3173cbd63e4552b2cd30afd9d5f222", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc3a0bc-eb", "ovs_interfaceid": "6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:2e:19,bridge_name='br-int',has_traffic_filtering=True,id=6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c,network=Network(f2fb8b83-b1db-45fd-8a84-230e5333ebef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc3a0bc-eb') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG os_vif [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:2e:19,bridge_name='br-int',has_traffic_filtering=True,id=6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c,network=Network(f2fb8b83-b1db-45fd-8a84-230e5333ebef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc3a0bc-eb') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6bc3a0bc-eb, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:19:47 user nova-compute[73469]: INFO os_vif [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:2e:19,bridge_name='br-int',has_traffic_filtering=True,id=6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c,network=Network(f2fb8b83-b1db-45fd-8a84-230e5333ebef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc3a0bc-eb')
Aug 22 03:19:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUFyDfQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:19:47 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:19:47 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a244b45-dcfa-40c9-9178-cc9f05b6b0a5', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1acbf84-6a8e-4255-a191-19255944e5be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:47 user nova-compute[73469]: WARNING os_brick.initiator.connectors.iscsi [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 22 03:19:47 user nova-compute[73469]: 
Aug 22 03:19:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec626e6-ea3d-48bf-821e-626bf2036399]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:19:47 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:19:47 user nova-compute[73469]:  {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:19:47 user nova-compute[73469]: WARNING os_brick.initiator.connectors.iscsi [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 22 03:19:47 user nova-compute[73469]: 
Aug 22 03:19:47 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a41eeb00>, {}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Disconnecting from: [] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.048s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] <== disconnect_volume: return (49ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:19:47 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Deleting instance files /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52_del
Aug 22 03:19:47 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Deletion of /opt/stack/data/nova/instances/1d2fe450-442f-4722-b187-2f75655c2b52_del complete
Aug 22 03:19:47 user nova-compute[73469]: INFO nova.compute.manager [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 22 03:19:47 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:19:47 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:19:48 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:19:48 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Took 0.89 seconds to deallocate network for instance.
Aug 22 03:19:48 user nova-compute[73469]: DEBUG nova.compute.manager [req-2e916362-fe0d-43ad-ba71-26eed082edfa req-9a781498-8e84-45a5-8dcf-572a24517cd9 service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Received event network-vif-deleted-6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:19:48 user nova-compute[73469]: WARNING nova.volume.cinder [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Attachment 74dc1593-860e-42ff-9fc8-cd5973b69973 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 74dc1593-860e-42ff-9fc8-cd5973b69973. (HTTP 404) (Request-ID: req-fcfdf50f-b0ed-4b79-9efb-a211bc610513)
Aug 22 03:19:48 user nova-compute[73469]: INFO nova.compute.manager [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Took 0.02 seconds to detach 1 volumes for instance.
Aug 22 03:19:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:48 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:19:48 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:19:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:48 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Deleted allocations for instance 1d2fe450-442f-4722-b187-2f75655c2b52
Aug 22 03:19:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-02d57699-55d6-43dc-8f29-cf46d0fa9664 tempest-VolumesSnapshotTestJSON-1072377725 tempest-VolumesSnapshotTestJSON-1072377725-project-member] Lock "1d2fe450-442f-4722-b187-2f75655c2b52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.263s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:48 user nova-compute[73469]: DEBUG nova.compute.manager [req-c1db88c5-d9cd-4be8-a53e-01e140eff03e req-0c8fd192-adb7-41d9-aa66-f81a53d5dd48 service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Received event network-vif-plugged-6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:19:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c1db88c5-d9cd-4be8-a53e-01e140eff03e req-0c8fd192-adb7-41d9-aa66-f81a53d5dd48 service nova] Acquiring lock "1d2fe450-442f-4722-b187-2f75655c2b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c1db88c5-d9cd-4be8-a53e-01e140eff03e req-0c8fd192-adb7-41d9-aa66-f81a53d5dd48 service nova] Lock "1d2fe450-442f-4722-b187-2f75655c2b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:48 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-c1db88c5-d9cd-4be8-a53e-01e140eff03e req-0c8fd192-adb7-41d9-aa66-f81a53d5dd48 service nova] Lock "1d2fe450-442f-4722-b187-2f75655c2b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:48 user nova-compute[73469]: DEBUG nova.compute.manager [req-c1db88c5-d9cd-4be8-a53e-01e140eff03e req-0c8fd192-adb7-41d9-aa66-f81a53d5dd48 service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] No waiting events found dispatching network-vif-plugged-6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:19:48 user nova-compute[73469]: WARNING nova.compute.manager [req-c1db88c5-d9cd-4be8-a53e-01e140eff03e req-0c8fd192-adb7-41d9-aa66-f81a53d5dd48 service nova] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Received unexpected event network-vif-plugged-6bc3a0bc-eb60-41eb-ba44-e2d11af93a3c for instance with vm_state deleted and task_state None.
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:19:49 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Creating image(s)
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Did not create local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Ensure instance console log exists: /opt/stack/data/nova/instances/2bcb99db-a352-4c77-a316-4152e82338c5/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Start _get_guest_xml network_info=[{"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'b4e91d6b-58fb-4d31-b39e-838cf64704a5', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGrLlCIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2bcb99db-a352-4c77-a316-4152e82338c5', 'attached_at': '', 'detached_at': '', 'volume_id': '7ff20bb8-f4f1-4996-88b1-3af0822feb8b', 'serial': '7ff20bb8-f4f1-4996-88b1-3af0822feb8b'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:19:49 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:19:49 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGrLlCIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:19:49 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:19:49 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:19:49 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ac46eb-1bac-4d63-8498-c67a5c760e8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:19:49 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84a33ef-af78-48fd-95fb-8c6adc35eac7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b] added
Aug 22 03:19:49 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a939be-9a51-4373-8d05-25b7ca2f2665]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3923db0f-6eb1-4c3e-aa91-a7cebbfac474]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGrLlCIw {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGrLlCIw" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d2c68e-ebb9-44ea-8d90-7da4ad2f1c6c]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oGrLlCIw'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a0f269-b6b0-471b-9372-331a85d36ecc]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[52aa5922-df48-4b49-8fa2-4b4cd4059412]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:19:49 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:19:49 user nova-compute[73469]:  {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:19:49 user nova-compute[73469]: WARNING os_brick.initiator.connectors.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 22 03:19:49 user nova-compute[73469]: 
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[421330a9-32ea-46b7-a740-55b886e755a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b, portal: 172.16.0.220,3260]
Aug 22 03:19:49 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b, portal: 172.16.0.220,3260] successful.
Aug 22 03:19:49 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe86d26-ff15-4de9-b977-b69d453a2495]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fc60f6-050d-4f0e-8cf1-3821fff1eff4]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)
Aug 22 03:19:49 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)
Aug 22 03:19:49 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55c69ef-830c-4b84-8b05-667a45763ad5]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:19:49 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGrLlCIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23661336131626638', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661336131626638', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:19:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1181981432',display_name='tempest-TestShelveInstance-server-1181981432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1181981432',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzGYbmnNPkHPTRx3w8VWXAlw/Q/LgDOaaME96KoTCtSUTjMCTJ+U401e/nhUc6cx6MB2fv6e8DSAeZ5AwQ0e6UX+qlxOasf8XXGwiMLIx3O/oMndmKunkdGEDkDMOx/cQ==',key_name='tempest-TestShelveInstance-789183110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a535e1201fc482fb98a779de2f2eb22',ramdisk_id='',reservation_id='r-z93obrmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1878913405',owner_user_name='tempest-TestShelveInstance-1878913405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:19:37Z,user_data=None,user_id='39da6c4b4af346adb57ef59ed72d6336',uuid=2bcb99db-a352-4c77-a316-4152e82338c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Converting VIF {"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9e:f4,bridge_name='br-int',has_traffic_filtering=True,id=127c6ea8-1f9e-43ed-8bf1-aeeda044ddce,network=Network(346ff46f-cc3e-4807-b97d-54434298bce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127c6ea8-1f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bcb99db-a352-4c77-a316-4152e82338c5 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:19:50 user nova-compute[73469]:   <uuid>2bcb99db-a352-4c77-a316-4152e82338c5</uuid>
Aug 22 03:19:50 user nova-compute[73469]:   <name>instance-0000002b</name>
Aug 22 03:19:50 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:19:50 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:19:50 user nova-compute[73469]:   <metadata>
Aug 22 03:19:50 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:19:50 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:19:50 user nova-compute[73469]:       <nova:name>tempest-TestShelveInstance-server-1181981432</nova:name>
Aug 22 03:19:50 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:19:49</nova:creationTime>
Aug 22 03:19:50 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:19:50 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:19:50 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:19:50 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:19:50 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:19:50 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:19:50 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:19:50 user nova-compute[73469]:       <nova:owner>
Aug 22 03:19:50 user nova-compute[73469]:         <nova:user uuid="39da6c4b4af346adb57ef59ed72d6336">tempest-TestShelveInstance-1878913405-project-member</nova:user>
Aug 22 03:19:50 user nova-compute[73469]:         <nova:project uuid="0a535e1201fc482fb98a779de2f2eb22">tempest-TestShelveInstance-1878913405</nova:project>
Aug 22 03:19:50 user nova-compute[73469]:       </nova:owner>
Aug 22 03:19:50 user nova-compute[73469]:       <nova:ports>
Aug 22 03:19:50 user nova-compute[73469]:         <nova:port uuid="127c6ea8-1f9e-43ed-8bf1-aeeda044ddce">
Aug 22 03:19:50 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 22 03:19:50 user nova-compute[73469]:         </nova:port>
Aug 22 03:19:50 user nova-compute[73469]:       </nova:ports>
Aug 22 03:19:50 user nova-compute[73469]:     </nova:instance>
Aug 22 03:19:50 user nova-compute[73469]:   </metadata>
Aug 22 03:19:50 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:19:50 user nova-compute[73469]:     <system>
Aug 22 03:19:50 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:19:50 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:19:50 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:19:50 user nova-compute[73469]:       <entry name="serial">2bcb99db-a352-4c77-a316-4152e82338c5</entry>
Aug 22 03:19:50 user nova-compute[73469]:       <entry name="uuid">2bcb99db-a352-4c77-a316-4152e82338c5</entry>
Aug 22 03:19:50 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:19:50 user nova-compute[73469]:     </system>
Aug 22 03:19:50 user nova-compute[73469]:   </sysinfo>
Aug 22 03:19:50 user nova-compute[73469]:   <os>
Aug 22 03:19:50 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:19:50 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:19:50 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:19:50 user nova-compute[73469]:   </os>
Aug 22 03:19:50 user nova-compute[73469]:   <features>
Aug 22 03:19:50 user nova-compute[73469]:     <acpi/>
Aug 22 03:19:50 user nova-compute[73469]:     <apic/>
Aug 22 03:19:50 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:19:50 user nova-compute[73469]:   </features>
Aug 22 03:19:50 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:19:50 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:19:50 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:19:50 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:19:50 user nova-compute[73469]:   </clock>
Aug 22 03:19:50 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:19:50 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:19:50 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:19:50 user nova-compute[73469]:   </cpu>
Aug 22 03:19:50 user nova-compute[73469]:   <devices>
Aug 22 03:19:50 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:19:50 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:19:50 user nova-compute[73469]:       <source dev="/dev/sdb"/>
Aug 22 03:19:50 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:19:50 user nova-compute[73469]:       <serial>7ff20bb8-f4f1-4996-88b1-3af0822feb8b</serial>
Aug 22 03:19:50 user nova-compute[73469]:     </disk>
Aug 22 03:19:50 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:19:50 user nova-compute[73469]:       <mac address="fa:16:3e:5f:9e:f4"/>
Aug 22 03:19:50 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:19:50 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:19:50 user nova-compute[73469]:       <target dev="tap127c6ea8-1f"/>
Aug 22 03:19:50 user nova-compute[73469]:     </interface>
Aug 22 03:19:50 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:19:50 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/2bcb99db-a352-4c77-a316-4152e82338c5/console.log" append="off"/>
Aug 22 03:19:50 user nova-compute[73469]:     </serial>
Aug 22 03:19:50 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:19:50 user nova-compute[73469]:     <video>
Aug 22 03:19:50 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:19:50 user nova-compute[73469]:     </video>
Aug 22 03:19:50 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:19:50 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:19:50 user nova-compute[73469]:     </rng>
Aug 22 03:19:50 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:19:50 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:19:50 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:19:50 user nova-compute[73469]:     </memballoon>
Aug 22 03:19:50 user nova-compute[73469]:   </devices>
Aug 22 03:19:50 user nova-compute[73469]: </domain>
Aug 22 03:19:50 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:19:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1181981432',display_name='tempest-TestShelveInstance-server-1181981432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1181981432',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzGYbmnNPkHPTRx3w8VWXAlw/Q/LgDOaaME96KoTCtSUTjMCTJ+U401e/nhUc6cx6MB2fv6e8DSAeZ5AwQ0e6UX+qlxOasf8XXGwiMLIx3O/oMndmKunkdGEDkDMOx/cQ==',key_name='tempest-TestShelveInstance-789183110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a535e1201fc482fb98a779de2f2eb22',ramdisk_id='',reservation_id='r-z93obrmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1878913405',owner_user_name='tempest-TestShelveInstance-1878913405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:19:37Z,user_data=None,user_id='39da6c4b4af346adb57ef59ed72d6336',uuid=2bcb99db-a352-4c77-a316-4152e82338c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Converting VIF {"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9e:f4,bridge_name='br-int',has_traffic_filtering=True,id=127c6ea8-1f9e-43ed-8bf1-aeeda044ddce,network=Network(346ff46f-cc3e-4807-b97d-54434298bce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127c6ea8-1f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG os_vif [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9e:f4,bridge_name='br-int',has_traffic_filtering=True,id=127c6ea8-1f9e-43ed-8bf1-aeeda044ddce,network=Network(346ff46f-cc3e-4807-b97d-54434298bce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127c6ea8-1f') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap127c6ea8-1f, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap127c6ea8-1f, col_values=(('external_ids', {'iface-id': '127c6ea8-1f9e-43ed-8bf1-aeeda044ddce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:9e:f4', 'vm-uuid': '2bcb99db-a352-4c77-a316-4152e82338c5'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:50 user nova-compute[73469]: INFO os_vif [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9e:f4,bridge_name='br-int',has_traffic_filtering=True,id=127c6ea8-1f9e-43ed-8bf1-aeeda044ddce,network=Network(346ff46f-cc3e-4807-b97d-54434298bce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127c6ea8-1f')
Aug 22 03:19:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:19:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] No VIF found with MAC fa:16:3e:5f:9e:f4, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:19:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:52 user nova-compute[73469]: DEBUG nova.compute.manager [req-170deedc-c5ac-4df9-a61a-9e2acb1766b7 req-bf1a8be5-dbec-449e-9dfa-d18f53141f58 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:19:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-170deedc-c5ac-4df9-a61a-9e2acb1766b7 req-bf1a8be5-dbec-449e-9dfa-d18f53141f58 service nova] Acquiring lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-170deedc-c5ac-4df9-a61a-9e2acb1766b7 req-bf1a8be5-dbec-449e-9dfa-d18f53141f58 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:52 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-170deedc-c5ac-4df9-a61a-9e2acb1766b7 req-bf1a8be5-dbec-449e-9dfa-d18f53141f58 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:52 user nova-compute[73469]: DEBUG nova.compute.manager [req-170deedc-c5ac-4df9-a61a-9e2acb1766b7 req-bf1a8be5-dbec-449e-9dfa-d18f53141f58 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] No waiting events found dispatching network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:19:52 user nova-compute[73469]: WARNING nova.compute.manager [req-170deedc-c5ac-4df9-a61a-9e2acb1766b7 req-bf1a8be5-dbec-449e-9dfa-d18f53141f58 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received unexpected event network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce for instance with vm_state building and task_state spawning.
Aug 22 03:19:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:54 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674394.2889097, 2bcb99db-a352-4c77-a316-4152e82338c5 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:19:54 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] VM Resumed (Lifecycle Event)
Aug 22 03:19:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:19:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:19:54 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Instance spawned successfully.
Aug 22 03:19:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:19:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:19:54 user nova-compute[73469]: DEBUG nova.compute.manager [req-7d00f8d9-d3a2-413a-b1bd-196ef9d3ef30 req-6e5c6261-3b4d-4e36-b09d-2f3860732479 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:19:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7d00f8d9-d3a2-413a-b1bd-196ef9d3ef30 req-6e5c6261-3b4d-4e36-b09d-2f3860732479 service nova] Acquiring lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:19:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7d00f8d9-d3a2-413a-b1bd-196ef9d3ef30 req-6e5c6261-3b4d-4e36-b09d-2f3860732479 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:19:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7d00f8d9-d3a2-413a-b1bd-196ef9d3ef30 req-6e5c6261-3b4d-4e36-b09d-2f3860732479 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:54 user nova-compute[73469]: DEBUG nova.compute.manager [req-7d00f8d9-d3a2-413a-b1bd-196ef9d3ef30 req-6e5c6261-3b4d-4e36-b09d-2f3860732479 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] No waiting events found dispatching network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:19:54 user nova-compute[73469]: WARNING nova.compute.manager [req-7d00f8d9-d3a2-413a-b1bd-196ef9d3ef30 req-6e5c6261-3b4d-4e36-b09d-2f3860732479 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received unexpected event network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce for instance with vm_state building and task_state spawning.
Aug 22 03:19:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:19:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:19:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:19:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:19:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:19:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:19:54 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:19:54 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:19:54 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674394.2929068, 2bcb99db-a352-4c77-a316-4152e82338c5 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:19:54 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] VM Started (Lifecycle Event)
Aug 22 03:19:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:19:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:19:54 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:19:54 user nova-compute[73469]: INFO nova.compute.manager [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Took 5.08 seconds to spawn the instance on the hypervisor.
Aug 22 03:19:54 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:19:54 user nova-compute[73469]: INFO nova.compute.manager [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Took 18.32 seconds to build instance.
Aug 22 03:19:54 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2d7afd2-d4f4-42d7-baa1-38c0f746cd96 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "2bcb99db-a352-4c77-a316-4152e82338c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.431s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:19:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:56 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:19:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:19:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:19:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:19:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:19:56 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:19:56 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid b01e4c17-2e37-4c89-9827-4d89f4a0b8ad {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:19:57 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Updating instance_info_cache with network_info: [{"id": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "address": "fa:16:3e:68:31:19", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ddb2d-70", "ovs_interfaceid": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:19:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:19:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:19:57 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:19:58 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:19:58 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:19:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:19:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:20:00 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:20:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:20:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:01 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:20:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:20:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:20:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:20:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:20:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:20:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:02 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692674387.052751, 1d2fe450-442f-4722-b187-2f75655c2b52 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:20:02 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] VM Stopped (Lifecycle Event)
Aug 22 03:20:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b4aea1ef-ab33-4f17-9c93-ff323e27da9c None None] [instance: 1d2fe450-442f-4722-b187-2f75655c2b52] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:20:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:02 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:20:02 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:20:02 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8198MB free_disk=25.176376342773438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:20:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:20:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:20:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance b01e4c17-2e37-4c89-9827-4d89f4a0b8ad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:20:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance fc2d4944-90fa-4b9c-b94d-2bcab9078708 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:20:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 2bcb99db-a352-4c77-a316-4152e82338c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:20:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:20:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:20:03 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing inventories for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 22 03:20:03 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Updating ProviderTree inventory for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 22 03:20:03 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Updating inventory in ProviderTree for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 22 03:20:03 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing aggregate associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, aggregates: None {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 22 03:20:03 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing trait associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 22 03:20:03 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:20:03 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:20:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:20:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.050s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:20:04 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:20:05 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:20:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "a313534c-121a-4d89-92c9-c3ba40b78c99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:20:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:20:11 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:20:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:20:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:20:12 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:20:12 user nova-compute[73469]: INFO nova.compute.claims [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Claim successful on node user
Aug 22 03:20:12 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:20:12 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:20:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:20:12 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:20:12 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:20:12 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:20:12 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:20:12 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:20:12 user nova-compute[73469]: DEBUG nova.policy [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96518602ea5a41749a90e53b39cc6eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467cfd0cdd79427b95292f684a990ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:20:12 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:20:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:20:12 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Creating image(s)
Aug 22 03:20:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "/opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:20:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "/opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:20:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "/opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:20:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.186s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:20:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:20:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.174s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk 1073741824" returned: 0 in 0.046s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:20:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.172s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:13 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:20:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:13 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Cannot resize image /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:20:13 user nova-compute[73469]: DEBUG nova.objects.instance [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lazy-loading 'migration_context' on Instance uuid a313534c-121a-4d89-92c9-c3ba40b78c99 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:20:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:20:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Ensure instance console log exists: /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:20:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:20:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:20:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:20:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:13 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Successfully created port: 2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Successfully updated port: 2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquired lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-efe7e11c-5dbb-4e38-9d2b-0d478c126f73 req-ee98146c-e744-46ef-8471-596a4de99b60 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received event network-changed-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-efe7e11c-5dbb-4e38-9d2b-0d478c126f73 req-ee98146c-e744-46ef-8471-596a4de99b60 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Refreshing instance network info cache due to event network-changed-2855f6eb-f5d9-46a6-a9d1-6b00ae364250. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-efe7e11c-5dbb-4e38-9d2b-0d478c126f73 req-ee98146c-e744-46ef-8471-596a4de99b60 service nova] Acquiring lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.network.neutron [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Updating instance_info_cache with network_info: [{"id": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "address": "fa:16:3e:69:71:05", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2855f6eb-f5", "ovs_interfaceid": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Releasing lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Instance network_info: |[{"id": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "address": "fa:16:3e:69:71:05", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2855f6eb-f5", "ovs_interfaceid": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-efe7e11c-5dbb-4e38-9d2b-0d478c126f73 req-ee98146c-e744-46ef-8471-596a4de99b60 service nova] Acquired lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.network.neutron [req-efe7e11c-5dbb-4e38-9d2b-0d478c126f73 req-ee98146c-e744-46ef-8471-596a4de99b60 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Refreshing network info cache for port 2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Start _get_guest_xml network_info=[{"id": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "address": "fa:16:3e:69:71:05", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2855f6eb-f5", "ovs_interfaceid": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:20:14 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:20:14 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:20:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-677344581',display_name='tempest-TestStampPattern-server-677344581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-677344581',id=44,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbbf7G0NOfRw/WveQo0wMklCRaQB6z4T276+FgSZHUtpkblbgKXhU3Q61VXJyHD1Dzj3wZj9gC/PhXMUryNTwkrTRmn8xreypCMtIoDaSoL2VUGYyY09H8O2SvcUlZQjA==',key_name='tempest-TestStampPattern-1767620429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='467cfd0cdd79427b95292f684a990ac7',ramdisk_id='',reservation_id='r-i1izifv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-912449456',owner_user_name='tempest-TestStampPattern-912449456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:20:13Z,user_data=None,user_id='96518602ea5a41749a90e53b39cc6eb2',uuid=a313534c-121a-4d89-92c9-c3ba40b78c99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "address": "fa:16:3e:69:71:05", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2855f6eb-f5", "ovs_interfaceid": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Converting VIF {"id": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "address": "fa:16:3e:69:71:05", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2855f6eb-f5", "ovs_interfaceid": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:20:14 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:71:05,bridge_name='br-int',has_traffic_filtering=True,id=2855f6eb-f5d9-46a6-a9d1-6b00ae364250,network=Network(8f171a1d-8c92-4090-8e32-9bdda50c1c8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2855f6eb-f5') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:20:15 user nova-compute[73469]: DEBUG nova.objects.instance [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lazy-loading 'pci_devices' on Instance uuid a313534c-121a-4d89-92c9-c3ba40b78c99 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:20:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:20:15 user nova-compute[73469]:   <uuid>a313534c-121a-4d89-92c9-c3ba40b78c99</uuid>
Aug 22 03:20:15 user nova-compute[73469]:   <name>instance-0000002c</name>
Aug 22 03:20:15 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:20:15 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:20:15 user nova-compute[73469]:   <metadata>
Aug 22 03:20:15 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:20:15 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:20:15 user nova-compute[73469]:       <nova:name>tempest-TestStampPattern-server-677344581</nova:name>
Aug 22 03:20:15 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:20:14</nova:creationTime>
Aug 22 03:20:15 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:20:15 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:20:15 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:20:15 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:20:15 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:20:15 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:20:15 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:20:15 user nova-compute[73469]:       <nova:owner>
Aug 22 03:20:15 user nova-compute[73469]:         <nova:user uuid="96518602ea5a41749a90e53b39cc6eb2">tempest-TestStampPattern-912449456-project-member</nova:user>
Aug 22 03:20:15 user nova-compute[73469]:         <nova:project uuid="467cfd0cdd79427b95292f684a990ac7">tempest-TestStampPattern-912449456</nova:project>
Aug 22 03:20:15 user nova-compute[73469]:       </nova:owner>
Aug 22 03:20:15 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:20:15 user nova-compute[73469]:       <nova:ports>
Aug 22 03:20:15 user nova-compute[73469]:         <nova:port uuid="2855f6eb-f5d9-46a6-a9d1-6b00ae364250">
Aug 22 03:20:15 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 22 03:20:15 user nova-compute[73469]:         </nova:port>
Aug 22 03:20:15 user nova-compute[73469]:       </nova:ports>
Aug 22 03:20:15 user nova-compute[73469]:     </nova:instance>
Aug 22 03:20:15 user nova-compute[73469]:   </metadata>
Aug 22 03:20:15 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:20:15 user nova-compute[73469]:     <system>
Aug 22 03:20:15 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:20:15 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:20:15 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:20:15 user nova-compute[73469]:       <entry name="serial">a313534c-121a-4d89-92c9-c3ba40b78c99</entry>
Aug 22 03:20:15 user nova-compute[73469]:       <entry name="uuid">a313534c-121a-4d89-92c9-c3ba40b78c99</entry>
Aug 22 03:20:15 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:20:15 user nova-compute[73469]:     </system>
Aug 22 03:20:15 user nova-compute[73469]:   </sysinfo>
Aug 22 03:20:15 user nova-compute[73469]:   <os>
Aug 22 03:20:15 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:20:15 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:20:15 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:20:15 user nova-compute[73469]:   </os>
Aug 22 03:20:15 user nova-compute[73469]:   <features>
Aug 22 03:20:15 user nova-compute[73469]:     <acpi/>
Aug 22 03:20:15 user nova-compute[73469]:     <apic/>
Aug 22 03:20:15 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:20:15 user nova-compute[73469]:   </features>
Aug 22 03:20:15 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:20:15 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:20:15 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:20:15 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:20:15 user nova-compute[73469]:   </clock>
Aug 22 03:20:15 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:20:15 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:20:15 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:20:15 user nova-compute[73469]:   </cpu>
Aug 22 03:20:15 user nova-compute[73469]:   <devices>
Aug 22 03:20:15 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:20:15 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:20:15 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk"/>
Aug 22 03:20:15 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:20:15 user nova-compute[73469]:     </disk>
Aug 22 03:20:15 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:20:15 user nova-compute[73469]:       <mac address="fa:16:3e:69:71:05"/>
Aug 22 03:20:15 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:20:15 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:20:15 user nova-compute[73469]:       <target dev="tap2855f6eb-f5"/>
Aug 22 03:20:15 user nova-compute[73469]:     </interface>
Aug 22 03:20:15 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:20:15 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/console.log" append="off"/>
Aug 22 03:20:15 user nova-compute[73469]:     </serial>
Aug 22 03:20:15 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:20:15 user nova-compute[73469]:     <video>
Aug 22 03:20:15 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:20:15 user nova-compute[73469]:     </video>
Aug 22 03:20:15 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:20:15 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:20:15 user nova-compute[73469]:     </rng>
Aug 22 03:20:15 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:20:15 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:20:15 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:20:15 user nova-compute[73469]:     </memballoon>
Aug 22 03:20:15 user nova-compute[73469]:   </devices>
Aug 22 03:20:15 user nova-compute[73469]: </domain>
Aug 22 03:20:15 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:20:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:20:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-677344581',display_name='tempest-TestStampPattern-server-677344581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-677344581',id=44,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbbf7G0NOfRw/WveQo0wMklCRaQB6z4T276+FgSZHUtpkblbgKXhU3Q61VXJyHD1Dzj3wZj9gC/PhXMUryNTwkrTRmn8xreypCMtIoDaSoL2VUGYyY09H8O2SvcUlZQjA==',key_name='tempest-TestStampPattern-1767620429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='467cfd0cdd79427b95292f684a990ac7',ramdisk_id='',reservation_id='r-i1izifv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-912449456',owner_user_name='tempest-TestStampPattern-912449456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:20:13Z,user_data=None,user_id='96518602ea5a41749a90e53b39cc6eb2',uuid=a313534c-121a-4d89-92c9-c3ba40b78c99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "address": "fa:16:3e:69:71:05", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2855f6eb-f5", "ovs_interfaceid": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:20:15 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Converting VIF {"id": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "address": "fa:16:3e:69:71:05", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2855f6eb-f5", "ovs_interfaceid": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:20:15 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:71:05,bridge_name='br-int',has_traffic_filtering=True,id=2855f6eb-f5d9-46a6-a9d1-6b00ae364250,network=Network(8f171a1d-8c92-4090-8e32-9bdda50c1c8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2855f6eb-f5') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:20:15 user nova-compute[73469]: DEBUG os_vif [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:71:05,bridge_name='br-int',has_traffic_filtering=True,id=2855f6eb-f5d9-46a6-a9d1-6b00ae364250,network=Network(8f171a1d-8c92-4090-8e32-9bdda50c1c8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2855f6eb-f5') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:20:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:20:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:20:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2855f6eb-f5, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:20:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2855f6eb-f5, col_values=(('external_ids', {'iface-id': '2855f6eb-f5d9-46a6-a9d1-6b00ae364250', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:71:05', 'vm-uuid': 'a313534c-121a-4d89-92c9-c3ba40b78c99'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:20:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:20:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:15 user nova-compute[73469]: INFO os_vif [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:71:05,bridge_name='br-int',has_traffic_filtering=True,id=2855f6eb-f5d9-46a6-a9d1-6b00ae364250,network=Network(8f171a1d-8c92-4090-8e32-9bdda50c1c8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2855f6eb-f5')
Aug 22 03:20:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:20:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] No VIF found with MAC fa:16:3e:69:71:05, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:20:15 user nova-compute[73469]: DEBUG nova.network.neutron [req-efe7e11c-5dbb-4e38-9d2b-0d478c126f73 req-ee98146c-e744-46ef-8471-596a4de99b60 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Updated VIF entry in instance network info cache for port 2855f6eb-f5d9-46a6-a9d1-6b00ae364250. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:20:15 user nova-compute[73469]: DEBUG nova.network.neutron [req-efe7e11c-5dbb-4e38-9d2b-0d478c126f73 req-ee98146c-e744-46ef-8471-596a4de99b60 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Updating instance_info_cache with network_info: [{"id": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "address": "fa:16:3e:69:71:05", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2855f6eb-f5", "ovs_interfaceid": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:20:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-efe7e11c-5dbb-4e38-9d2b-0d478c126f73 req-ee98146c-e744-46ef-8471-596a4de99b60 service nova] Releasing lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:20:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-8a24f0d4-91d4-4c9f-95f9-5071f4d58b7d req-010485f9-b5bf-44e8-9655-65aaec7d045a service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Received event network-changed-471ddb2d-7086-42f3-ab67-6a08a38d0585 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:20:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-8a24f0d4-91d4-4c9f-95f9-5071f4d58b7d req-010485f9-b5bf-44e8-9655-65aaec7d045a service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Refreshing instance network info cache due to event network-changed-471ddb2d-7086-42f3-ab67-6a08a38d0585. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:20:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8a24f0d4-91d4-4c9f-95f9-5071f4d58b7d req-010485f9-b5bf-44e8-9655-65aaec7d045a service nova] Acquiring lock "refresh_cache-b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:20:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8a24f0d4-91d4-4c9f-95f9-5071f4d58b7d req-010485f9-b5bf-44e8-9655-65aaec7d045a service nova] Acquired lock "refresh_cache-b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:20:16 user nova-compute[73469]: DEBUG nova.network.neutron [req-8a24f0d4-91d4-4c9f-95f9-5071f4d58b7d req-010485f9-b5bf-44e8-9655-65aaec7d045a service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Refreshing network info cache for port 471ddb2d-7086-42f3-ab67-6a08a38d0585 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:20:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-ef031f41-520d-4294-a025-c36f99c548d8 req-4f0ab238-b8f6-429e-94d1-4c9549eee33a service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received event network-vif-plugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:20:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ef031f41-520d-4294-a025-c36f99c548d8 req-4f0ab238-b8f6-429e-94d1-4c9549eee33a service nova] Acquiring lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:20:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ef031f41-520d-4294-a025-c36f99c548d8 req-4f0ab238-b8f6-429e-94d1-4c9549eee33a service nova] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:20:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ef031f41-520d-4294-a025-c36f99c548d8 req-4f0ab238-b8f6-429e-94d1-4c9549eee33a service nova] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:20:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-ef031f41-520d-4294-a025-c36f99c548d8 req-4f0ab238-b8f6-429e-94d1-4c9549eee33a service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] No waiting events found dispatching network-vif-plugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:20:16 user nova-compute[73469]: WARNING nova.compute.manager [req-ef031f41-520d-4294-a025-c36f99c548d8 req-4f0ab238-b8f6-429e-94d1-4c9549eee33a service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received unexpected event network-vif-plugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 for instance with vm_state building and task_state spawning.
Aug 22 03:20:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:17 user nova-compute[73469]: DEBUG nova.network.neutron [req-8a24f0d4-91d4-4c9f-95f9-5071f4d58b7d req-010485f9-b5bf-44e8-9655-65aaec7d045a service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Updated VIF entry in instance network info cache for port 471ddb2d-7086-42f3-ab67-6a08a38d0585. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:20:17 user nova-compute[73469]: DEBUG nova.network.neutron [req-8a24f0d4-91d4-4c9f-95f9-5071f4d58b7d req-010485f9-b5bf-44e8-9655-65aaec7d045a service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Updating instance_info_cache with network_info: [{"id": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "address": "fa:16:3e:68:31:19", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ddb2d-70", "ovs_interfaceid": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:20:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8a24f0d4-91d4-4c9f-95f9-5071f4d58b7d req-010485f9-b5bf-44e8-9655-65aaec7d045a service nova] Releasing lock "refresh_cache-b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:20:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:18 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674418.7114203, a313534c-121a-4d89-92c9-c3ba40b78c99 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:20:18 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] VM Resumed (Lifecycle Event)
Aug 22 03:20:18 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:20:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:20:18 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Instance spawned successfully.
Aug 22 03:20:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:20:18 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:20:18 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:20:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-a3039d7c-dcbb-4bb3-b97d-77935574811f req-24e39be2-8554-475f-aa9c-158d74371e69 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received event network-vif-plugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:20:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a3039d7c-dcbb-4bb3-b97d-77935574811f req-24e39be2-8554-475f-aa9c-158d74371e69 service nova] Acquiring lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:20:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a3039d7c-dcbb-4bb3-b97d-77935574811f req-24e39be2-8554-475f-aa9c-158d74371e69 service nova] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:20:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a3039d7c-dcbb-4bb3-b97d-77935574811f req-24e39be2-8554-475f-aa9c-158d74371e69 service nova] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:20:18 user nova-compute[73469]: DEBUG nova.compute.manager [req-a3039d7c-dcbb-4bb3-b97d-77935574811f req-24e39be2-8554-475f-aa9c-158d74371e69 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] No waiting events found dispatching network-vif-plugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:20:18 user nova-compute[73469]: WARNING nova.compute.manager [req-a3039d7c-dcbb-4bb3-b97d-77935574811f req-24e39be2-8554-475f-aa9c-158d74371e69 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received unexpected event network-vif-plugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 for instance with vm_state building and task_state spawning.
Aug 22 03:20:18 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:20:18 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674418.7126575, a313534c-121a-4d89-92c9-c3ba40b78c99 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:20:18 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] VM Started (Lifecycle Event)
Aug 22 03:20:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:20:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:20:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:20:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:20:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:20:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:20:18 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:20:18 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:20:18 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:20:18 user nova-compute[73469]: INFO nova.compute.manager [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Took 6.12 seconds to spawn the instance on the hypervisor.
Aug 22 03:20:18 user nova-compute[73469]: DEBUG nova.compute.manager [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:20:18 user nova-compute[73469]: INFO nova.compute.manager [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Took 6.78 seconds to build instance.
Aug 22 03:20:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-4fccd7bd-23e4-41a3-8257-cb76e044e1e6 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.093s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:20:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG nova.objects.instance [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'flavor' on Instance uuid b01e4c17-2e37-4c89-9827-4d89f4a0b8ad {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:20:21 user nova-compute[73469]: INFO nova.compute.manager [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Attaching volume 801c770c-f861-448d-8975-c94721f92725 to /dev/vdb
Aug 22 03:20:21 user nova-compute[73469]: DEBUG os_brick.utils [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a5ad88-0818-4e0d-948b-32590b3ef9b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[65286f9b-863c-41e8-ab15-00fdc1b7cae8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d7d1c0-ed30-402a-9e5a-e9370782e884]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97467b7-5d67-4ff3-8c35-67d231772191]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:20:21 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:20:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[78334979-84b0-4e90-9369-1d5c96e4798f]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG os_brick.utils [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:20:21 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Updating existing volume attachment record: 41d3f48b-4a48-445c-a845-434063f4d4d3 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:20:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:20:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:20:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:20:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:20:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRVIBLDv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:20:32 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:20:32 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:20:32 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce69431c-1b17-46a6-994f-b247ff8a176c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:20:32 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9818aa48-1a28-44bb-9ca1-0bad49c254e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725] added
Aug 22 03:20:32 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9b78f2-30aa-4c23-9860-420e41e40bd2]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[443e4c73-0bcd-4fbd-83fe-0330505f33ab]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRVIBLDv {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRVIBLDv" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b15f991-6418-4c17-926e-2041e2d611f6]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MRVIBLDv'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d577a98d-5b5b-4b1c-a96d-b637fee0fce4]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ea6130-1ec0-4d10-84f9-15bc448eeef9]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)
Aug 22 03:20:32 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)
Aug 22 03:20:32 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[612cedfa-6299-4732-befb-0bde64211a6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725, portal: 172.16.0.220,3260]
Aug 22 03:20:32 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725, portal: 172.16.0.220,3260] successful.
Aug 22 03:20:32 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9dc7bc-1a77-421c-8ef1-92e99e7cc0a2]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[429d9774-8a27-4c9f-b33d-1d661d1bdbe3]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)
Aug 22 03:20:32 user nova-compute[73469]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 (non-flash)
Aug 22 03:20:32 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)
Aug 22 03:20:32 user nova-compute[73469]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 (non-flash)
Aug 22 03:20:32 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d5ca7e-4be1-4dca-aa86-d4cc2b64021e]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:20:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRVIBLDv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:20:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:20:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26631386431393932', 'path': '/dev/sdc'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:20:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631386431393932', 'path': '/dev/sdc'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:20:33 user nova-compute[73469]: DEBUG nova.objects.instance [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'flavor' on Instance uuid b01e4c17-2e37-4c89-9827-4d89f4a0b8ad {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:20:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:20:33 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:20:33 user nova-compute[73469]:   <source dev="/dev/sdc"/>
Aug 22 03:20:33 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:20:33 user nova-compute[73469]:   <serial>801c770c-f861-448d-8975-c94721f92725</serial>
Aug 22 03:20:33 user nova-compute[73469]: </disk>
Aug 22 03:20:33 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:20:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:20:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:20:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] No VIF found with MAC fa:16:3e:68:31:19, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:20:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5383c2dd-b7df-48fd-b02d-210f5de29f27 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.756s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:20:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:20:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:20:34 user nova-compute[73469]: INFO nova.compute.manager [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Detaching volume 801c770c-f861-448d-8975-c94721f92725
Aug 22 03:20:34 user nova-compute[73469]: INFO nova.virt.block_device [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Attempting to driver detach volume 801c770c-f861-448d-8975-c94721f92725 from mountpoint /dev/vdb
Aug 22 03:20:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Attempting to detach device vdb from instance b01e4c17-2e37-4c89-9827-4d89f4a0b8ad from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:20:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:20:34 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:20:34 user nova-compute[73469]:   <source dev="/dev/sdc"/>
Aug 22 03:20:34 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:20:34 user nova-compute[73469]:   <serial>801c770c-f861-448d-8975-c94721f92725</serial>
Aug 22 03:20:34 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:20:34 user nova-compute[73469]: </disk>
Aug 22 03:20:34 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:20:34 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Successfully detached device vdb from instance b01e4c17-2e37-4c89-9827-4d89f4a0b8ad from the persistent domain config.
Aug 22 03:20:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b01e4c17-2e37-4c89-9827-4d89f4a0b8ad from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:20:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:20:34 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:20:34 user nova-compute[73469]:   <source dev="/dev/sdc"/>
Aug 22 03:20:34 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:20:34 user nova-compute[73469]:   <serial>801c770c-f861-448d-8975-c94721f92725</serial>
Aug 22 03:20:34 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:20:34 user nova-compute[73469]: </disk>
Aug 22 03:20:34 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692674435.2475793, b01e4c17-2e37-4c89-9827-4d89f4a0b8ad => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b01e4c17-2e37-4c89-9827-4d89f4a0b8ad {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:20:35 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Successfully detached device vdb from instance b01e4c17-2e37-4c89-9827-4d89f4a0b8ad from the live domain config.
Aug 22 03:20:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRVIBLDv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:20:35 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:20:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98f6eb9-6b6e-4cae-923d-a8067b9f6c95]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cf1cac-28fb-4284-9795-45cecf6d10b9]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)
Aug 22 03:20:35 user nova-compute[73469]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 (non-flash)
Aug 22 03:20:35 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)
Aug 22 03:20:35 user nova-compute[73469]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 (non-flash)
Aug 22 03:20:35 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7980781870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725'): ({'sdc'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Removing single pathed devices sdc {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[899bc95e-0b34-4665-b651-495c3af460e0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc3f2a5-962e-4b96-a046-7f7e4369b670]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Flushing IO for device /dev/sdc {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d552b6d4-74da-430a-aff0-ff94cae639be]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a065fd9-f21d-4e3a-bae6-e9f109456072]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[510b7078-b592-40f1-9d5b-47e1ae6a157a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b212f0-db5a-428c-860e-ad316670672b]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725, portal: 172.16.0.220,3260]
Aug 22 03:20:35 user nova-compute[73469]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725, portal: 172.16.0.220,3260] successful.
Aug 22 03:20:35 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801c770c-f861-448d-8975-c94721f92725 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0eb4a4c-3e9b-4acb-9356-54d42c7f703a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] <== disconnect_volume: return (264ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:20:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:20:36 user nova-compute[73469]: DEBUG nova.objects.instance [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'flavor' on Instance uuid b01e4c17-2e37-4c89-9827-4d89f4a0b8ad {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:20:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-fba8896e-170c-4fc5-bcf7-48be3101f05c tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.627s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:20:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:20:56 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:20:56 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:20:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:20:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-fc2d4944-90fa-4b9c-b94d-2bcab9078708" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:20:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-fc2d4944-90fa-4b9c-b94d-2bcab9078708" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:20:56 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:20:57 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Updating instance_info_cache with network_info: [{"id": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "address": "fa:16:3e:b5:3f:54", "network": {"id": "39acbbc6-2fd4-44ee-8aa0-8931baff1f3b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c3ce6b6b36b4531a48d91ae3d6ed128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd513f095-ab", "ovs_interfaceid": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:20:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-fc2d4944-90fa-4b9c-b94d-2bcab9078708" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:20:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:20:58 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:20:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:20:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:20:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:21:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:21:00 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:21:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:21:01 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:21:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:21:01 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:21:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:21:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:21:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:21:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:21:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:21:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:21:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:21:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:21:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:21:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:21:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:21:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:21:03 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:21:03 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:21:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8207MB free_disk=25.145023345947266GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:21:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance b01e4c17-2e37-4c89-9827-4d89f4a0b8ad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:21:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance fc2d4944-90fa-4b9c-b94d-2bcab9078708 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:21:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 2bcb99db-a352-4c77-a316-4152e82338c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:21:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a313534c-121a-4d89-92c9-c3ba40b78c99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:21:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:21:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:21:03 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:21:03 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:21:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:21:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:04 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:21:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:06 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:21:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Acquiring lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Acquiring lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:12 user nova-compute[73469]: INFO nova.compute.manager [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Terminating instance
Aug 22 03:21:12 user nova-compute[73469]: DEBUG nova.compute.manager [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG nova.compute.manager [req-cb223502-71d0-47da-b607-850125a724dd req-a1cfcfca-9386-4160-ad08-900f414dd66a service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Received event network-vif-unplugged-d513f095-ab50-446d-8ef4-b291e33ba3f0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cb223502-71d0-47da-b607-850125a724dd req-a1cfcfca-9386-4160-ad08-900f414dd66a service nova] Acquiring lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cb223502-71d0-47da-b607-850125a724dd req-a1cfcfca-9386-4160-ad08-900f414dd66a service nova] Lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cb223502-71d0-47da-b607-850125a724dd req-a1cfcfca-9386-4160-ad08-900f414dd66a service nova] Lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG nova.compute.manager [req-cb223502-71d0-47da-b607-850125a724dd req-a1cfcfca-9386-4160-ad08-900f414dd66a service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] No waiting events found dispatching network-vif-unplugged-d513f095-ab50-446d-8ef4-b291e33ba3f0 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG nova.compute.manager [req-cb223502-71d0-47da-b607-850125a724dd req-a1cfcfca-9386-4160-ad08-900f414dd66a service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Received event network-vif-unplugged-d513f095-ab50-446d-8ef4-b291e33ba3f0 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:21:12 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Instance destroyed successfully.
Aug 22 03:21:12 user nova-compute[73469]: DEBUG nova.objects.instance [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Lazy-loading 'resources' on Instance uuid fc2d4944-90fa-4b9c-b94d-2bcab9078708 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:19:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1740021099',display_name='tempest-VolumesNegativeTest-instance-1740021099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1740021099',id=42,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:19:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66f44e4e3e8b4ddd93458eafb5dea5dd',ramdisk_id='',reservation_id='r-90y4tde4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-413750711',owner_user_name='tempest-VolumesNegativeTest-413750711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:19:29Z,user_data=None,user_id='3fd15d338f304d51aadd43537558d88f',uuid=fc2d4944-90fa-4b9c-b94d-2bcab9078708,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "address": "fa:16:3e:b5:3f:54", "network": {"id": "39acbbc6-2fd4-44ee-8aa0-8931baff1f3b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c3ce6b6b36b4531a48d91ae3d6ed128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd513f095-ab", "ovs_interfaceid": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Converting VIF {"id": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "address": "fa:16:3e:b5:3f:54", "network": {"id": "39acbbc6-2fd4-44ee-8aa0-8931baff1f3b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c3ce6b6b36b4531a48d91ae3d6ed128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd513f095-ab", "ovs_interfaceid": "d513f095-ab50-446d-8ef4-b291e33ba3f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:3f:54,bridge_name='br-int',has_traffic_filtering=True,id=d513f095-ab50-446d-8ef4-b291e33ba3f0,network=Network(39acbbc6-2fd4-44ee-8aa0-8931baff1f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd513f095-ab') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG os_vif [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:3f:54,bridge_name='br-int',has_traffic_filtering=True,id=d513f095-ab50-446d-8ef4-b291e33ba3f0,network=Network(39acbbc6-2fd4-44ee-8aa0-8931baff1f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd513f095-ab') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd513f095-ab, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:21:12 user nova-compute[73469]: INFO os_vif [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:3f:54,bridge_name='br-int',has_traffic_filtering=True,id=d513f095-ab50-446d-8ef4-b291e33ba3f0,network=Network(39acbbc6-2fd4-44ee-8aa0-8931baff1f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd513f095-ab')
Aug 22 03:21:12 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Deleting instance files /opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708_del
Aug 22 03:21:12 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Deletion of /opt/stack/data/nova/instances/fc2d4944-90fa-4b9c-b94d-2bcab9078708_del complete
Aug 22 03:21:12 user nova-compute[73469]: INFO nova.compute.manager [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 22 03:21:12 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:21:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:13 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:21:13 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Took 0.48 seconds to deallocate network for instance.
Aug 22 03:21:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-1cfd81b0-da0f-4b94-977c-16414aa79fd4 req-98df186c-1a34-4a65-aedb-341bc3144f9f service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Received event network-vif-deleted-d513f095-ab50-446d-8ef4-b291e33ba3f0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:21:13 user nova-compute[73469]: INFO nova.compute.manager [req-1cfd81b0-da0f-4b94-977c-16414aa79fd4 req-98df186c-1a34-4a65-aedb-341bc3144f9f service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Neutron deleted interface d513f095-ab50-446d-8ef4-b291e33ba3f0; detaching it from the instance and deleting it from the info cache
Aug 22 03:21:13 user nova-compute[73469]: DEBUG nova.network.neutron [req-1cfd81b0-da0f-4b94-977c-16414aa79fd4 req-98df186c-1a34-4a65-aedb-341bc3144f9f service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:21:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-1cfd81b0-da0f-4b94-977c-16414aa79fd4 req-98df186c-1a34-4a65-aedb-341bc3144f9f service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Detach interface failed, port_id=d513f095-ab50-446d-8ef4-b291e33ba3f0, reason: Instance fc2d4944-90fa-4b9c-b94d-2bcab9078708 could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 03:21:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:13 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:21:13 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:21:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:13 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Deleted allocations for instance fc2d4944-90fa-4b9c-b94d-2bcab9078708
Aug 22 03:21:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-2def116f-77ae-456d-850d-a35ae35e27b6 tempest-VolumesNegativeTest-413750711 tempest-VolumesNegativeTest-413750711-project-member] Lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.538s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-89520107-7c1f-47ea-89d2-32fd9a7b821e req-16aeff42-b3c3-47c9-a838-69caa8c2402f service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Received event network-vif-plugged-d513f095-ab50-446d-8ef4-b291e33ba3f0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:21:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-89520107-7c1f-47ea-89d2-32fd9a7b821e req-16aeff42-b3c3-47c9-a838-69caa8c2402f service nova] Acquiring lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-89520107-7c1f-47ea-89d2-32fd9a7b821e req-16aeff42-b3c3-47c9-a838-69caa8c2402f service nova] Lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-89520107-7c1f-47ea-89d2-32fd9a7b821e req-16aeff42-b3c3-47c9-a838-69caa8c2402f service nova] Lock "fc2d4944-90fa-4b9c-b94d-2bcab9078708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-89520107-7c1f-47ea-89d2-32fd9a7b821e req-16aeff42-b3c3-47c9-a838-69caa8c2402f service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] No waiting events found dispatching network-vif-plugged-d513f095-ab50-446d-8ef4-b291e33ba3f0 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:21:14 user nova-compute[73469]: WARNING nova.compute.manager [req-89520107-7c1f-47ea-89d2-32fd9a7b821e req-16aeff42-b3c3-47c9-a838-69caa8c2402f service nova] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Received unexpected event network-vif-plugged-d513f095-ab50-446d-8ef4-b291e33ba3f0 for instance with vm_state deleted and task_state None.
Aug 22 03:21:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:25 user nova-compute[73469]: INFO nova.compute.manager [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Terminating instance
Aug 22 03:21:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG nova.compute.manager [req-9c204f6f-721c-4e3f-b7f1-ef81d64b18e4 req-27dfca8c-a6e4-4c08-aedd-5a569e5895e0 service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Received event network-vif-unplugged-471ddb2d-7086-42f3-ab67-6a08a38d0585 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9c204f6f-721c-4e3f-b7f1-ef81d64b18e4 req-27dfca8c-a6e4-4c08-aedd-5a569e5895e0 service nova] Acquiring lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9c204f6f-721c-4e3f-b7f1-ef81d64b18e4 req-27dfca8c-a6e4-4c08-aedd-5a569e5895e0 service nova] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9c204f6f-721c-4e3f-b7f1-ef81d64b18e4 req-27dfca8c-a6e4-4c08-aedd-5a569e5895e0 service nova] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG nova.compute.manager [req-9c204f6f-721c-4e3f-b7f1-ef81d64b18e4 req-27dfca8c-a6e4-4c08-aedd-5a569e5895e0 service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] No waiting events found dispatching network-vif-unplugged-471ddb2d-7086-42f3-ab67-6a08a38d0585 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG nova.compute.manager [req-9c204f6f-721c-4e3f-b7f1-ef81d64b18e4 req-27dfca8c-a6e4-4c08-aedd-5a569e5895e0 service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Received event network-vif-unplugged-471ddb2d-7086-42f3-ab67-6a08a38d0585 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:21:25 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Instance destroyed successfully.
Aug 22 03:21:25 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lazy-loading 'resources' on Instance uuid b01e4c17-2e37-4c89-9827-4d89f4a0b8ad {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:18:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-897364723',display_name='tempest-AttachVolumeNegativeTest-server-897364723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-897364723',id=41,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBwJrX9Ku/2C3IIx62t6RzPvda/207lPihK6pdddLjuut+hdp+3C2rR5gUBEiDAEX8SHQRjZ421wOvzH6N3XVGqrm822n5sughxmJXPMWjmbxMKjI937F873qaKgXYMyg==',key_name='tempest-keypair-9834392',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:18:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab150042073d4977b15414a3062d82fd',ramdisk_id='',reservation_id='r-blt4fg20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-356032718',owner_user_name='tempest-AttachVolumeNegativeTest-356032718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:18:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25b830ec1451440f911d6578c8c55f3d',uuid=b01e4c17-2e37-4c89-9827-4d89f4a0b8ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "address": "fa:16:3e:68:31:19", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ddb2d-70", "ovs_interfaceid": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converting VIF {"id": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "address": "fa:16:3e:68:31:19", "network": {"id": "c05229f0-9acd-4868-bc9a-b1485882fa56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1482164319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab150042073d4977b15414a3062d82fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ddb2d-70", "ovs_interfaceid": "471ddb2d-7086-42f3-ab67-6a08a38d0585", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:31:19,bridge_name='br-int',has_traffic_filtering=True,id=471ddb2d-7086-42f3-ab67-6a08a38d0585,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ddb2d-70') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG os_vif [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:31:19,bridge_name='br-int',has_traffic_filtering=True,id=471ddb2d-7086-42f3-ab67-6a08a38d0585,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ddb2d-70') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap471ddb2d-70, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:21:25 user nova-compute[73469]: INFO os_vif [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:31:19,bridge_name='br-int',has_traffic_filtering=True,id=471ddb2d-7086-42f3-ab67-6a08a38d0585,network=Network(c05229f0-9acd-4868-bc9a-b1485882fa56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ddb2d-70')
Aug 22 03:21:25 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Deleting instance files /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad_del
Aug 22 03:21:25 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Deletion of /opt/stack/data/nova/instances/b01e4c17-2e37-4c89-9827-4d89f4a0b8ad_del complete
Aug 22 03:21:25 user nova-compute[73469]: INFO nova.compute.manager [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Took 0.82 seconds to destroy the instance on the hypervisor.
Aug 22 03:21:25 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:21:25 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:21:26 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:21:26 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Took 1.01 seconds to deallocate network for instance.
Aug 22 03:21:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:27 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:21:27 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:21:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:27 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Deleted allocations for instance b01e4c17-2e37-4c89-9827-4d89f4a0b8ad
Aug 22 03:21:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b6e927e1-9022-4b10-b35c-528dd8f7e386 tempest-AttachVolumeNegativeTest-356032718 tempest-AttachVolumeNegativeTest-356032718-project-member] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.297s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-7a38a237-89d9-4be1-a93a-9c9ac6e0fb9f req-aaa4af95-33c3-4469-946a-d780a3efa272 service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Received event network-vif-plugged-471ddb2d-7086-42f3-ab67-6a08a38d0585 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:21:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7a38a237-89d9-4be1-a93a-9c9ac6e0fb9f req-aaa4af95-33c3-4469-946a-d780a3efa272 service nova] Acquiring lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7a38a237-89d9-4be1-a93a-9c9ac6e0fb9f req-aaa4af95-33c3-4469-946a-d780a3efa272 service nova] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7a38a237-89d9-4be1-a93a-9c9ac6e0fb9f req-aaa4af95-33c3-4469-946a-d780a3efa272 service nova] Lock "b01e4c17-2e37-4c89-9827-4d89f4a0b8ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-7a38a237-89d9-4be1-a93a-9c9ac6e0fb9f req-aaa4af95-33c3-4469-946a-d780a3efa272 service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] No waiting events found dispatching network-vif-plugged-471ddb2d-7086-42f3-ab67-6a08a38d0585 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:21:27 user nova-compute[73469]: WARNING nova.compute.manager [req-7a38a237-89d9-4be1-a93a-9c9ac6e0fb9f req-aaa4af95-33c3-4469-946a-d780a3efa272 service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Received unexpected event network-vif-plugged-471ddb2d-7086-42f3-ab67-6a08a38d0585 for instance with vm_state deleted and task_state None.
Aug 22 03:21:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-7a38a237-89d9-4be1-a93a-9c9ac6e0fb9f req-aaa4af95-33c3-4469-946a-d780a3efa272 service nova] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Received event network-vif-deleted-471ddb2d-7086-42f3-ab67-6a08a38d0585 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:21:27 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692674472.647089, fc2d4944-90fa-4b9c-b94d-2bcab9078708 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:21:27 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] VM Stopped (Lifecycle Event)
Aug 22 03:21:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-76a41125-bcdc-426e-9822-2da6408ae1cb None None] [instance: fc2d4944-90fa-4b9c-b94d-2bcab9078708] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:21:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-b5e85116-347a-4c18-99ba-d00bbb2bc079 req-3c0469e8-979c-4cbf-a382-0cd31335c10b service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-changed-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:21:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-b5e85116-347a-4c18-99ba-d00bbb2bc079 req-3c0469e8-979c-4cbf-a382-0cd31335c10b service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Refreshing instance network info cache due to event network-changed-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:21:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b5e85116-347a-4c18-99ba-d00bbb2bc079 req-3c0469e8-979c-4cbf-a382-0cd31335c10b service nova] Acquiring lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:21:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b5e85116-347a-4c18-99ba-d00bbb2bc079 req-3c0469e8-979c-4cbf-a382-0cd31335c10b service nova] Acquired lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:21:28 user nova-compute[73469]: DEBUG nova.network.neutron [req-b5e85116-347a-4c18-99ba-d00bbb2bc079 req-3c0469e8-979c-4cbf-a382-0cd31335c10b service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Refreshing network info cache for port 127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:21:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:29 user nova-compute[73469]: DEBUG nova.network.neutron [req-b5e85116-347a-4c18-99ba-d00bbb2bc079 req-3c0469e8-979c-4cbf-a382-0cd31335c10b service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Updated VIF entry in instance network info cache for port 127c6ea8-1f9e-43ed-8bf1-aeeda044ddce. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:21:29 user nova-compute[73469]: DEBUG nova.network.neutron [req-b5e85116-347a-4c18-99ba-d00bbb2bc079 req-3c0469e8-979c-4cbf-a382-0cd31335c10b service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Updating instance_info_cache with network_info: [{"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:21:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "2bcb99db-a352-4c77-a316-4152e82338c5" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "2bcb99db-a352-4c77-a316-4152e82338c5" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:29 user nova-compute[73469]: INFO nova.compute.manager [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Shelve offloading
Aug 22 03:21:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b5e85116-347a-4c18-99ba-d00bbb2bc079 req-3c0469e8-979c-4cbf-a382-0cd31335c10b service nova] Releasing lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:21:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:29 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Instance destroyed successfully.
Aug 22 03:21:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:21:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:21:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquired lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:21:29 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:21:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-ee2097f1-2165-4538-9ea6-723ddb657fe8 req-eb9f7909-b277-4e84-a9b7-a34d37e07fa7 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-vif-unplugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:21:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ee2097f1-2165-4538-9ea6-723ddb657fe8 req-eb9f7909-b277-4e84-a9b7-a34d37e07fa7 service nova] Acquiring lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ee2097f1-2165-4538-9ea6-723ddb657fe8 req-eb9f7909-b277-4e84-a9b7-a34d37e07fa7 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ee2097f1-2165-4538-9ea6-723ddb657fe8 req-eb9f7909-b277-4e84-a9b7-a34d37e07fa7 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-ee2097f1-2165-4538-9ea6-723ddb657fe8 req-eb9f7909-b277-4e84-a9b7-a34d37e07fa7 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] No waiting events found dispatching network-vif-unplugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:21:30 user nova-compute[73469]: WARNING nova.compute.manager [req-ee2097f1-2165-4538-9ea6-723ddb657fe8 req-eb9f7909-b277-4e84-a9b7-a34d37e07fa7 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received unexpected event network-vif-unplugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce for instance with vm_state active and task_state shelving.
Aug 22 03:21:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:30 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Updating instance_info_cache with network_info: [{"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:21:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Releasing lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:21:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Instance destroyed successfully.
Aug 22 03:21:31 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lazy-loading 'resources' on Instance uuid 2bcb99db-a352-4c77-a316-4152e82338c5 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:21:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:19:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1181981432',display_name='tempest-TestShelveInstance-server-1181981432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1181981432',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzGYbmnNPkHPTRx3w8VWXAlw/Q/LgDOaaME96KoTCtSUTjMCTJ+U401e/nhUc6cx6MB2fv6e8DSAeZ5AwQ0e6UX+qlxOasf8XXGwiMLIx3O/oMndmKunkdGEDkDMOx/cQ==',key_name='tempest-TestShelveInstance-789183110',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:19:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a535e1201fc482fb98a779de2f2eb22',ramdisk_id='',reservation_id='r-z93obrmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1878913405',owner_user_name='tempest-TestShelveInstance-1878913405-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:19:54Z,user_data=None,user_id='39da6c4b4af346adb57ef59ed72d6336',uuid=2bcb99db-a352-4c77-a316-4152e82338c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:21:31 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Converting VIF {"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:21:31 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:9e:f4,bridge_name='br-int',has_traffic_filtering=True,id=127c6ea8-1f9e-43ed-8bf1-aeeda044ddce,network=Network(346ff46f-cc3e-4807-b97d-54434298bce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127c6ea8-1f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:21:31 user nova-compute[73469]: DEBUG os_vif [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:9e:f4,bridge_name='br-int',has_traffic_filtering=True,id=127c6ea8-1f9e-43ed-8bf1-aeeda044ddce,network=Network(346ff46f-cc3e-4807-b97d-54434298bce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127c6ea8-1f') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:21:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap127c6ea8-1f, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:21:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:21:31 user nova-compute[73469]: INFO os_vif [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:9e:f4,bridge_name='br-int',has_traffic_filtering=True,id=127c6ea8-1f9e-43ed-8bf1-aeeda044ddce,network=Network(346ff46f-cc3e-4807-b97d-54434298bce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127c6ea8-1f')
Aug 22 03:21:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:21:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGrLlCIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:21:31 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:21:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:21:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:21:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:21:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:21:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:21:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5369b4-328c-47e4-a06c-31bb43601bad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:21:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[da17c197-e4bf-4245-87a3-9eb0abde3587]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)
Aug 22 03:21:32 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)
Aug 22 03:21:32 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a47777f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a3edb9-b40d-4251-8cc1-e72e2e423449]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c2c324-23a8-40fa-b266-1c72cb99fec8]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9158538b-87f6-4511-8812-eb02a04ec380]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f00776-f632-467a-a85d-47f02f320ad8]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[474255ce-5a44-4602-9f3e-aba518efb69a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Acquiring lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] No waiting events found dispatching network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:21:32 user nova-compute[73469]: WARNING nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received unexpected event network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce for instance with vm_state active and task_state shelving.
Aug 22 03:21:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Acquiring lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] No waiting events found dispatching network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:21:32 user nova-compute[73469]: WARNING nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received unexpected event network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce for instance with vm_state active and task_state shelving.
Aug 22 03:21:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Acquiring lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] No waiting events found dispatching network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:21:32 user nova-compute[73469]: WARNING nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received unexpected event network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce for instance with vm_state active and task_state shelving.
Aug 22 03:21:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-vif-unplugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Acquiring lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] No waiting events found dispatching network-vif-unplugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:21:32 user nova-compute[73469]: WARNING nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received unexpected event network-vif-unplugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce for instance with vm_state active and task_state shelving.
Aug 22 03:21:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-vif-unplugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Acquiring lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] No waiting events found dispatching network-vif-unplugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:21:32 user nova-compute[73469]: WARNING nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received unexpected event network-vif-unplugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce for instance with vm_state active and task_state shelving.
Aug 22 03:21:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-changed-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Refreshing instance network info cache due to event network-changed-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Acquiring lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Acquired lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG nova.network.neutron [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Refreshing network info cache for port 127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1c28fe-50cc-4609-b77d-60d1afec6dd8]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b, portal: 172.16.0.220,3260]
Aug 22 03:21:32 user nova-compute[73469]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b, portal: 172.16.0.220,3260] successful.
Aug 22 03:21:32 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e2109c-03fc-4cfc-8dac-3dcb73a1961a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] <== disconnect_volume: return (269ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:21:32 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Deleting instance files /opt/stack/data/nova/instances/2bcb99db-a352-4c77-a316-4152e82338c5_del
Aug 22 03:21:32 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Deletion of /opt/stack/data/nova/instances/2bcb99db-a352-4c77-a316-4152e82338c5_del complete
Aug 22 03:21:32 user nova-compute[73469]: DEBUG nova.network.neutron [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Updated VIF entry in instance network info cache for port 127c6ea8-1f9e-43ed-8bf1-aeeda044ddce. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG nova.network.neutron [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Updating instance_info_cache with network_info: [{"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": null, "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Releasing lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Acquiring lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] No waiting events found dispatching network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:21:32 user nova-compute[73469]: WARNING nova.compute.manager [req-61d1fb7d-e945-4a3d-9f22-99c09940d3e5 req-57ad7c2b-838b-41cf-b16c-7629d6bbc745 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received unexpected event network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce for instance with vm_state active and task_state shelving.
Aug 22 03:21:33 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Deleted allocations for instance 2bcb99db-a352-4c77-a316-4152e82338c5
Aug 22 03:21:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:21:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:21:33 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lazy-loading 'numa_topology' on Instance uuid 2bcb99db-a352-4c77-a316-4152e82338c5 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:21:33 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:21:33 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:21:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ae5e74bc-87bc-470e-8eb1-1c4e88bf02e0 tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "2bcb99db-a352-4c77-a316-4152e82338c5" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.347s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:21:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:40 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692674485.769318, b01e4c17-2e37-4c89-9827-4d89f4a0b8ad => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:21:40 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] VM Stopped (Lifecycle Event)
Aug 22 03:21:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-0ee5a24a-3e1e-4080-8b9b-f8bb8b40072b None None] [instance: b01e4c17-2e37-4c89-9827-4d89f4a0b8ad] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:21:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:44 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692674489.8297756, 2bcb99db-a352-4c77-a316-4152e82338c5 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:21:44 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] VM Stopped (Lifecycle Event)
Aug 22 03:21:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-0ea4903f-fc82-4b85-8312-2b78b2ab1863 None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:21:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:56 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:21:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:21:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Skipping network cache update for instance because it has been migrated to another host. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 22 03:21:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Didn't find any instances for network info cache update. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 22 03:21:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:21:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:21:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:21:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:00 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:22:00 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:22:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:22:01 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:22:01 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:22:01 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:22:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:22:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:22:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:22:01 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:22:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:01 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:02 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:22:02 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:22:02 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8610MB free_disk=25.19864273071289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:22:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:22:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:22:02 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a313534c-121a-4d89-92c9-c3ba40b78c99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:22:02 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:22:02 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:22:02 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:22:02 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:22:02 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:22:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:22:03 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:22:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:04 user nova-compute[73469]: DEBUG nova.compute.manager [req-265fd0b4-ed59-4261-ab27-b0b37dd2d21a req-94d697a6-3560-42af-8b0e-8f427a823bcb service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received event network-changed-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:22:04 user nova-compute[73469]: DEBUG nova.compute.manager [req-265fd0b4-ed59-4261-ab27-b0b37dd2d21a req-94d697a6-3560-42af-8b0e-8f427a823bcb service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Refreshing instance network info cache due to event network-changed-2855f6eb-f5d9-46a6-a9d1-6b00ae364250. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:22:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-265fd0b4-ed59-4261-ab27-b0b37dd2d21a req-94d697a6-3560-42af-8b0e-8f427a823bcb service nova] Acquiring lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:22:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-265fd0b4-ed59-4261-ab27-b0b37dd2d21a req-94d697a6-3560-42af-8b0e-8f427a823bcb service nova] Acquired lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:22:04 user nova-compute[73469]: DEBUG nova.network.neutron [req-265fd0b4-ed59-4261-ab27-b0b37dd2d21a req-94d697a6-3560-42af-8b0e-8f427a823bcb service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Refreshing network info cache for port 2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:22:05 user nova-compute[73469]: DEBUG nova.network.neutron [req-265fd0b4-ed59-4261-ab27-b0b37dd2d21a req-94d697a6-3560-42af-8b0e-8f427a823bcb service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Updated VIF entry in instance network info cache for port 2855f6eb-f5d9-46a6-a9d1-6b00ae364250. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:22:05 user nova-compute[73469]: DEBUG nova.network.neutron [req-265fd0b4-ed59-4261-ab27-b0b37dd2d21a req-94d697a6-3560-42af-8b0e-8f427a823bcb service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Updating instance_info_cache with network_info: [{"id": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "address": "fa:16:3e:69:71:05", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2855f6eb-f5", "ovs_interfaceid": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:22:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-265fd0b4-ed59-4261-ab27-b0b37dd2d21a req-94d697a6-3560-42af-8b0e-8f427a823bcb service nova] Releasing lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:22:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "a313534c-121a-4d89-92c9-c3ba40b78c99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:22:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:22:05 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lazy-loading 'flavor' on Instance uuid a313534c-121a-4d89-92c9-c3ba40b78c99 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:22:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:22:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "a313534c-121a-4d89-92c9-c3ba40b78c99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:22:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:22:05 user nova-compute[73469]: INFO nova.compute.manager [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Attaching volume ef20241b-2e22-464d-b3a7-925be566f58a to /dev/vdb
Aug 22 03:22:06 user nova-compute[73469]: DEBUG os_brick.utils [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ad6f84-5191-48ee-9b5f-84821fd6a2e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47fe102-5ec8-41e2-b06e-3a4253d72002]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d6d589-9b1f-4e0c-9482-cb78540b65c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4fd0db-6f5b-4711-97f8-58456133d939]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:22:06 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:22:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c6b1cf-ecbd-4105-8258-6b32d1ccbc9b]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG os_brick.utils [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Updating existing volume attachment record: f8cf397f-eec0-46ef-8bea-d59f4f7dd4db {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:22:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:07 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:22:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JLyngTlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:22:16 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:22:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:22:16 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:22:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:22:16 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f1b3bc-52c6-4699-bc86-042dd9501428]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:22:16 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acd56cd-9b07-4f89-b0de-a910b3a72350]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a] added
Aug 22 03:22:16 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7f026a-2e7d-48b8-bc7e-54ffe42694d6]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[08eb5abc-9344-4bd3-9170-3bffd19ef0b5]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JLyngTlD {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JLyngTlD" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[994fcd20-b1e3-49b3-b93c-1a1f176fa5cc]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JLyngTlD'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1046576-b8d9-467c-996b-1424a2d92a64]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8444c2f3-54bb-432a-bf75-c6420817e020]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:22:16 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:22:16 user nova-compute[73469]:  {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:22:16 user nova-compute[73469]: WARNING os_brick.initiator.connectors.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 22 03:22:16 user nova-compute[73469]: 
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0aba386-64bd-4ce3-95b8-5530e0bbdc3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a, portal: 172.16.0.220,3260]
Aug 22 03:22:16 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a, portal: 172.16.0.220,3260] successful.
Aug 22 03:22:16 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0001a07-1cca-46b5-9999-b3cb2b88f970]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b9b457-8641-4e0b-81ee-c56d6c876632]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a (non-flash)
Aug 22 03:22:16 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:22:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a (non-flash)
Aug 22 03:22:16 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:22:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:22:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:22:17 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:22:17 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:22:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:17 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:17 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3c250b-a537-4ab2-9e9f-947fd2fdb3ac]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:17 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:22:17 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JLyngTlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:22:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:22:18 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23136303366646262', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:22:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136303366646262', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:22:18 user nova-compute[73469]: DEBUG nova.objects.instance [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lazy-loading 'flavor' on Instance uuid a313534c-121a-4d89-92c9-c3ba40b78c99 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:22:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:22:18 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:22:18 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:22:18 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:22:18 user nova-compute[73469]:   <serial>ef20241b-2e22-464d-b3a7-925be566f58a</serial>
Aug 22 03:22:18 user nova-compute[73469]: </disk>
Aug 22 03:22:18 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:22:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:22:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:22:18 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] No VIF found with MAC fa:16:3e:69:71:05, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:22:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-b2ab1efe-02b2-41b6-91e5-ab66256b0c4f tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.802s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:22:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "a313534c-121a-4d89-92c9-c3ba40b78c99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:22:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:22:20 user nova-compute[73469]: INFO nova.compute.manager [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Detaching volume ef20241b-2e22-464d-b3a7-925be566f58a
Aug 22 03:22:20 user nova-compute[73469]: INFO nova.virt.block_device [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Attempting to driver detach volume ef20241b-2e22-464d-b3a7-925be566f58a from mountpoint /dev/vdb
Aug 22 03:22:20 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Attempting to detach device vdb from instance a313534c-121a-4d89-92c9-c3ba40b78c99 from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:22:20 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:22:20 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:22:20 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:22:20 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:22:20 user nova-compute[73469]:   <serial>ef20241b-2e22-464d-b3a7-925be566f58a</serial>
Aug 22 03:22:20 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:22:20 user nova-compute[73469]: </disk>
Aug 22 03:22:20 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:22:20 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Successfully detached device vdb from instance a313534c-121a-4d89-92c9-c3ba40b78c99 from the persistent domain config.
Aug 22 03:22:20 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a313534c-121a-4d89-92c9-c3ba40b78c99 from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:22:20 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:22:20 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:22:20 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:22:20 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:22:20 user nova-compute[73469]:   <serial>ef20241b-2e22-464d-b3a7-925be566f58a</serial>
Aug 22 03:22:20 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:22:20 user nova-compute[73469]: </disk>
Aug 22 03:22:20 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692674541.307823, a313534c-121a-4d89-92c9-c3ba40b78c99 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a313534c-121a-4d89-92c9-c3ba40b78c99 {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:22:21 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Successfully detached device vdb from instance a313534c-121a-4d89-92c9-c3ba40b78c99 from the live domain config.
Aug 22 03:22:21 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JLyngTlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:22:21 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:22:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba14a63-deb2-4aef-a95d-20fe6c4b5c4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcb9cc7-5b96-4d0e-b38a-8fead437c0cd]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a (non-flash)
Aug 22 03:22:21 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a (non-flash)
Aug 22 03:22:21 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a41c31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbca7f2-e927-4ac7-b169-07f62f41b739]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccaaf81-ae10-4682-9084-6c7a11412b88]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eba59ee-f9b6-4747-b838-4e0f1a4a5d62]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5cfafc-3007-4564-8a8d-d842f31d6152]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdd5639-48cd-43b0-a00f-ab5e456b92bc]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78abe99-7b02-46fd-9e3b-4e8adb3c12b5]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a, portal: 172.16.0.220,3260]
Aug 22 03:22:21 user nova-compute[73469]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a, portal: 172.16.0.220,3260] successful.
Aug 22 03:22:21 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef20241b-2e22-464d-b3a7-925be566f58a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3c9773-31cc-44c1-9720-a0b17d7fb826]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] <== disconnect_volume: return (271ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:22:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:22 user nova-compute[73469]: DEBUG nova.objects.instance [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lazy-loading 'flavor' on Instance uuid a313534c-121a-4d89-92c9-c3ba40b78c99 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:22:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-44f17668-f4e9-429d-bc6d-8374857e742d tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.636s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:22:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:22:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:22:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:22:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:22:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:22:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:22:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:22:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:22:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:22:56 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:22:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:22:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:22:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:22:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:22:56 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:22:56 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid a313534c-121a-4d89-92c9-c3ba40b78c99 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:22:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:22:57 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Updating instance_info_cache with network_info: [{"id": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "address": "fa:16:3e:69:71:05", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2855f6eb-f5", "ovs_interfaceid": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:22:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:22:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:22:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:23:00 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:23:01 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:23:01 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:23:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:23:02 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:23:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:23:02 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:23:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:23:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:23:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:23:02 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:23:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:03 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:23:03 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:23:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8626MB free_disk=25.186721801757812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:23:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:23:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:23:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a313534c-121a-4d89-92c9-c3ba40b78c99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:23:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:23:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:23:03 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:23:03 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:23:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:23:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:23:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:04 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:23:04 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:23:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:09 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:23:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "2bcb99db-a352-4c77-a316-4152e82338c5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "2bcb99db-a352-4c77-a316-4152e82338c5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:23:21 user nova-compute[73469]: INFO nova.compute.manager [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Unshelving
Aug 22 03:23:21 user nova-compute[73469]: INFO nova.virt.block_device [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Booting with volume 7ff20bb8-f4f1-4996-88b1-3af0822feb8b at /dev/vda
Aug 22 03:23:21 user nova-compute[73469]: DEBUG os_brick.utils [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[061852c7-8edd-4f5f-a6b8-e9ed52e9e458]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3ef8e9-434c-4cca-8397-199e9b6e2492]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62da5d6-cb86-420e-974f-380b499854d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1293f22b-9681-4d80-a4a7-23af506b1d08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:23:21 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:23:21 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a7bcf6-447d-47ab-8184-cb71b1b22d9a]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG os_brick.utils [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:23:21 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Updating existing volume attachment record: b2d0ea13-5c6e-44d8-a1b0-49c54f5172f6 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:23:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:26 user nova-compute[73469]: DEBUG nova.compute.manager [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:23:26 user nova-compute[73469]: INFO nova.compute.manager [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] instance snapshotting
Aug 22 03:23:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:27 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Beginning live snapshot process
Aug 22 03:23:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json -f qcow2 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json -f qcow2 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json -f qcow2" returned: 0 in 0.255s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.181s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps0fxza96/45d617050069422aaaef5a44a395ae98.delta 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps0fxza96/45d617050069422aaaef5a44a395ae98.delta 1073741824" returned: 0 in 0.056s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:27 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 22 03:23:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 03:23:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73469) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 22 03:23:29 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 22 03:23:29 user nova-compute[73469]: DEBUG nova.privsep.utils [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 22 03:23:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps0fxza96/45d617050069422aaaef5a44a395ae98.delta /opt/stack/data/nova/instances/snapshots/tmps0fxza96/45d617050069422aaaef5a44a395ae98 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps0fxza96/45d617050069422aaaef5a44a395ae98.delta /opt/stack/data/nova/instances/snapshots/tmps0fxza96/45d617050069422aaaef5a44a395ae98" returned: 0 in 0.492s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:29 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Snapshot extracted, beginning image upload
Aug 22 03:23:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:32 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Snapshot image upload complete
Aug 22 03:23:32 user nova-compute[73469]: INFO nova.compute.manager [None req-8bbc6216-647b-42b8-9740-573f11a33304 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Took 5.25 seconds to snapshot the instance on the hypervisor.
Aug 22 03:23:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "0b20349a-8916-4c73-b47a-ada7a89c62ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:23:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "0b20349a-8916-4c73-b47a-ada7a89c62ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:23:34 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:23:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:23:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:23:34 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:23:34 user nova-compute[73469]: INFO nova.compute.claims [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Claim successful on node user
Aug 22 03:23:35 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:23:35 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:23:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:23:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:23:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:23:35 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:23:35 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:23:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:23:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:23:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:23:35 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Creating image(s)
Aug 22 03:23:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:23:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "/opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:23:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "/opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:23:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "1df8b7feec6a5dac3605e847abf2342f397ed344" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:23:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "1df8b7feec6a5dac3605e847abf2342f397ed344" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:23:35 user nova-compute[73469]: DEBUG nova.policy [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96518602ea5a41749a90e53b39cc6eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467cfd0cdd79427b95292f684a990ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:23:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1df8b7feec6a5dac3605e847abf2342f397ed344.part --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1df8b7feec6a5dac3605e847abf2342f397ed344.part --force-share --output=json" returned: 0 in 0.216s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:36 user nova-compute[73469]: DEBUG nova.virt.images [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] 6772c3c0-c19a-41db-956f-74b7e2a8fcc3 was qcow2, converting to raw {{(pid=73469) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 22 03:23:36 user nova-compute[73469]: DEBUG nova.privsep.utils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73469) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 22 03:23:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1df8b7feec6a5dac3605e847abf2342f397ed344.part /opt/stack/data/nova/instances/_base/1df8b7feec6a5dac3605e847abf2342f397ed344.converted {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:36 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1df8b7feec6a5dac3605e847abf2342f397ed344.part /opt/stack/data/nova/instances/_base/1df8b7feec6a5dac3605e847abf2342f397ed344.converted" returned: 0 in 0.254s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1df8b7feec6a5dac3605e847abf2342f397ed344.converted --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1df8b7feec6a5dac3605e847abf2342f397ed344.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "1df8b7feec6a5dac3605e847abf2342f397ed344" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.701s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1df8b7feec6a5dac3605e847abf2342f397ed344 --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Successfully created port: 4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1df8b7feec6a5dac3605e847abf2342f397ed344 --force-share --output=json" returned: 0 in 0.199s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "1df8b7feec6a5dac3605e847abf2342f397ed344" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "1df8b7feec6a5dac3605e847abf2342f397ed344" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1df8b7feec6a5dac3605e847abf2342f397ed344 --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1df8b7feec6a5dac3605e847abf2342f397ed344 --force-share --output=json" returned: 0 in 0.173s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1df8b7feec6a5dac3605e847abf2342f397ed344,backing_fmt=raw /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1df8b7feec6a5dac3605e847abf2342f397ed344,backing_fmt=raw /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk 1073741824" returned: 0 in 0.050s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "1df8b7feec6a5dac3605e847abf2342f397ed344" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1df8b7feec6a5dac3605e847abf2342f397ed344 --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1df8b7feec6a5dac3605e847abf2342f397ed344 --force-share --output=json" returned: 0 in 0.211s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG nova.objects.instance [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lazy-loading 'migration_context' on Instance uuid 0b20349a-8916-4c73-b47a-ada7a89c62ce {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Ensure instance console log exists: /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:23:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Successfully updated port: 4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "refresh_cache-0b20349a-8916-4c73-b47a-ada7a89c62ce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquired lock "refresh_cache-0b20349a-8916-4c73-b47a-ada7a89c62ce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-2d8f3324-7edd-41c6-bfa6-8addd91c5d4c req-771cda38-07ea-44d7-80ae-b5ed0d9dfafb service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Received event network-changed-4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-2d8f3324-7edd-41c6-bfa6-8addd91c5d4c req-771cda38-07ea-44d7-80ae-b5ed0d9dfafb service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Refreshing instance network info cache due to event network-changed-4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2d8f3324-7edd-41c6-bfa6-8addd91c5d4c req-771cda38-07ea-44d7-80ae-b5ed0d9dfafb service nova] Acquiring lock "refresh_cache-0b20349a-8916-4c73-b47a-ada7a89c62ce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.network.neutron [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Updating instance_info_cache with network_info: [{"id": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "address": "fa:16:3e:27:6b:e0", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf0ed07-bc", "ovs_interfaceid": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Releasing lock "refresh_cache-0b20349a-8916-4c73-b47a-ada7a89c62ce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Instance network_info: |[{"id": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "address": "fa:16:3e:27:6b:e0", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf0ed07-bc", "ovs_interfaceid": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2d8f3324-7edd-41c6-bfa6-8addd91c5d4c req-771cda38-07ea-44d7-80ae-b5ed0d9dfafb service nova] Acquired lock "refresh_cache-0b20349a-8916-4c73-b47a-ada7a89c62ce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.network.neutron [req-2d8f3324-7edd-41c6-bfa6-8addd91c5d4c req-771cda38-07ea-44d7-80ae-b5ed0d9dfafb service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Refreshing network info cache for port 4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Start _get_guest_xml network_info=[{"id": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "address": "fa:16:3e:27:6b:e0", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf0ed07-bc", "ovs_interfaceid": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='40b111d546126687a450c50aae312f7a',container_format='bare',created_at=2023-08-22T03:23:27Z,direct_url=<?>,disk_format='qcow2',id=6772c3c0-c19a-41db-956f-74b7e2a8fcc3,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1133949462',owner='467cfd0cdd79427b95292f684a990ac7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-22T03:23:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '6772c3c0-c19a-41db-956f-74b7e2a8fcc3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:23:38 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:23:38 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='40b111d546126687a450c50aae312f7a',container_format='bare',created_at=2023-08-22T03:23:27Z,direct_url=<?>,disk_format='qcow2',id=6772c3c0-c19a-41db-956f-74b7e2a8fcc3,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1133949462',owner='467cfd0cdd79427b95292f684a990ac7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-22T03:23:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:23:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-975460297',display_name='tempest-TestStampPattern-server-975460297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-975460297',id=45,image_ref='6772c3c0-c19a-41db-956f-74b7e2a8fcc3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbbf7G0NOfRw/WveQo0wMklCRaQB6z4T276+FgSZHUtpkblbgKXhU3Q61VXJyHD1Dzj3wZj9gC/PhXMUryNTwkrTRmn8xreypCMtIoDaSoL2VUGYyY09H8O2SvcUlZQjA==',key_name='tempest-TestStampPattern-1767620429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='467cfd0cdd79427b95292f684a990ac7',ramdisk_id='',reservation_id='r-kjghuk5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a313534c-121a-4d89-92c9-c3ba40b78c99',image_min_disk='1',image_min_ram='0',image_owner_id='467cfd0cdd79427b95292f684a990ac7',image_owner_project_name='tempest-TestStampPattern-912449456',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-912449456-project-member',image_user_id='96518602ea5a41749a90e53b39cc6eb2',network_allocated='True',owner_project_name='tempest-TestStampPattern-912449456',owner_user_name='tempest-TestStampPattern-912449456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:23:35Z,user_data=None,user_id='96518602ea5a41749a90e53b39cc6eb2',uuid=0b20349a-8916-4c73-b47a-ada7a89c62ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "address": "fa:16:3e:27:6b:e0", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf0ed07-bc", "ovs_interfaceid": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Converting VIF {"id": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "address": "fa:16:3e:27:6b:e0", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf0ed07-bc", "ovs_interfaceid": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:6b:e0,bridge_name='br-int',has_traffic_filtering=True,id=4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c,network=Network(8f171a1d-8c92-4090-8e32-9bdda50c1c8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf0ed07-bc') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.objects.instance [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b20349a-8916-4c73-b47a-ada7a89c62ce {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:23:38 user nova-compute[73469]:   <uuid>0b20349a-8916-4c73-b47a-ada7a89c62ce</uuid>
Aug 22 03:23:38 user nova-compute[73469]:   <name>instance-0000002d</name>
Aug 22 03:23:38 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:23:38 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:23:38 user nova-compute[73469]:   <metadata>
Aug 22 03:23:38 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:23:38 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:23:38 user nova-compute[73469]:       <nova:name>tempest-TestStampPattern-server-975460297</nova:name>
Aug 22 03:23:38 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:23:38</nova:creationTime>
Aug 22 03:23:38 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:23:38 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:23:38 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:23:38 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:23:38 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:23:38 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:23:38 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:23:38 user nova-compute[73469]:       <nova:owner>
Aug 22 03:23:38 user nova-compute[73469]:         <nova:user uuid="96518602ea5a41749a90e53b39cc6eb2">tempest-TestStampPattern-912449456-project-member</nova:user>
Aug 22 03:23:38 user nova-compute[73469]:         <nova:project uuid="467cfd0cdd79427b95292f684a990ac7">tempest-TestStampPattern-912449456</nova:project>
Aug 22 03:23:38 user nova-compute[73469]:       </nova:owner>
Aug 22 03:23:38 user nova-compute[73469]:       <nova:root type="image" uuid="6772c3c0-c19a-41db-956f-74b7e2a8fcc3"/>
Aug 22 03:23:38 user nova-compute[73469]:       <nova:ports>
Aug 22 03:23:38 user nova-compute[73469]:         <nova:port uuid="4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c">
Aug 22 03:23:38 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 22 03:23:38 user nova-compute[73469]:         </nova:port>
Aug 22 03:23:38 user nova-compute[73469]:       </nova:ports>
Aug 22 03:23:38 user nova-compute[73469]:     </nova:instance>
Aug 22 03:23:38 user nova-compute[73469]:   </metadata>
Aug 22 03:23:38 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:23:38 user nova-compute[73469]:     <system>
Aug 22 03:23:38 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:23:38 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:23:38 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:23:38 user nova-compute[73469]:       <entry name="serial">0b20349a-8916-4c73-b47a-ada7a89c62ce</entry>
Aug 22 03:23:38 user nova-compute[73469]:       <entry name="uuid">0b20349a-8916-4c73-b47a-ada7a89c62ce</entry>
Aug 22 03:23:38 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:23:38 user nova-compute[73469]:     </system>
Aug 22 03:23:38 user nova-compute[73469]:   </sysinfo>
Aug 22 03:23:38 user nova-compute[73469]:   <os>
Aug 22 03:23:38 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:23:38 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:23:38 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:23:38 user nova-compute[73469]:   </os>
Aug 22 03:23:38 user nova-compute[73469]:   <features>
Aug 22 03:23:38 user nova-compute[73469]:     <acpi/>
Aug 22 03:23:38 user nova-compute[73469]:     <apic/>
Aug 22 03:23:38 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:23:38 user nova-compute[73469]:   </features>
Aug 22 03:23:38 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:23:38 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:23:38 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:23:38 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:23:38 user nova-compute[73469]:   </clock>
Aug 22 03:23:38 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:23:38 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:23:38 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:23:38 user nova-compute[73469]:   </cpu>
Aug 22 03:23:38 user nova-compute[73469]:   <devices>
Aug 22 03:23:38 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:23:38 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:23:38 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk"/>
Aug 22 03:23:38 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:23:38 user nova-compute[73469]:     </disk>
Aug 22 03:23:38 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:23:38 user nova-compute[73469]:       <mac address="fa:16:3e:27:6b:e0"/>
Aug 22 03:23:38 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:23:38 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:23:38 user nova-compute[73469]:       <target dev="tap4bf0ed07-bc"/>
Aug 22 03:23:38 user nova-compute[73469]:     </interface>
Aug 22 03:23:38 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:23:38 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/console.log" append="off"/>
Aug 22 03:23:38 user nova-compute[73469]:     </serial>
Aug 22 03:23:38 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:23:38 user nova-compute[73469]:     <video>
Aug 22 03:23:38 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:23:38 user nova-compute[73469]:     </video>
Aug 22 03:23:38 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:23:38 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:23:38 user nova-compute[73469]:     </rng>
Aug 22 03:23:38 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:23:38 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:23:38 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:23:38 user nova-compute[73469]:     </memballoon>
Aug 22 03:23:38 user nova-compute[73469]:   </devices>
Aug 22 03:23:38 user nova-compute[73469]: </domain>
Aug 22 03:23:38 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:23:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-975460297',display_name='tempest-TestStampPattern-server-975460297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-975460297',id=45,image_ref='6772c3c0-c19a-41db-956f-74b7e2a8fcc3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbbf7G0NOfRw/WveQo0wMklCRaQB6z4T276+FgSZHUtpkblbgKXhU3Q61VXJyHD1Dzj3wZj9gC/PhXMUryNTwkrTRmn8xreypCMtIoDaSoL2VUGYyY09H8O2SvcUlZQjA==',key_name='tempest-TestStampPattern-1767620429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='467cfd0cdd79427b95292f684a990ac7',ramdisk_id='',reservation_id='r-kjghuk5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a313534c-121a-4d89-92c9-c3ba40b78c99',image_min_disk='1',image_min_ram='0',image_owner_id='467cfd0cdd79427b95292f684a990ac7',image_owner_project_name='tempest-TestStampPattern-912449456',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-912449456-project-member',image_user_id='96518602ea5a41749a90e53b39cc6eb2',network_allocated='True',owner_project_name='tempest-TestStampPattern-912449456',owner_user_name='tempest-TestStampPattern-912449456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:23:35Z,user_data=None,user_id='96518602ea5a41749a90e53b39cc6eb2',uuid=0b20349a-8916-4c73-b47a-ada7a89c62ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "address": "fa:16:3e:27:6b:e0", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf0ed07-bc", "ovs_interfaceid": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Converting VIF {"id": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "address": "fa:16:3e:27:6b:e0", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf0ed07-bc", "ovs_interfaceid": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:6b:e0,bridge_name='br-int',has_traffic_filtering=True,id=4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c,network=Network(8f171a1d-8c92-4090-8e32-9bdda50c1c8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf0ed07-bc') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG os_vif [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:6b:e0,bridge_name='br-int',has_traffic_filtering=True,id=4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c,network=Network(8f171a1d-8c92-4090-8e32-9bdda50c1c8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf0ed07-bc') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bf0ed07-bc, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4bf0ed07-bc, col_values=(('external_ids', {'iface-id': '4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:6b:e0', 'vm-uuid': '0b20349a-8916-4c73-b47a-ada7a89c62ce'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:38 user nova-compute[73469]: INFO os_vif [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:6b:e0,bridge_name='br-int',has_traffic_filtering=True,id=4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c,network=Network(8f171a1d-8c92-4090-8e32-9bdda50c1c8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf0ed07-bc')
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:23:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] No VIF found with MAC fa:16:3e:27:6b:e0, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:23:39 user nova-compute[73469]: DEBUG nova.network.neutron [req-2d8f3324-7edd-41c6-bfa6-8addd91c5d4c req-771cda38-07ea-44d7-80ae-b5ed0d9dfafb service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Updated VIF entry in instance network info cache for port 4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:23:39 user nova-compute[73469]: DEBUG nova.network.neutron [req-2d8f3324-7edd-41c6-bfa6-8addd91c5d4c req-771cda38-07ea-44d7-80ae-b5ed0d9dfafb service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Updating instance_info_cache with network_info: [{"id": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "address": "fa:16:3e:27:6b:e0", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf0ed07-bc", "ovs_interfaceid": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:23:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2d8f3324-7edd-41c6-bfa6-8addd91c5d4c req-771cda38-07ea-44d7-80ae-b5ed0d9dfafb service nova] Releasing lock "refresh_cache-0b20349a-8916-4c73-b47a-ada7a89c62ce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:23:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:23:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:23:39 user nova-compute[73469]: DEBUG nova.objects.instance [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lazy-loading 'pci_requests' on Instance uuid 2bcb99db-a352-4c77-a316-4152e82338c5 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:23:39 user nova-compute[73469]: DEBUG nova.objects.instance [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lazy-loading 'numa_topology' on Instance uuid 2bcb99db-a352-4c77-a316-4152e82338c5 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:23:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "3875c417-2548-4f48-a909-1b7b15607c94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:23:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "3875c417-2548-4f48-a909-1b7b15607c94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:23:39 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:23:39 user nova-compute[73469]: INFO nova.compute.claims [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Claim successful on node user
Aug 22 03:23:39 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:23:39 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:23:39 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:23:39 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:23:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:23:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.159s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:23:40 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:23:40 user nova-compute[73469]: INFO nova.compute.claims [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Claim successful on node user
Aug 22 03:23:40 user nova-compute[73469]: INFO nova.network.neutron [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Updating port 127c6ea8-1f9e-43ed-8bf1-aeeda044ddce with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 22 03:23:40 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:23:40 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:23:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:23:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:23:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:23:40 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:23:40 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:23:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:23:40 user nova-compute[73469]: DEBUG nova.policy [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c2b396a267549f4b7911646251a4094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9878ef4b06740e9af1fc5aff14417ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:23:40 user nova-compute[73469]: INFO nova.virt.block_device [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Booting with volume snapshot d8a31988-a871-4170-ab5b-956cec2459e0 at /dev/vda
Aug 22 03:23:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:40 user nova-compute[73469]: DEBUG nova.compute.manager [req-b5e499a2-a03b-418d-89cf-a4664ea0cd49 req-1b608aca-dfb1-48aa-918d-872982631d0f service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Received event network-vif-plugged-4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:23:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b5e499a2-a03b-418d-89cf-a4664ea0cd49 req-1b608aca-dfb1-48aa-918d-872982631d0f service nova] Acquiring lock "0b20349a-8916-4c73-b47a-ada7a89c62ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:23:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b5e499a2-a03b-418d-89cf-a4664ea0cd49 req-1b608aca-dfb1-48aa-918d-872982631d0f service nova] Lock "0b20349a-8916-4c73-b47a-ada7a89c62ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:23:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b5e499a2-a03b-418d-89cf-a4664ea0cd49 req-1b608aca-dfb1-48aa-918d-872982631d0f service nova] Lock "0b20349a-8916-4c73-b47a-ada7a89c62ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:23:40 user nova-compute[73469]: DEBUG nova.compute.manager [req-b5e499a2-a03b-418d-89cf-a4664ea0cd49 req-1b608aca-dfb1-48aa-918d-872982631d0f service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] No waiting events found dispatching network-vif-plugged-4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:23:40 user nova-compute[73469]: WARNING nova.compute.manager [req-b5e499a2-a03b-418d-89cf-a4664ea0cd49 req-1b608aca-dfb1-48aa-918d-872982631d0f service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Received unexpected event network-vif-plugged-4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c for instance with vm_state building and task_state spawning.
Aug 22 03:23:41 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Successfully created port: f48c4900-7dfa-456b-bf55-ce72b69653dd {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:23:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:23:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquired lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:23:41 user nova-compute[73469]: DEBUG nova.network.neutron [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Successfully updated port: f48c4900-7dfa-456b-bf55-ce72b69653dd {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "refresh_cache-3875c417-2548-4f48-a909-1b7b15607c94" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquired lock "refresh_cache-3875c417-2548-4f48-a909-1b7b15607c94" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.network.neutron [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Updating instance_info_cache with network_info: [{"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.compute.manager [req-3db22f24-de8c-4663-b1b8-e9510acecf50 req-2b58b383-7e34-43d8-8295-fe9d242d50c8 service nova] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Received event network-changed-f48c4900-7dfa-456b-bf55-ce72b69653dd {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.compute.manager [req-3db22f24-de8c-4663-b1b8-e9510acecf50 req-2b58b383-7e34-43d8-8295-fe9d242d50c8 service nova] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Refreshing instance network info cache due to event network-changed-f48c4900-7dfa-456b-bf55-ce72b69653dd. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-3db22f24-de8c-4663-b1b8-e9510acecf50 req-2b58b383-7e34-43d8-8295-fe9d242d50c8 service nova] Acquiring lock "refresh_cache-3875c417-2548-4f48-a909-1b7b15607c94" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Releasing lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:23:42 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Creating image(s)
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Did not create local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Ensure instance console log exists: /opt/stack/data/nova/instances/2bcb99db-a352-4c77-a316-4152e82338c5/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Start _get_guest_xml network_info=[{"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'b2d0ea13-5c6e-44d8-a1b0-49c54f5172f6', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGrLlCIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2bcb99db-a352-4c77-a316-4152e82338c5', 'attached_at': '', 'detached_at': '', 'volume_id': '7ff20bb8-f4f1-4996-88b1-3af0822feb8b', 'serial': '7ff20bb8-f4f1-4996-88b1-3af0822feb8b'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:23:42 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:23:42 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.objects.instance [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2bcb99db-a352-4c77-a316-4152e82338c5 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGrLlCIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:23:42 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:23:42 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:23:42 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7442d98-c13a-40b3-a614-3fbf3754ea8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:23:42 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7c782d-0785-47e2-bbe1-f2d4e4b14b54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b] added
Aug 22 03:23:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e325feb9-f56b-48da-8d76-413972435f96]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6facbb41-e778-44f8-8742-70e5bad2ba1f]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGrLlCIw {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGrLlCIw" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[889189d0-6d02-4c82-82d8-b0f57a246f4e]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oGrLlCIw'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9c9bd5-ce88-4353-b87c-6b8ff92c6472]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9e38ee-3d55-40d0-98f7-9d8ffb60b0f4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:23:42 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:23:42 user nova-compute[73469]:  {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:23:42 user nova-compute[73469]: WARNING os_brick.initiator.connectors.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 22 03:23:42 user nova-compute[73469]: 
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ac4c3b-ae73-4f9a-845f-39f33368226b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b, portal: 172.16.0.220,3260]
Aug 22 03:23:42 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b, portal: 172.16.0.220,3260] successful.
Aug 22 03:23:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674622.7083666, 0b20349a-8916-4c73-b47a-ada7a89c62ce => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:23:42 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] VM Resumed (Lifecycle Event)
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:23:42 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Instance spawned successfully.
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefb9e3b-ed35-446c-8eea-d0c7b2b5f8db]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccddcd99-3723-497a-b340-6776a307c0af]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)
Aug 22 03:23:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)
Aug 22 03:23:42 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:42 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674622.7112963, 0b20349a-8916-4c73-b47a-ada7a89c62ce => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:23:42 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] VM Started (Lifecycle Event)
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.compute.manager [req-d86feabe-2689-440b-ad88-ffeb11e95c33 req-d7dc2688-8b3e-4f81-83af-0ac1a292c146 service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Received event network-vif-plugged-4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d86feabe-2689-440b-ad88-ffeb11e95c33 req-d7dc2688-8b3e-4f81-83af-0ac1a292c146 service nova] Acquiring lock "0b20349a-8916-4c73-b47a-ada7a89c62ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d86feabe-2689-440b-ad88-ffeb11e95c33 req-d7dc2688-8b3e-4f81-83af-0ac1a292c146 service nova] Lock "0b20349a-8916-4c73-b47a-ada7a89c62ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d86feabe-2689-440b-ad88-ffeb11e95c33 req-d7dc2688-8b3e-4f81-83af-0ac1a292c146 service nova] Lock "0b20349a-8916-4c73-b47a-ada7a89c62ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.compute.manager [req-d86feabe-2689-440b-ad88-ffeb11e95c33 req-d7dc2688-8b3e-4f81-83af-0ac1a292c146 service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] No waiting events found dispatching network-vif-plugged-4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:23:42 user nova-compute[73469]: WARNING nova.compute.manager [req-d86feabe-2689-440b-ad88-ffeb11e95c33 req-d7dc2688-8b3e-4f81-83af-0ac1a292c146 service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Received unexpected event network-vif-plugged-4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c for instance with vm_state building and task_state spawning.
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.compute.manager [req-d86feabe-2689-440b-ad88-ffeb11e95c33 req-d7dc2688-8b3e-4f81-83af-0ac1a292c146 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-changed-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.compute.manager [req-d86feabe-2689-440b-ad88-ffeb11e95c33 req-d7dc2688-8b3e-4f81-83af-0ac1a292c146 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Refreshing instance network info cache due to event network-changed-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d86feabe-2689-440b-ad88-ffeb11e95c33 req-d7dc2688-8b3e-4f81-83af-0ac1a292c146 service nova] Acquiring lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d86feabe-2689-440b-ad88-ffeb11e95c33 req-d7dc2688-8b3e-4f81-83af-0ac1a292c146 service nova] Acquired lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.network.neutron [req-d86feabe-2689-440b-ad88-ffeb11e95c33 req-d7dc2688-8b3e-4f81-83af-0ac1a292c146 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Refreshing network info cache for port 127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f04fbe3-2da4-41ad-bd16-0326c47c1131]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGrLlCIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:23:42 user nova-compute[73469]: INFO nova.compute.manager [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Took 7.33 seconds to spawn the instance on the hypervisor.
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:23:42 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.network.neutron [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Updating instance_info_cache with network_info: [{"id": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "address": "fa:16:3e:86:4c:b3", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c4900-7d", "ovs_interfaceid": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Releasing lock "refresh_cache-3875c417-2548-4f48-a909-1b7b15607c94" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Instance network_info: |[{"id": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "address": "fa:16:3e:86:4c:b3", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c4900-7d", "ovs_interfaceid": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-3db22f24-de8c-4663-b1b8-e9510acecf50 req-2b58b383-7e34-43d8-8295-fe9d242d50c8 service nova] Acquired lock "refresh_cache-3875c417-2548-4f48-a909-1b7b15607c94" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:23:42 user nova-compute[73469]: DEBUG nova.network.neutron [req-3db22f24-de8c-4663-b1b8-e9510acecf50 req-2b58b383-7e34-43d8-8295-fe9d242d50c8 service nova] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Refreshing network info cache for port f48c4900-7dfa-456b-bf55-ce72b69653dd {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:23:42 user nova-compute[73469]: INFO nova.compute.manager [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Took 8.11 seconds to build instance.
Aug 22 03:23:42 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6255cf3f-9035-49b8-88c1-49087a7cf955 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "0b20349a-8916-4c73-b47a-ada7a89c62ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.224s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG nova.network.neutron [req-3db22f24-de8c-4663-b1b8-e9510acecf50 req-2b58b383-7e34-43d8-8295-fe9d242d50c8 service nova] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Updated VIF entry in instance network info cache for port f48c4900-7dfa-456b-bf55-ce72b69653dd. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG nova.network.neutron [req-3db22f24-de8c-4663-b1b8-e9510acecf50 req-2b58b383-7e34-43d8-8295-fe9d242d50c8 service nova] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Updating instance_info_cache with network_info: [{"id": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "address": "fa:16:3e:86:4c:b3", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c4900-7d", "ovs_interfaceid": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-3db22f24-de8c-4663-b1b8-e9510acecf50 req-2b58b383-7e34-43d8-8295-fe9d242d50c8 service nova] Releasing lock "refresh_cache-3875c417-2548-4f48-a909-1b7b15607c94" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG nova.network.neutron [req-d86feabe-2689-440b-ad88-ffeb11e95c33 req-d7dc2688-8b3e-4f81-83af-0ac1a292c146 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Updated VIF entry in instance network info cache for port 127c6ea8-1f9e-43ed-8bf1-aeeda044ddce. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG nova.network.neutron [req-d86feabe-2689-440b-ad88-ffeb11e95c33 req-d7dc2688-8b3e-4f81-83af-0ac1a292c146 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Updating instance_info_cache with network_info: [{"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-d86feabe-2689-440b-ad88-ffeb11e95c33 req-d7dc2688-8b3e-4f81-83af-0ac1a292c146 service nova] Releasing lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23661336131626638', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661336131626638', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-22T03:19:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1181981432',display_name='tempest-TestShelveInstance-server-1181981432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1181981432',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-789183110',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:19:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0a535e1201fc482fb98a779de2f2eb22',ramdisk_id='',reservation_id='r-z93obrmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1878913405',owner_user_name='tempest-TestShelveInstance-1878913405-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:23:21Z,user_data=None,user_id='39da6c4b4af346adb57ef59ed72d6336',uuid=2bcb99db-a352-4c77-a316-4152e82338c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Converting VIF {"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9e:f4,bridge_name='br-int',has_traffic_filtering=True,id=127c6ea8-1f9e-43ed-8bf1-aeeda044ddce,network=Network(346ff46f-cc3e-4807-b97d-54434298bce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127c6ea8-1f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG nova.objects.instance [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bcb99db-a352-4c77-a316-4152e82338c5 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:23:43 user nova-compute[73469]:   <uuid>2bcb99db-a352-4c77-a316-4152e82338c5</uuid>
Aug 22 03:23:43 user nova-compute[73469]:   <name>instance-0000002b</name>
Aug 22 03:23:43 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:23:43 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:23:43 user nova-compute[73469]:   <metadata>
Aug 22 03:23:43 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:23:43 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:23:43 user nova-compute[73469]:       <nova:name>tempest-TestShelveInstance-server-1181981432</nova:name>
Aug 22 03:23:43 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:23:42</nova:creationTime>
Aug 22 03:23:43 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:23:43 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:23:43 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:23:43 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:23:43 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:23:43 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:23:43 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:23:43 user nova-compute[73469]:       <nova:owner>
Aug 22 03:23:43 user nova-compute[73469]:         <nova:user uuid="39da6c4b4af346adb57ef59ed72d6336">tempest-TestShelveInstance-1878913405-project-member</nova:user>
Aug 22 03:23:43 user nova-compute[73469]:         <nova:project uuid="0a535e1201fc482fb98a779de2f2eb22">tempest-TestShelveInstance-1878913405</nova:project>
Aug 22 03:23:43 user nova-compute[73469]:       </nova:owner>
Aug 22 03:23:43 user nova-compute[73469]:       <nova:ports>
Aug 22 03:23:43 user nova-compute[73469]:         <nova:port uuid="127c6ea8-1f9e-43ed-8bf1-aeeda044ddce">
Aug 22 03:23:43 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 22 03:23:43 user nova-compute[73469]:         </nova:port>
Aug 22 03:23:43 user nova-compute[73469]:       </nova:ports>
Aug 22 03:23:43 user nova-compute[73469]:     </nova:instance>
Aug 22 03:23:43 user nova-compute[73469]:   </metadata>
Aug 22 03:23:43 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:23:43 user nova-compute[73469]:     <system>
Aug 22 03:23:43 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:23:43 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:23:43 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:23:43 user nova-compute[73469]:       <entry name="serial">2bcb99db-a352-4c77-a316-4152e82338c5</entry>
Aug 22 03:23:43 user nova-compute[73469]:       <entry name="uuid">2bcb99db-a352-4c77-a316-4152e82338c5</entry>
Aug 22 03:23:43 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:23:43 user nova-compute[73469]:     </system>
Aug 22 03:23:43 user nova-compute[73469]:   </sysinfo>
Aug 22 03:23:43 user nova-compute[73469]:   <os>
Aug 22 03:23:43 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:23:43 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:23:43 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:23:43 user nova-compute[73469]:   </os>
Aug 22 03:23:43 user nova-compute[73469]:   <features>
Aug 22 03:23:43 user nova-compute[73469]:     <acpi/>
Aug 22 03:23:43 user nova-compute[73469]:     <apic/>
Aug 22 03:23:43 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:23:43 user nova-compute[73469]:   </features>
Aug 22 03:23:43 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:23:43 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:23:43 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:23:43 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:23:43 user nova-compute[73469]:   </clock>
Aug 22 03:23:43 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:23:43 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:23:43 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:23:43 user nova-compute[73469]:   </cpu>
Aug 22 03:23:43 user nova-compute[73469]:   <devices>
Aug 22 03:23:43 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:23:43 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:23:43 user nova-compute[73469]:       <source dev="/dev/sdb"/>
Aug 22 03:23:43 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:23:43 user nova-compute[73469]:       <serial>7ff20bb8-f4f1-4996-88b1-3af0822feb8b</serial>
Aug 22 03:23:43 user nova-compute[73469]:     </disk>
Aug 22 03:23:43 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:23:43 user nova-compute[73469]:       <mac address="fa:16:3e:5f:9e:f4"/>
Aug 22 03:23:43 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:23:43 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:23:43 user nova-compute[73469]:       <target dev="tap127c6ea8-1f"/>
Aug 22 03:23:43 user nova-compute[73469]:     </interface>
Aug 22 03:23:43 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:23:43 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/2bcb99db-a352-4c77-a316-4152e82338c5/console.log" append="off"/>
Aug 22 03:23:43 user nova-compute[73469]:     </serial>
Aug 22 03:23:43 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:23:43 user nova-compute[73469]:     <video>
Aug 22 03:23:43 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:23:43 user nova-compute[73469]:     </video>
Aug 22 03:23:43 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:23:43 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:23:43 user nova-compute[73469]:     </rng>
Aug 22 03:23:43 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:23:43 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:23:43 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:23:43 user nova-compute[73469]:     </memballoon>
Aug 22 03:23:43 user nova-compute[73469]:   </devices>
Aug 22 03:23:43 user nova-compute[73469]: </domain>
Aug 22 03:23:43 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-22T03:19:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1181981432',display_name='tempest-TestShelveInstance-server-1181981432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1181981432',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-789183110',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:19:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0a535e1201fc482fb98a779de2f2eb22',ramdisk_id='',reservation_id='r-z93obrmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1878913405',owner_user_name='tempest-TestShelveInstance-1878913405-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:23:21Z,user_data=None,user_id='39da6c4b4af346adb57ef59ed72d6336',uuid=2bcb99db-a352-4c77-a316-4152e82338c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Converting VIF {"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9e:f4,bridge_name='br-int',has_traffic_filtering=True,id=127c6ea8-1f9e-43ed-8bf1-aeeda044ddce,network=Network(346ff46f-cc3e-4807-b97d-54434298bce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127c6ea8-1f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG os_vif [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9e:f4,bridge_name='br-int',has_traffic_filtering=True,id=127c6ea8-1f9e-43ed-8bf1-aeeda044ddce,network=Network(346ff46f-cc3e-4807-b97d-54434298bce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127c6ea8-1f') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap127c6ea8-1f, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap127c6ea8-1f, col_values=(('external_ids', {'iface-id': '127c6ea8-1f9e-43ed-8bf1-aeeda044ddce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:9e:f4', 'vm-uuid': '2bcb99db-a352-4c77-a316-4152e82338c5'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:43 user nova-compute[73469]: INFO os_vif [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9e:f4,bridge_name='br-int',has_traffic_filtering=True,id=127c6ea8-1f9e-43ed-8bf1-aeeda044ddce,network=Network(346ff46f-cc3e-4807-b97d-54434298bce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127c6ea8-1f')
Aug 22 03:23:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:23:43 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] No VIF found with MAC fa:16:3e:5f:9e:f4, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:23:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-8b0548ba-885f-49e5-af84-7531a28944a2 req-5f5eb624-43d8-4092-a1ed-a8ea6b247a10 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:23:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8b0548ba-885f-49e5-af84-7531a28944a2 req-5f5eb624-43d8-4092-a1ed-a8ea6b247a10 service nova] Acquiring lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:23:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8b0548ba-885f-49e5-af84-7531a28944a2 req-5f5eb624-43d8-4092-a1ed-a8ea6b247a10 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:23:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8b0548ba-885f-49e5-af84-7531a28944a2 req-5f5eb624-43d8-4092-a1ed-a8ea6b247a10 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:23:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-8b0548ba-885f-49e5-af84-7531a28944a2 req-5f5eb624-43d8-4092-a1ed-a8ea6b247a10 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] No waiting events found dispatching network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:23:45 user nova-compute[73469]: WARNING nova.compute.manager [req-8b0548ba-885f-49e5-af84-7531a28944a2 req-5f5eb624-43d8-4092-a1ed-a8ea6b247a10 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received unexpected event network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce for instance with vm_state shelved_offloaded and task_state spawning.
Aug 22 03:23:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG os_brick.utils [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7229e9-8acd-4c73-a1fd-56403542d4c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc45b3cc-ab22-4719-bcec-f2caf681731e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[19455d2f-9673-47fe-a73d-a61bba01d239]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[767bbebd-e3d4-4cb8-9c50-3b62d4f9a6c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:23:46 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:23:46 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[995dc410-7247-4abc-b842-0936ff8f2cba]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG os_brick.utils [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:23:46 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Updating existing volume attachment record: dd365fcb-14ec-4e40-a2c9-614a749ffa23 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:23:47 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674627.4948432, 2bcb99db-a352-4c77-a316-4152e82338c5 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:23:47 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] VM Resumed (Lifecycle Event)
Aug 22 03:23:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:23:47 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:23:47 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Instance spawned successfully.
Aug 22 03:23:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:23:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:23:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:23:47 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:23:47 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674627.496547, 2bcb99db-a352-4c77-a316-4152e82338c5 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:23:47 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] VM Started (Lifecycle Event)
Aug 22 03:23:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:23:47 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:23:47 user nova-compute[73469]: DEBUG nova.compute.manager [req-11d1dfc0-80ef-497f-925b-1923d90c73ba req-ecaa0bd3-29c4-4a62-8dd3-d4b2920e7464 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:23:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-11d1dfc0-80ef-497f-925b-1923d90c73ba req-ecaa0bd3-29c4-4a62-8dd3-d4b2920e7464 service nova] Acquiring lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:23:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-11d1dfc0-80ef-497f-925b-1923d90c73ba req-ecaa0bd3-29c4-4a62-8dd3-d4b2920e7464 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:23:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-11d1dfc0-80ef-497f-925b-1923d90c73ba req-ecaa0bd3-29c4-4a62-8dd3-d4b2920e7464 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:23:47 user nova-compute[73469]: DEBUG nova.compute.manager [req-11d1dfc0-80ef-497f-925b-1923d90c73ba req-ecaa0bd3-29c4-4a62-8dd3-d4b2920e7464 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] No waiting events found dispatching network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:23:47 user nova-compute[73469]: WARNING nova.compute.manager [req-11d1dfc0-80ef-497f-925b-1923d90c73ba req-ecaa0bd3-29c4-4a62-8dd3-d4b2920e7464 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received unexpected event network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce for instance with vm_state shelved_offloaded and task_state spawning.
Aug 22 03:23:47 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-dc57dbab-f352-4958-b52f-22f6272d9e6a tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "2bcb99db-a352-4c77-a316-4152e82338c5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.538s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:23:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:23:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:23:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:23:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:23:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:56 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:23:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:23:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:23:56 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Skipping network cache update for instance because it is Building. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 22 03:23:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:23:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:23:56 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:23:56 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid 2bcb99db-a352-4c77-a316-4152e82338c5 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Updating instance_info_cache with network_info: [{"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:23:57 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Creating image(s)
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Did not create local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Ensure instance console log exists: /opt/stack/data/nova/instances/3875c417-2548-4f48-a909-1b7b15607c94/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Start _get_guest_xml network_info=[{"id": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "address": "fa:16:3e:86:4c:b3", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c4900-7d", "ovs_interfaceid": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'dd365fcb-14ec-4e40-a2c9-614a749ffa23', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUEAuhqY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3875c417-2548-4f48-a909-1b7b15607c94', 'attached_at': '', 'detached_at': '', 'volume_id': '2cd1caba-a67f-4703-a75d-5592b74498db', 'serial': '2cd1caba-a67f-4703-a75d-5592b74498db'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:23:57 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:23:57 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUEAuhqY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:23:57 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:23:57 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:23:57 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2a6aac-90f5-45f6-b9ef-8e0ffb102e26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:23:57 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[66628058-ce68-432e-b720-f3a473a5b203]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db] added
Aug 22 03:23:57 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2a5f6e-5f80-4fe1-b6c9-003ad1dcf0f0]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44bf3ee-5a5c-4720-a7b4-d9af679e008f]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nUEAuhqY {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nUEAuhqY" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3faf16-7eb6-4441-be20-40ddc2609036]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nUEAuhqY'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[983b6024-36f0-4fd7-bfec-1e548c6cc80f]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a247285-b4c1-41fd-ba4d-1a2c369f7786]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)
Aug 22 03:23:57 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)
Aug 22 03:23:57 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1810e141-6cf0-4a79-86bf-4c7255c94f5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db, portal: 172.16.0.220,3260]
Aug 22 03:23:57 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db, portal: 172.16.0.220,3260] successful.
Aug 22 03:23:57 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[503ea7e5-d35b-40e6-846a-2c2c061239c7]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb723a5-f2cf-4b66-9079-1a73f9abd2ca]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)
Aug 22 03:23:57 user nova-compute[73469]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db (non-flash)
Aug 22 03:23:57 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)
Aug 22 03:23:57 user nova-compute[73469]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db (non-flash)
Aug 22 03:23:57 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff46355-aa94-4647-b6e3-a80d98cbf3b3]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:23:57 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUEAuhqY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26364376430373463', 'path': '/dev/sdc'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364376430373463', 'path': '/dev/sdc'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1513213702',display_name='tempest-TestVolumeBootPattern-server-1513213702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1513213702',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9878ef4b06740e9af1fc5aff14417ab',ramdisk_id='',reservation_id='r-ukyfkhio',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1927887073',owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:23:41Z,user_data=None,user_id='8c2b396a267549f4b7911646251a4094',uuid=3875c417-2548-4f48-a909-1b7b15607c94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "address": "fa:16:3e:86:4c:b3", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c4900-7d", "ovs_interfaceid": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converting VIF {"id": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "address": "fa:16:3e:86:4c:b3", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c4900-7d", "ovs_interfaceid": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:4c:b3,bridge_name='br-int',has_traffic_filtering=True,id=f48c4900-7dfa-456b-bf55-ce72b69653dd,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c4900-7d') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG nova.objects.instance [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lazy-loading 'pci_devices' on Instance uuid 3875c417-2548-4f48-a909-1b7b15607c94 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:23:58 user nova-compute[73469]:   <uuid>3875c417-2548-4f48-a909-1b7b15607c94</uuid>
Aug 22 03:23:58 user nova-compute[73469]:   <name>instance-0000002e</name>
Aug 22 03:23:58 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:23:58 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:23:58 user nova-compute[73469]:   <metadata>
Aug 22 03:23:58 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:23:58 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:23:58 user nova-compute[73469]:       <nova:name>tempest-TestVolumeBootPattern-server-1513213702</nova:name>
Aug 22 03:23:58 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:23:57</nova:creationTime>
Aug 22 03:23:58 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:23:58 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:23:58 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:23:58 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:23:58 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:23:58 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:23:58 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:23:58 user nova-compute[73469]:       <nova:owner>
Aug 22 03:23:58 user nova-compute[73469]:         <nova:user uuid="8c2b396a267549f4b7911646251a4094">tempest-TestVolumeBootPattern-1927887073-project-member</nova:user>
Aug 22 03:23:58 user nova-compute[73469]:         <nova:project uuid="f9878ef4b06740e9af1fc5aff14417ab">tempest-TestVolumeBootPattern-1927887073</nova:project>
Aug 22 03:23:58 user nova-compute[73469]:       </nova:owner>
Aug 22 03:23:58 user nova-compute[73469]:       <nova:ports>
Aug 22 03:23:58 user nova-compute[73469]:         <nova:port uuid="f48c4900-7dfa-456b-bf55-ce72b69653dd">
Aug 22 03:23:58 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 22 03:23:58 user nova-compute[73469]:         </nova:port>
Aug 22 03:23:58 user nova-compute[73469]:       </nova:ports>
Aug 22 03:23:58 user nova-compute[73469]:     </nova:instance>
Aug 22 03:23:58 user nova-compute[73469]:   </metadata>
Aug 22 03:23:58 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:23:58 user nova-compute[73469]:     <system>
Aug 22 03:23:58 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:23:58 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:23:58 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:23:58 user nova-compute[73469]:       <entry name="serial">3875c417-2548-4f48-a909-1b7b15607c94</entry>
Aug 22 03:23:58 user nova-compute[73469]:       <entry name="uuid">3875c417-2548-4f48-a909-1b7b15607c94</entry>
Aug 22 03:23:58 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:23:58 user nova-compute[73469]:     </system>
Aug 22 03:23:58 user nova-compute[73469]:   </sysinfo>
Aug 22 03:23:58 user nova-compute[73469]:   <os>
Aug 22 03:23:58 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:23:58 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:23:58 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:23:58 user nova-compute[73469]:   </os>
Aug 22 03:23:58 user nova-compute[73469]:   <features>
Aug 22 03:23:58 user nova-compute[73469]:     <acpi/>
Aug 22 03:23:58 user nova-compute[73469]:     <apic/>
Aug 22 03:23:58 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:23:58 user nova-compute[73469]:   </features>
Aug 22 03:23:58 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:23:58 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:23:58 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:23:58 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:23:58 user nova-compute[73469]:   </clock>
Aug 22 03:23:58 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:23:58 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:23:58 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:23:58 user nova-compute[73469]:   </cpu>
Aug 22 03:23:58 user nova-compute[73469]:   <devices>
Aug 22 03:23:58 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:23:58 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:23:58 user nova-compute[73469]:       <source dev="/dev/sdc"/>
Aug 22 03:23:58 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:23:58 user nova-compute[73469]:       <serial>2cd1caba-a67f-4703-a75d-5592b74498db</serial>
Aug 22 03:23:58 user nova-compute[73469]:     </disk>
Aug 22 03:23:58 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:23:58 user nova-compute[73469]:       <mac address="fa:16:3e:86:4c:b3"/>
Aug 22 03:23:58 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:23:58 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:23:58 user nova-compute[73469]:       <target dev="tapf48c4900-7d"/>
Aug 22 03:23:58 user nova-compute[73469]:     </interface>
Aug 22 03:23:58 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:23:58 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/3875c417-2548-4f48-a909-1b7b15607c94/console.log" append="off"/>
Aug 22 03:23:58 user nova-compute[73469]:     </serial>
Aug 22 03:23:58 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:23:58 user nova-compute[73469]:     <video>
Aug 22 03:23:58 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:23:58 user nova-compute[73469]:     </video>
Aug 22 03:23:58 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:23:58 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:23:58 user nova-compute[73469]:     </rng>
Aug 22 03:23:58 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:23:58 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:23:58 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:23:58 user nova-compute[73469]:     </memballoon>
Aug 22 03:23:58 user nova-compute[73469]:   </devices>
Aug 22 03:23:58 user nova-compute[73469]: </domain>
Aug 22 03:23:58 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1513213702',display_name='tempest-TestVolumeBootPattern-server-1513213702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1513213702',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9878ef4b06740e9af1fc5aff14417ab',ramdisk_id='',reservation_id='r-ukyfkhio',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1927887073',owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:23:41Z,user_data=None,user_id='8c2b396a267549f4b7911646251a4094',uuid=3875c417-2548-4f48-a909-1b7b15607c94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "address": "fa:16:3e:86:4c:b3", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c4900-7d", "ovs_interfaceid": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converting VIF {"id": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "address": "fa:16:3e:86:4c:b3", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c4900-7d", "ovs_interfaceid": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:4c:b3,bridge_name='br-int',has_traffic_filtering=True,id=f48c4900-7dfa-456b-bf55-ce72b69653dd,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c4900-7d') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG os_vif [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:4c:b3,bridge_name='br-int',has_traffic_filtering=True,id=f48c4900-7dfa-456b-bf55-ce72b69653dd,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c4900-7d') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf48c4900-7d, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf48c4900-7d, col_values=(('external_ids', {'iface-id': 'f48c4900-7dfa-456b-bf55-ce72b69653dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:4c:b3', 'vm-uuid': '3875c417-2548-4f48-a909-1b7b15607c94'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:58 user nova-compute[73469]: INFO os_vif [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:4c:b3,bridge_name='br-int',has_traffic_filtering=True,id=f48c4900-7dfa-456b-bf55-ce72b69653dd,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c4900-7d')
Aug 22 03:23:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:23:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] No VIF found with MAC fa:16:3e:86:4c:b3, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:23:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:23:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:23:59 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 22 03:23:59 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] There are 0 instances to clean {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 22 03:23:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:24:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:00 user nova-compute[73469]: DEBUG nova.compute.manager [req-abe4a771-5df1-4d05-8b8e-15564079768f req-cfba0deb-3997-4e18-a65a-f911f8aafe94 service nova] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Received event network-vif-plugged-f48c4900-7dfa-456b-bf55-ce72b69653dd {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:24:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-abe4a771-5df1-4d05-8b8e-15564079768f req-cfba0deb-3997-4e18-a65a-f911f8aafe94 service nova] Acquiring lock "3875c417-2548-4f48-a909-1b7b15607c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:24:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-abe4a771-5df1-4d05-8b8e-15564079768f req-cfba0deb-3997-4e18-a65a-f911f8aafe94 service nova] Lock "3875c417-2548-4f48-a909-1b7b15607c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:24:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-abe4a771-5df1-4d05-8b8e-15564079768f req-cfba0deb-3997-4e18-a65a-f911f8aafe94 service nova] Lock "3875c417-2548-4f48-a909-1b7b15607c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:24:00 user nova-compute[73469]: DEBUG nova.compute.manager [req-abe4a771-5df1-4d05-8b8e-15564079768f req-cfba0deb-3997-4e18-a65a-f911f8aafe94 service nova] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] No waiting events found dispatching network-vif-plugged-f48c4900-7dfa-456b-bf55-ce72b69653dd {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:24:00 user nova-compute[73469]: WARNING nova.compute.manager [req-abe4a771-5df1-4d05-8b8e-15564079768f req-cfba0deb-3997-4e18-a65a-f911f8aafe94 service nova] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Received unexpected event network-vif-plugged-f48c4900-7dfa-456b-bf55-ce72b69653dd for instance with vm_state building and task_state spawning.
Aug 22 03:24:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:01 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674642.1940393, 3875c417-2548-4f48-a909-1b7b15607c94 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:24:02 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] VM Resumed (Lifecycle Event)
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:24:02 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Instance spawned successfully.
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:24:02 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674642.195297, 3875c417-2548-4f48-a909-1b7b15607c94 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:24:02 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] VM Started (Lifecycle Event)
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:24:02 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:24:02 user nova-compute[73469]: INFO nova.compute.manager [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Took 4.88 seconds to spawn the instance on the hypervisor.
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.compute.manager [req-ebca6d7c-ac0d-471b-98cb-a12f98eff5b7 req-e23dd4c4-f1d3-4c28-ab14-3873a4e0c533 service nova] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Received event network-vif-plugged-f48c4900-7dfa-456b-bf55-ce72b69653dd {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ebca6d7c-ac0d-471b-98cb-a12f98eff5b7 req-e23dd4c4-f1d3-4c28-ab14-3873a4e0c533 service nova] Acquiring lock "3875c417-2548-4f48-a909-1b7b15607c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ebca6d7c-ac0d-471b-98cb-a12f98eff5b7 req-e23dd4c4-f1d3-4c28-ab14-3873a4e0c533 service nova] Lock "3875c417-2548-4f48-a909-1b7b15607c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ebca6d7c-ac0d-471b-98cb-a12f98eff5b7 req-e23dd4c4-f1d3-4c28-ab14-3873a4e0c533 service nova] Lock "3875c417-2548-4f48-a909-1b7b15607c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.compute.manager [req-ebca6d7c-ac0d-471b-98cb-a12f98eff5b7 req-e23dd4c4-f1d3-4c28-ab14-3873a4e0c533 service nova] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] No waiting events found dispatching network-vif-plugged-f48c4900-7dfa-456b-bf55-ce72b69653dd {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:24:02 user nova-compute[73469]: WARNING nova.compute.manager [req-ebca6d7c-ac0d-471b-98cb-a12f98eff5b7 req-e23dd4c4-f1d3-4c28-ab14-3873a4e0c533 service nova] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Received unexpected event network-vif-plugged-f48c4900-7dfa-456b-bf55-ce72b69653dd for instance with vm_state building and task_state spawning.
Aug 22 03:24:02 user nova-compute[73469]: INFO nova.compute.manager [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Took 22.59 seconds to build instance.
Aug 22 03:24:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-cd74eda9-3ae4-465d-a2db-0e23e6ac01ab tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "3875c417-2548-4f48-a909-1b7b15607c94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.680s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:24:02 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:24:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:24:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:24:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:24:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:24:03 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:24:03 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:24:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8308MB free_disk=25.029659271240234GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:24:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:24:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:24:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a313534c-121a-4d89-92c9-c3ba40b78c99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:24:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 2bcb99db-a352-4c77-a316-4152e82338c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:24:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 0b20349a-8916-4c73-b47a-ada7a89c62ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:24:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 3875c417-2548-4f48-a909-1b7b15607c94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:24:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:24:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:24:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:03 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:24:04 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:24:04 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:24:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:24:04 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:24:04 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 22 03:24:05 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:24:05 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:24:05 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:24:05 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:24:05 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:24:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:09 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:24:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:24:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:24:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:24:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:24:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:24:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:24:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:24:57 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:24:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:24:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:24:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:24:57 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:24:58 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Updating instance_info_cache with network_info: [{"id": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "address": "fa:16:3e:69:71:05", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2855f6eb-f5", "ovs_interfaceid": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:24:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:24:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:24:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:24:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:24:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:24:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:24:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:24:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:01 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:25:02 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:25:03 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:25:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:25:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:25:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:25:03 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:25:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:25:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:03 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:25:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:04 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:25:04 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:25:04 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8349MB free_disk=25.02851104736328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:25:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:25:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:25:05 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a313534c-121a-4d89-92c9-c3ba40b78c99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:25:05 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 2bcb99db-a352-4c77-a316-4152e82338c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:25:05 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 0b20349a-8916-4c73-b47a-ada7a89c62ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:25:05 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 3875c417-2548-4f48-a909-1b7b15607c94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:25:05 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:25:05 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:25:05 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing inventories for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 22 03:25:05 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Updating ProviderTree inventory for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 22 03:25:05 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Updating inventory in ProviderTree for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 22 03:25:05 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing aggregate associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, aggregates: None {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 22 03:25:05 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing trait associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 22 03:25:05 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:25:05 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:25:05 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:25:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:25:06 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:25:06 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:25:06 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:25:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:25:06 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:25:06 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:25:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:25:10 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:25:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:11 user nova-compute[73469]: DEBUG nova.compute.manager [req-9d1567b4-26fd-4682-8fc5-fcfb8a13d476 req-6b8ad92b-c7a8-4947-a6ea-7f6dd1a93a5f service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-changed-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:25:11 user nova-compute[73469]: DEBUG nova.compute.manager [req-9d1567b4-26fd-4682-8fc5-fcfb8a13d476 req-6b8ad92b-c7a8-4947-a6ea-7f6dd1a93a5f service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Refreshing instance network info cache due to event network-changed-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:25:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9d1567b4-26fd-4682-8fc5-fcfb8a13d476 req-6b8ad92b-c7a8-4947-a6ea-7f6dd1a93a5f service nova] Acquiring lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:25:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9d1567b4-26fd-4682-8fc5-fcfb8a13d476 req-6b8ad92b-c7a8-4947-a6ea-7f6dd1a93a5f service nova] Acquired lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:25:11 user nova-compute[73469]: DEBUG nova.network.neutron [req-9d1567b4-26fd-4682-8fc5-fcfb8a13d476 req-6b8ad92b-c7a8-4947-a6ea-7f6dd1a93a5f service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Refreshing network info cache for port 127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "2bcb99db-a352-4c77-a316-4152e82338c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "2bcb99db-a352-4c77-a316-4152e82338c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:25:12 user nova-compute[73469]: INFO nova.compute.manager [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Terminating instance
Aug 22 03:25:12 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG nova.compute.manager [req-44610255-2187-4356-9dc9-319612bef606 req-787afc35-256e-4e81-9de4-73d975685b39 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-vif-unplugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-44610255-2187-4356-9dc9-319612bef606 req-787afc35-256e-4e81-9de4-73d975685b39 service nova] Acquiring lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-44610255-2187-4356-9dc9-319612bef606 req-787afc35-256e-4e81-9de4-73d975685b39 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-44610255-2187-4356-9dc9-319612bef606 req-787afc35-256e-4e81-9de4-73d975685b39 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG nova.compute.manager [req-44610255-2187-4356-9dc9-319612bef606 req-787afc35-256e-4e81-9de4-73d975685b39 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] No waiting events found dispatching network-vif-unplugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG nova.compute.manager [req-44610255-2187-4356-9dc9-319612bef606 req-787afc35-256e-4e81-9de4-73d975685b39 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-vif-unplugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG nova.network.neutron [req-9d1567b4-26fd-4682-8fc5-fcfb8a13d476 req-6b8ad92b-c7a8-4947-a6ea-7f6dd1a93a5f service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Updated VIF entry in instance network info cache for port 127c6ea8-1f9e-43ed-8bf1-aeeda044ddce. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG nova.network.neutron [req-9d1567b4-26fd-4682-8fc5-fcfb8a13d476 req-6b8ad92b-c7a8-4947-a6ea-7f6dd1a93a5f service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Updating instance_info_cache with network_info: [{"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9d1567b4-26fd-4682-8fc5-fcfb8a13d476 req-6b8ad92b-c7a8-4947-a6ea-7f6dd1a93a5f service nova] Releasing lock "refresh_cache-2bcb99db-a352-4c77-a316-4152e82338c5" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:25:12 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Instance destroyed successfully.
Aug 22 03:25:12 user nova-compute[73469]: DEBUG nova.objects.instance [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lazy-loading 'resources' on Instance uuid 2bcb99db-a352-4c77-a316-4152e82338c5 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-22T03:19:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1181981432',display_name='tempest-TestShelveInstance-server-1181981432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1181981432',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzGYbmnNPkHPTRx3w8VWXAlw/Q/LgDOaaME96KoTCtSUTjMCTJ+U401e/nhUc6cx6MB2fv6e8DSAeZ5AwQ0e6UX+qlxOasf8XXGwiMLIx3O/oMndmKunkdGEDkDMOx/cQ==',key_name='tempest-TestShelveInstance-789183110',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a535e1201fc482fb98a779de2f2eb22',ramdisk_id='',reservation_id='r-z93obrmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1878913405',owner_user_name='tempest-TestShelveInstance-1878913405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:23:48Z,user_data=None,user_id='39da6c4b4af346adb57ef59ed72d6336',uuid=2bcb99db-a352-4c77-a316-4152e82338c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Converting VIF {"id": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "address": "fa:16:3e:5f:9e:f4", "network": {"id": "346ff46f-cc3e-4807-b97d-54434298bce1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1484006949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a535e1201fc482fb98a779de2f2eb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127c6ea8-1f", "ovs_interfaceid": "127c6ea8-1f9e-43ed-8bf1-aeeda044ddce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:9e:f4,bridge_name='br-int',has_traffic_filtering=True,id=127c6ea8-1f9e-43ed-8bf1-aeeda044ddce,network=Network(346ff46f-cc3e-4807-b97d-54434298bce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127c6ea8-1f') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG os_vif [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:9e:f4,bridge_name='br-int',has_traffic_filtering=True,id=127c6ea8-1f9e-43ed-8bf1-aeeda044ddce,network=Network(346ff46f-cc3e-4807-b97d-54434298bce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127c6ea8-1f') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap127c6ea8-1f, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:12 user nova-compute[73469]: INFO os_vif [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:9e:f4,bridge_name='br-int',has_traffic_filtering=True,id=127c6ea8-1f9e-43ed-8bf1-aeeda044ddce,network=Network(346ff46f-cc3e-4807-b97d-54434298bce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127c6ea8-1f')
Aug 22 03:25:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGrLlCIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:25:12 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:25:12 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[19834f36-2411-4da3-90e7-364faf7e1dc5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a9dd39-30ad-453f-9995-9ec7cdf71903]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)
Aug 22 03:25:12 user nova-compute[73469]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db (non-flash)
Aug 22 03:25:12 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b (non-flash)
Aug 22 03:25:12 user nova-compute[73469]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db (non-flash)
Aug 22 03:25:12 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a41c0040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae346b4-8681-45b7-b670-80b669438f5a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[80767808-260d-48c2-a5c3-a1c036f95c4e]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1080a386-a4f2-44ab-becf-6a66f3373318]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d2ac91-e78a-4236-8c02-8085f56abf3c]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23661336131626638', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bf1dd7d3', '/dev/disk/by-id/scsi-1SCST_BIObf1dd7d3-6a3a1bf811413373') {{(pid=84378) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8df1d9-f590-4965-b146-9c3f6e0cfedd]: (4, None) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:25:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[217e8bf5-1ef3-49fa-80ad-7c00f2ef5c42]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:25:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0e8c8e-4ee9-47db-8c4b-f99715e7c4bc]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b, portal: 172.16.0.220,3260]
Aug 22 03:25:13 user nova-compute[73469]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b, portal: 172.16.0.220,3260] successful.
Aug 22 03:25:13 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:25:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff20bb8-f4f1-4996-88b1-3af0822feb8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e133b68a-5906-426a-927a-40a8ad3e2362]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:25:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:25:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] <== disconnect_volume: return (294ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:25:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:25:13 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Deleting instance files /opt/stack/data/nova/instances/2bcb99db-a352-4c77-a316-4152e82338c5_del
Aug 22 03:25:13 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Deletion of /opt/stack/data/nova/instances/2bcb99db-a352-4c77-a316-4152e82338c5_del complete
Aug 22 03:25:13 user nova-compute[73469]: INFO nova.compute.manager [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 22 03:25:13 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:25:13 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:25:13 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:25:13 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:25:13 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Took 0.46 seconds to deallocate network for instance.
Aug 22 03:25:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:14 user nova-compute[73469]: INFO nova.compute.manager [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Took 0.76 seconds to detach 1 volumes for instance.
Aug 22 03:25:14 user nova-compute[73469]: DEBUG nova.compute.manager [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Deleting volume: 7ff20bb8-f4f1-4996-88b1-3af0822feb8b {{(pid=73469) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 22 03:25:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:25:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:25:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-05af3087-072a-479d-916e-dd8ee9246205 req-49a3403f-5c32-4d40-9fa7-c15bd9d66f74 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:25:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-05af3087-072a-479d-916e-dd8ee9246205 req-49a3403f-5c32-4d40-9fa7-c15bd9d66f74 service nova] Acquiring lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:25:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-05af3087-072a-479d-916e-dd8ee9246205 req-49a3403f-5c32-4d40-9fa7-c15bd9d66f74 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:25:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-05af3087-072a-479d-916e-dd8ee9246205 req-49a3403f-5c32-4d40-9fa7-c15bd9d66f74 service nova] Lock "2bcb99db-a352-4c77-a316-4152e82338c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:25:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-05af3087-072a-479d-916e-dd8ee9246205 req-49a3403f-5c32-4d40-9fa7-c15bd9d66f74 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] No waiting events found dispatching network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:25:14 user nova-compute[73469]: WARNING nova.compute.manager [req-05af3087-072a-479d-916e-dd8ee9246205 req-49a3403f-5c32-4d40-9fa7-c15bd9d66f74 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received unexpected event network-vif-plugged-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce for instance with vm_state deleted and task_state None.
Aug 22 03:25:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-05af3087-072a-479d-916e-dd8ee9246205 req-49a3403f-5c32-4d40-9fa7-c15bd9d66f74 service nova] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Received event network-vif-deleted-127c6ea8-1f9e-43ed-8bf1-aeeda044ddce {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:25:14 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:25:14 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:25:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:25:14 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Deleted allocations for instance 2bcb99db-a352-4c77-a316-4152e82338c5
Aug 22 03:25:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-6472438d-3ec2-4030-9250-76ce5859e22c tempest-TestShelveInstance-1878913405 tempest-TestShelveInstance-1878913405-project-member] Lock "2bcb99db-a352-4c77-a316-4152e82338c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.771s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:25:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-81b580f0-2e4b-4b98-b957-6e4d1904030a req-f5bb0ba1-1290-41bc-81a4-7dbad0b9a6ba service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Received event network-changed-4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:25:26 user nova-compute[73469]: DEBUG nova.compute.manager [req-81b580f0-2e4b-4b98-b957-6e4d1904030a req-f5bb0ba1-1290-41bc-81a4-7dbad0b9a6ba service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Refreshing instance network info cache due to event network-changed-4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:25:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-81b580f0-2e4b-4b98-b957-6e4d1904030a req-f5bb0ba1-1290-41bc-81a4-7dbad0b9a6ba service nova] Acquiring lock "refresh_cache-0b20349a-8916-4c73-b47a-ada7a89c62ce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:25:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-81b580f0-2e4b-4b98-b957-6e4d1904030a req-f5bb0ba1-1290-41bc-81a4-7dbad0b9a6ba service nova] Acquired lock "refresh_cache-0b20349a-8916-4c73-b47a-ada7a89c62ce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:25:26 user nova-compute[73469]: DEBUG nova.network.neutron [req-81b580f0-2e4b-4b98-b957-6e4d1904030a req-f5bb0ba1-1290-41bc-81a4-7dbad0b9a6ba service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Refreshing network info cache for port 4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "0b20349a-8916-4c73-b47a-ada7a89c62ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "0b20349a-8916-4c73-b47a-ada7a89c62ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG nova.objects.instance [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lazy-loading 'flavor' on Instance uuid 0b20349a-8916-4c73-b47a-ada7a89c62ce {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "0b20349a-8916-4c73-b47a-ada7a89c62ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "0b20349a-8916-4c73-b47a-ada7a89c62ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "0b20349a-8916-4c73-b47a-ada7a89c62ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:25:27 user nova-compute[73469]: INFO nova.compute.manager [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Attaching volume fc841f10-c006-419e-8ec5-8a186777f4a9 to /dev/vdb
Aug 22 03:25:27 user nova-compute[73469]: DEBUG os_brick.utils [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c01ef9-2d93-416e-8c82-8004a2a38e00]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a985a7bd-0e14-49f6-a80b-e4f636ef2d2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b52f1bb-8e6e-4f7b-a2f8-a9e461b075a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb0d253-22b4-43f9-8e19-3d68e444437b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:25:27 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23e2d05-b963-4e94-89cf-a4e159c8244e]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG os_brick.utils [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Updating existing volume attachment record: 4dafa728-d736-4549-8a99-79d7aa6a8c52 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG nova.network.neutron [req-81b580f0-2e4b-4b98-b957-6e4d1904030a req-f5bb0ba1-1290-41bc-81a4-7dbad0b9a6ba service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Updated VIF entry in instance network info cache for port 4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG nova.network.neutron [req-81b580f0-2e4b-4b98-b957-6e4d1904030a req-f5bb0ba1-1290-41bc-81a4-7dbad0b9a6ba service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Updating instance_info_cache with network_info: [{"id": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "address": "fa:16:3e:27:6b:e0", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf0ed07-bc", "ovs_interfaceid": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692674712.7584722, 2bcb99db-a352-4c77-a316-4152e82338c5 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:25:27 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] VM Stopped (Lifecycle Event)
Aug 22 03:25:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-81b580f0-2e4b-4b98-b957-6e4d1904030a req-f5bb0ba1-1290-41bc-81a4-7dbad0b9a6ba service nova] Releasing lock "refresh_cache-0b20349a-8916-4c73-b47a-ada7a89c62ce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-e3ec51af-870e-40ca-883d-f051964dd0cf None None] [instance: 2bcb99db-a352-4c77-a316-4152e82338c5] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:25:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:25:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "3875c417-2548-4f48-a909-1b7b15607c94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:25:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "3875c417-2548-4f48-a909-1b7b15607c94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:25:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "3875c417-2548-4f48-a909-1b7b15607c94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:25:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "3875c417-2548-4f48-a909-1b7b15607c94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:25:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "3875c417-2548-4f48-a909-1b7b15607c94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:25:30 user nova-compute[73469]: INFO nova.compute.manager [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Terminating instance
Aug 22 03:25:30 user nova-compute[73469]: DEBUG nova.compute.manager [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:25:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-ffe490d4-369e-4b7a-9083-71fc6b68dee1 req-f9ccb933-202b-4714-b1c5-c3461b578d25 service nova] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Received event network-vif-unplugged-f48c4900-7dfa-456b-bf55-ce72b69653dd {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:25:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ffe490d4-369e-4b7a-9083-71fc6b68dee1 req-f9ccb933-202b-4714-b1c5-c3461b578d25 service nova] Acquiring lock "3875c417-2548-4f48-a909-1b7b15607c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:25:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ffe490d4-369e-4b7a-9083-71fc6b68dee1 req-f9ccb933-202b-4714-b1c5-c3461b578d25 service nova] Lock "3875c417-2548-4f48-a909-1b7b15607c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:25:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ffe490d4-369e-4b7a-9083-71fc6b68dee1 req-f9ccb933-202b-4714-b1c5-c3461b578d25 service nova] Lock "3875c417-2548-4f48-a909-1b7b15607c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:25:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-ffe490d4-369e-4b7a-9083-71fc6b68dee1 req-f9ccb933-202b-4714-b1c5-c3461b578d25 service nova] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] No waiting events found dispatching network-vif-unplugged-f48c4900-7dfa-456b-bf55-ce72b69653dd {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:25:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-ffe490d4-369e-4b7a-9083-71fc6b68dee1 req-f9ccb933-202b-4714-b1c5-c3461b578d25 service nova] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Received event network-vif-unplugged-f48c4900-7dfa-456b-bf55-ce72b69653dd for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:25:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Instance destroyed successfully.
Aug 22 03:25:31 user nova-compute[73469]: DEBUG nova.objects.instance [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lazy-loading 'resources' on Instance uuid 3875c417-2548-4f48-a909-1b7b15607c94 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1513213702',display_name='tempest-TestVolumeBootPattern-server-1513213702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1513213702',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:24:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9878ef4b06740e9af1fc5aff14417ab',ramdisk_id='',reservation_id='r-ukyfkhio',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1927887073',owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:24:02Z,user_data=None,user_id='8c2b396a267549f4b7911646251a4094',uuid=3875c417-2548-4f48-a909-1b7b15607c94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "address": "fa:16:3e:86:4c:b3", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c4900-7d", "ovs_interfaceid": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converting VIF {"id": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "address": "fa:16:3e:86:4c:b3", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c4900-7d", "ovs_interfaceid": "f48c4900-7dfa-456b-bf55-ce72b69653dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:4c:b3,bridge_name='br-int',has_traffic_filtering=True,id=f48c4900-7dfa-456b-bf55-ce72b69653dd,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c4900-7d') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_vif [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:4c:b3,bridge_name='br-int',has_traffic_filtering=True,id=f48c4900-7dfa-456b-bf55-ce72b69653dd,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c4900-7d') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf48c4900-7d, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:25:31 user nova-compute[73469]: INFO os_vif [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:4c:b3,bridge_name='br-int',has_traffic_filtering=True,id=f48c4900-7dfa-456b-bf55-ce72b69653dd,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c4900-7d')
Aug 22 03:25:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUEAuhqY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:25:31 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[15afb829-9f4b-49ef-942d-25612dd8cf58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a76f2d-147c-4561-96ae-e569566f7330]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db (non-flash)
Aug 22 03:25:31 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db (non-flash)
Aug 22 03:25:31 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4660820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db'): ({'sdc'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Removing single pathed devices sdc {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8cc42d-6308-4586-847f-8b05bff2fc65]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c1c6ee-987d-4439-80ad-6f13f43f4f86]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Flushing IO for device /dev/sdc {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c7758d-4176-4960-8c5c-64de94cc2a26]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9272918e-a8d3-441a-9688-725f609e054c]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_adef16ae', '/dev/disk/by-id/scsi-1SCST_BIOadef16ae-cd7d074c90b3a69a', '/dev/disk/by-id/scsi-26364376430373463') {{(pid=84378) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccad3a1-51ec-4b45-94b4-f4424617bb49]: (4, None) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc77272-ac39-4ba5-84ce-7c5a8015f4d2]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0055d19-8937-4e89-8b0d-c27eefc49abf]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db, portal: 172.16.0.220,3260]
Aug 22 03:25:31 user nova-compute[73469]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db, portal: 172.16.0.220,3260] successful.
Aug 22 03:25:31 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[94392fc3-29df-48c3-8eb5-6963a6373c38]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] <== disconnect_volume: return (289ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:25:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Deleting instance files /opt/stack/data/nova/instances/3875c417-2548-4f48-a909-1b7b15607c94_del
Aug 22 03:25:31 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Deletion of /opt/stack/data/nova/instances/3875c417-2548-4f48-a909-1b7b15607c94_del complete
Aug 22 03:25:31 user nova-compute[73469]: INFO nova.compute.manager [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 22 03:25:31 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:25:31 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:25:31 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Took 0.45 seconds to deallocate network for instance.
Aug 22 03:25:31 user nova-compute[73469]: DEBUG nova.compute.manager [req-e339fe4b-a4ac-472b-a4c4-2d681ad31853 req-c05b61fb-5d2a-49e4-84dc-b09421c2ea8b service nova] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Received event network-vif-deleted-f48c4900-7dfa-456b-bf55-ce72b69653dd {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:25:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-48271a11-a882-45d3-a3f5-d70fd0d9e027 req-f008c06e-c391-40e6-adb0-7564d27c0ee4 service nova] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Received event network-vif-plugged-f48c4900-7dfa-456b-bf55-ce72b69653dd {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:25:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-48271a11-a882-45d3-a3f5-d70fd0d9e027 req-f008c06e-c391-40e6-adb0-7564d27c0ee4 service nova] Acquiring lock "3875c417-2548-4f48-a909-1b7b15607c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:25:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-48271a11-a882-45d3-a3f5-d70fd0d9e027 req-f008c06e-c391-40e6-adb0-7564d27c0ee4 service nova] Lock "3875c417-2548-4f48-a909-1b7b15607c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:25:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-48271a11-a882-45d3-a3f5-d70fd0d9e027 req-f008c06e-c391-40e6-adb0-7564d27c0ee4 service nova] Lock "3875c417-2548-4f48-a909-1b7b15607c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:25:32 user nova-compute[73469]: DEBUG nova.compute.manager [req-48271a11-a882-45d3-a3f5-d70fd0d9e027 req-f008c06e-c391-40e6-adb0-7564d27c0ee4 service nova] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] No waiting events found dispatching network-vif-plugged-f48c4900-7dfa-456b-bf55-ce72b69653dd {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:25:32 user nova-compute[73469]: WARNING nova.compute.manager [req-48271a11-a882-45d3-a3f5-d70fd0d9e027 req-f008c06e-c391-40e6-adb0-7564d27c0ee4 service nova] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Received unexpected event network-vif-plugged-f48c4900-7dfa-456b-bf55-ce72b69653dd for instance with vm_state active and task_state deleting.
Aug 22 03:25:32 user nova-compute[73469]: INFO nova.compute.manager [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Took 0.73 seconds to detach 1 volumes for instance.
Aug 22 03:25:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Deleting volume: 2cd1caba-a67f-4703-a75d-5592b74498db {{(pid=73469) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 22 03:25:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:25:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:25:32 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:25:32 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:25:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.volume.cinder [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Update attachment failed for attachment 4dafa728-d736-4549-8a99-79d7aa6a8c52. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:fc841f10-c006-419e-8ec5-8a186777f4a9 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:fc841f10-c006-419e-8ec5-8a186777f4a9/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db was not found.).). (HTTP 500) (Request-ID: req-6e87b7e6-fb81-4b03-b910-508df45e3fe2) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:fc841f10-c006-419e-8ec5-8a186777f4a9 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:fc841f10-c006-419e-8ec5-8a186777f4a9/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db was not found.).). (HTTP 500) (Request-ID: req-6e87b7e6-fb81-4b03-b910-508df45e3fe2)
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Failed to attach fc841f10-c006-419e-8ec5-8a186777f4a9 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:fc841f10-c006-419e-8ec5-8a186777f4a9 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:fc841f10-c006-419e-8ec5-8a186777f4a9/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db was not found.).). (HTTP 500) (Request-ID: req-6e87b7e6-fb81-4b03-b910-508df45e3fe2)
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Traceback (most recent call last):
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]     ret_val = method(obj, context, *args, **kwargs)
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]     self._do_attach(context, instance, volume, volume_api,
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]     self._volume_attach(context, volume, connector, instance,
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]     connection_info = volume_api.attachment_update(
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]     res = method(self, ctx, *args, **kwargs)
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]     with excutils.save_and_reraise_exception():
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]     self.force_reraise()
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]     raise self.value
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]     context, '3.44', skip_version_check=True).attachments.update(
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]     return method.func(obj, *args, **kwargs)
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]     resp = self._update('/attachments/%s' % id, body)
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]     return self._cs_request(url, 'PUT', **kwargs)
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]     return self.request(url, method, **kwargs)
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce]     raise exceptions.from_response(resp, body)
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:fc841f10-c006-419e-8ec5-8a186777f4a9 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:fc841f10-c006-419e-8ec5-8a186777f4a9/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db was not found.).). (HTTP 500) (Request-ID: req-6e87b7e6-fb81-4b03-b910-508df45e3fe2)
Aug 22 03:25:32 user nova-compute[73469]: ERROR nova.compute.manager [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] 
Aug 22 03:25:32 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Deleted allocations for instance 3875c417-2548-4f48-a909-1b7b15607c94
Aug 22 03:25:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-541b9130-ae73-4272-933c-7e43651d2302 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "3875c417-2548-4f48-a909-1b7b15607c94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.748s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:25:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "0b20349a-8916-4c73-b47a-ada7a89c62ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.626s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server [None req-09198df7-ef5c-45b4-9488-bae6e4ada971 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:fc841f10-c006-419e-8ec5-8a186777f4a9 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:fc841f10-c006-419e-8ec5-8a186777f4a9/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db was not found.).). (HTTP 500) (Request-ID: req-6e87b7e6-fb81-4b03-b910-508df45e3fe2)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:fc841f10-c006-419e-8ec5-8a186777f4a9 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:fc841f10-c006-419e-8ec5-8a186777f4a9/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2cd1caba-a67f-4703-a75d-5592b74498db was not found.).). (HTTP 500) (Request-ID: req-6e87b7e6-fb81-4b03-b910-508df45e3fe2)
Aug 22 03:25:33 user nova-compute[73469]: ERROR oslo_messaging.rpc.server 
Aug 22 03:25:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:46 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692674731.0535882, 3875c417-2548-4f48-a909-1b7b15607c94 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:25:46 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] VM Stopped (Lifecycle Event)
Aug 22 03:25:46 user nova-compute[73469]: DEBUG nova.compute.manager [None req-d96490dd-25d4-4c7a-b6cf-33281afa34aa None None] [instance: 3875c417-2548-4f48-a909-1b7b15607c94] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:25:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:25:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:25:59 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:25:59 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:25:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-0b20349a-8916-4c73-b47a-ada7a89c62ce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:25:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-0b20349a-8916-4c73-b47a-ada7a89c62ce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:25:59 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:26:00 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Updating instance_info_cache with network_info: [{"id": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "address": "fa:16:3e:27:6b:e0", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf0ed07-bc", "ovs_interfaceid": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:26:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-0b20349a-8916-4c73-b47a-ada7a89c62ce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:26:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:26:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:26:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:26:03 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:26:03 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:26:04 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:26:04 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:26:05 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:26:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:26:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:26:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:26:05 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:26:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:26:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:26:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:26:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:26:05 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:26:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:26:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:26:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:26:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:26:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:26:06 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:26:06 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:26:06 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8584MB free_disk=25.018993377685547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:26:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:26:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:26:06 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a313534c-121a-4d89-92c9-c3ba40b78c99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:26:06 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 0b20349a-8916-4c73-b47a-ada7a89c62ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:26:06 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:26:06 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:26:06 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:26:06 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:26:07 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:26:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:26:08 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:26:08 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:26:08 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:26:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:26:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:26:12 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:26:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:26:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:26:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:26:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:26:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:26:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:26:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:26:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:26:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:26:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:26:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:26:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:26:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:26:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:26:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:26:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:26:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:26:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:26:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:26:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:26:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:26:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:26:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:26:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:26:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:26:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:26:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:26:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:26:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:01 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:27:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:27:01 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:27:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:27:01 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:27:01 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:27:01 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid a313534c-121a-4d89-92c9-c3ba40b78c99 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:27:02 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Updating instance_info_cache with network_info: [{"id": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "address": "fa:16:3e:69:71:05", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2855f6eb-f5", "ovs_interfaceid": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:27:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:27:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:27:03 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:27:04 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:27:04 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:27:04 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:27:05 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:27:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:27:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:27:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:27:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:27:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:06 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:27:07 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:27:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:27:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:27:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:27:07 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:27:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:27:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:27:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:27:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:27:08 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:27:08 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:27:08 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8620MB free_disk=25.016456604003906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:27:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:27:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:27:08 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a313534c-121a-4d89-92c9-c3ba40b78c99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:27:08 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 0b20349a-8916-4c73-b47a-ada7a89c62ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:27:08 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:27:08 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:27:08 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:27:08 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:27:08 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:27:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:27:10 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:27:10 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:27:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:27:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:12 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:27:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "3ee7c47f-372e-4855-993b-3539a5c474aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:27:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "3ee7c47f-372e-4855-993b-3539a5c474aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:27:14 user nova-compute[73469]: DEBUG nova.compute.manager [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:27:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:27:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:27:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:27:14 user nova-compute[73469]: INFO nova.compute.claims [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Claim successful on node user
Aug 22 03:27:14 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:27:14 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:27:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:27:14 user nova-compute[73469]: DEBUG nova.compute.manager [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:27:14 user nova-compute[73469]: DEBUG nova.compute.manager [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:27:14 user nova-compute[73469]: DEBUG nova.network.neutron [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:27:14 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:27:15 user nova-compute[73469]: DEBUG nova.compute.manager [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:27:15 user nova-compute[73469]: INFO nova.virt.block_device [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Booting with volume d8c32d07-fdef-4fff-8ccf-608137154701 at /dev/vda
Aug 22 03:27:15 user nova-compute[73469]: DEBUG nova.policy [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c2b396a267549f4b7911646251a4094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9878ef4b06740e9af1fc5aff14417ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG os_brick.utils [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78044af-2adc-42a3-a217-d790f5a4bbf0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef0cbb7-f864-4e33-9777-7d8ab8295534]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0bf05b-52d2-4e0a-8131-ad7cced38da5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[30485a79-f1d5-4d63-a374-4d72627609f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:27:15 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:27:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[363b68bb-5b09-4cf4-95a3-f0ea26b6fce2]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG os_brick.utils [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Updating existing volume attachment record: a9449da4-f438-4dd3-a512-8dba33e8f425 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:27:15 user nova-compute[73469]: DEBUG nova.network.neutron [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Successfully created port: 4ab979d5-acac-4b3e-83de-6e7be1133da0 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:27:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:16 user nova-compute[73469]: DEBUG nova.network.neutron [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Successfully updated port: 4ab979d5-acac-4b3e-83de-6e7be1133da0 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:27:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "refresh_cache-3ee7c47f-372e-4855-993b-3539a5c474aa" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:27:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquired lock "refresh_cache-3ee7c47f-372e-4855-993b-3539a5c474aa" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:27:16 user nova-compute[73469]: DEBUG nova.network.neutron [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:27:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-1ec87124-8be6-4122-afce-73812aa5936c req-19fdacfe-85d5-407b-8c84-d57ad316a723 service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Received event network-changed-4ab979d5-acac-4b3e-83de-6e7be1133da0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:27:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-1ec87124-8be6-4122-afce-73812aa5936c req-19fdacfe-85d5-407b-8c84-d57ad316a723 service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Refreshing instance network info cache due to event network-changed-4ab979d5-acac-4b3e-83de-6e7be1133da0. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:27:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1ec87124-8be6-4122-afce-73812aa5936c req-19fdacfe-85d5-407b-8c84-d57ad316a723 service nova] Acquiring lock "refresh_cache-3ee7c47f-372e-4855-993b-3539a5c474aa" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:27:16 user nova-compute[73469]: DEBUG nova.network.neutron [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:27:16 user nova-compute[73469]: DEBUG nova.network.neutron [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Updating instance_info_cache with network_info: [{"id": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "address": "fa:16:3e:ce:ca:84", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab979d5-ac", "ovs_interfaceid": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:27:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Releasing lock "refresh_cache-3ee7c47f-372e-4855-993b-3539a5c474aa" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:27:16 user nova-compute[73469]: DEBUG nova.compute.manager [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Instance network_info: |[{"id": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "address": "fa:16:3e:ce:ca:84", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab979d5-ac", "ovs_interfaceid": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:27:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1ec87124-8be6-4122-afce-73812aa5936c req-19fdacfe-85d5-407b-8c84-d57ad316a723 service nova] Acquired lock "refresh_cache-3ee7c47f-372e-4855-993b-3539a5c474aa" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:27:16 user nova-compute[73469]: DEBUG nova.network.neutron [req-1ec87124-8be6-4122-afce-73812aa5936c req-19fdacfe-85d5-407b-8c84-d57ad316a723 service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Refreshing network info cache for port 4ab979d5-acac-4b3e-83de-6e7be1133da0 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:27:17 user nova-compute[73469]: DEBUG nova.network.neutron [req-1ec87124-8be6-4122-afce-73812aa5936c req-19fdacfe-85d5-407b-8c84-d57ad316a723 service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Updated VIF entry in instance network info cache for port 4ab979d5-acac-4b3e-83de-6e7be1133da0. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:27:17 user nova-compute[73469]: DEBUG nova.network.neutron [req-1ec87124-8be6-4122-afce-73812aa5936c req-19fdacfe-85d5-407b-8c84-d57ad316a723 service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Updating instance_info_cache with network_info: [{"id": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "address": "fa:16:3e:ce:ca:84", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab979d5-ac", "ovs_interfaceid": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:27:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-1ec87124-8be6-4122-afce-73812aa5936c req-19fdacfe-85d5-407b-8c84-d57ad316a723 service nova] Releasing lock "refresh_cache-3ee7c47f-372e-4855-993b-3539a5c474aa" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:27:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:27:25 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Creating image(s)
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Did not create local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Ensure instance console log exists: /opt/stack/data/nova/instances/3ee7c47f-372e-4855-993b-3539a5c474aa/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Start _get_guest_xml network_info=[{"id": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "address": "fa:16:3e:ce:ca:84", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab979d5-ac", "ovs_interfaceid": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'a9449da4-f438-4dd3-a512-8dba33e8f425', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AyQNlYti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3ee7c47f-372e-4855-993b-3539a5c474aa', 'attached_at': '', 'detached_at': '', 'volume_id': 'd8c32d07-fdef-4fff-8ccf-608137154701', 'serial': 'd8c32d07-fdef-4fff-8ccf-608137154701'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:27:25 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:27:25 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AyQNlYti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:27:25 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:27:25 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:27:25 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfb823a-78a4-4788-9927-c2e48f985b78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:27:25 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e255c6-8377-412d-a909-a4b8aea68447]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701] added
Aug 22 03:27:25 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e16365e-7d09-49cd-a7a1-9f8f2a5edd90]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7d9b37-9ab5-4d13-8903-f8f105785e38]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AyQNlYti {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AyQNlYti" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6d9269-80aa-4fbb-b648-4359196d072d]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AyQNlYti'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f813e5-4e43-4409-8e90-6124f40d9554]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cc46a4-ad7b-4380-8095-c69cd8750765]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:27:25 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:27:25 user nova-compute[73469]:  {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:27:25 user nova-compute[73469]: WARNING os_brick.initiator.connectors.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 22 03:27:25 user nova-compute[73469]: 
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[100f78aa-4827-47dc-9815-e74089e3012a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701, portal: 172.16.0.220,3260]
Aug 22 03:27:25 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701, portal: 172.16.0.220,3260] successful.
Aug 22 03:27:25 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1a4e99-7306-4ae9-80ea-3089d851beff]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e537c3-0f01-47bf-b0ee-94bd5d836f52]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 (non-flash)
Aug 22 03:27:25 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 (non-flash)
Aug 22 03:27:25 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:27:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:27:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:27:26 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a2a649-2429-4d61-b848-25ca6b3a851a]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:27:26 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:27:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:27:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:27:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:27:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:27:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AyQNlYti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23062653165313632', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062653165313632', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:27:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1397359901',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1397359901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1397359901',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoyTZp+WTuZnA513B5xopgb43qDL+5CxcfblhVI4qpM6E9uKIcUGfqo1Osl57NbPf4k3UwxAQaaZnWKGvejneBWgd1CUr/WENgI+4kaFVhuhTN12nQyjIElknKVoDc4kg==',key_name='tempest-keypair-127698107',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9878ef4b06740e9af1fc5aff14417ab',ramdisk_id='',reservation_id='r-qm5ubclz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1927887073',owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:27:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c2b396a267549f4b7911646251a4094',uuid=3ee7c47f-372e-4855-993b-3539a5c474aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "address": "fa:16:3e:ce:ca:84", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab979d5-ac", "ovs_interfaceid": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converting VIF {"id": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "address": "fa:16:3e:ce:ca:84", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab979d5-ac", "ovs_interfaceid": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:84,bridge_name='br-int',has_traffic_filtering=True,id=4ab979d5-acac-4b3e-83de-6e7be1133da0,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ab979d5-ac') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG nova.objects.instance [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ee7c47f-372e-4855-993b-3539a5c474aa {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:27:27 user nova-compute[73469]:   <uuid>3ee7c47f-372e-4855-993b-3539a5c474aa</uuid>
Aug 22 03:27:27 user nova-compute[73469]:   <name>instance-0000002f</name>
Aug 22 03:27:27 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:27:27 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:27:27 user nova-compute[73469]:   <metadata>
Aug 22 03:27:27 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:27:27 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:27:27 user nova-compute[73469]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1397359901</nova:name>
Aug 22 03:27:27 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:27:25</nova:creationTime>
Aug 22 03:27:27 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:27:27 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:27:27 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:27:27 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:27:27 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:27:27 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:27:27 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:27:27 user nova-compute[73469]:       <nova:owner>
Aug 22 03:27:27 user nova-compute[73469]:         <nova:user uuid="8c2b396a267549f4b7911646251a4094">tempest-TestVolumeBootPattern-1927887073-project-member</nova:user>
Aug 22 03:27:27 user nova-compute[73469]:         <nova:project uuid="f9878ef4b06740e9af1fc5aff14417ab">tempest-TestVolumeBootPattern-1927887073</nova:project>
Aug 22 03:27:27 user nova-compute[73469]:       </nova:owner>
Aug 22 03:27:27 user nova-compute[73469]:       <nova:ports>
Aug 22 03:27:27 user nova-compute[73469]:         <nova:port uuid="4ab979d5-acac-4b3e-83de-6e7be1133da0">
Aug 22 03:27:27 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 22 03:27:27 user nova-compute[73469]:         </nova:port>
Aug 22 03:27:27 user nova-compute[73469]:       </nova:ports>
Aug 22 03:27:27 user nova-compute[73469]:     </nova:instance>
Aug 22 03:27:27 user nova-compute[73469]:   </metadata>
Aug 22 03:27:27 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:27:27 user nova-compute[73469]:     <system>
Aug 22 03:27:27 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:27:27 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:27:27 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:27:27 user nova-compute[73469]:       <entry name="serial">3ee7c47f-372e-4855-993b-3539a5c474aa</entry>
Aug 22 03:27:27 user nova-compute[73469]:       <entry name="uuid">3ee7c47f-372e-4855-993b-3539a5c474aa</entry>
Aug 22 03:27:27 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:27:27 user nova-compute[73469]:     </system>
Aug 22 03:27:27 user nova-compute[73469]:   </sysinfo>
Aug 22 03:27:27 user nova-compute[73469]:   <os>
Aug 22 03:27:27 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:27:27 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:27:27 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:27:27 user nova-compute[73469]:   </os>
Aug 22 03:27:27 user nova-compute[73469]:   <features>
Aug 22 03:27:27 user nova-compute[73469]:     <acpi/>
Aug 22 03:27:27 user nova-compute[73469]:     <apic/>
Aug 22 03:27:27 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:27:27 user nova-compute[73469]:   </features>
Aug 22 03:27:27 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:27:27 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:27:27 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:27:27 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:27:27 user nova-compute[73469]:   </clock>
Aug 22 03:27:27 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:27:27 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:27:27 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:27:27 user nova-compute[73469]:   </cpu>
Aug 22 03:27:27 user nova-compute[73469]:   <devices>
Aug 22 03:27:27 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:27:27 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:27:27 user nova-compute[73469]:       <source dev="/dev/sdb"/>
Aug 22 03:27:27 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:27:27 user nova-compute[73469]:       <serial>d8c32d07-fdef-4fff-8ccf-608137154701</serial>
Aug 22 03:27:27 user nova-compute[73469]:     </disk>
Aug 22 03:27:27 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:27:27 user nova-compute[73469]:       <mac address="fa:16:3e:ce:ca:84"/>
Aug 22 03:27:27 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:27:27 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:27:27 user nova-compute[73469]:       <target dev="tap4ab979d5-ac"/>
Aug 22 03:27:27 user nova-compute[73469]:     </interface>
Aug 22 03:27:27 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:27:27 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/3ee7c47f-372e-4855-993b-3539a5c474aa/console.log" append="off"/>
Aug 22 03:27:27 user nova-compute[73469]:     </serial>
Aug 22 03:27:27 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:27:27 user nova-compute[73469]:     <video>
Aug 22 03:27:27 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:27:27 user nova-compute[73469]:     </video>
Aug 22 03:27:27 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:27:27 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:27:27 user nova-compute[73469]:     </rng>
Aug 22 03:27:27 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:27:27 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:27:27 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:27:27 user nova-compute[73469]:     </memballoon>
Aug 22 03:27:27 user nova-compute[73469]:   </devices>
Aug 22 03:27:27 user nova-compute[73469]: </domain>
Aug 22 03:27:27 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:27:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1397359901',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1397359901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1397359901',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoyTZp+WTuZnA513B5xopgb43qDL+5CxcfblhVI4qpM6E9uKIcUGfqo1Osl57NbPf4k3UwxAQaaZnWKGvejneBWgd1CUr/WENgI+4kaFVhuhTN12nQyjIElknKVoDc4kg==',key_name='tempest-keypair-127698107',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9878ef4b06740e9af1fc5aff14417ab',ramdisk_id='',reservation_id='r-qm5ubclz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1927887073',owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:27:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c2b396a267549f4b7911646251a4094',uuid=3ee7c47f-372e-4855-993b-3539a5c474aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "address": "fa:16:3e:ce:ca:84", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab979d5-ac", "ovs_interfaceid": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converting VIF {"id": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "address": "fa:16:3e:ce:ca:84", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab979d5-ac", "ovs_interfaceid": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:84,bridge_name='br-int',has_traffic_filtering=True,id=4ab979d5-acac-4b3e-83de-6e7be1133da0,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ab979d5-ac') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG os_vif [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:84,bridge_name='br-int',has_traffic_filtering=True,id=4ab979d5-acac-4b3e-83de-6e7be1133da0,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ab979d5-ac') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ab979d5-ac, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ab979d5-ac, col_values=(('external_ids', {'iface-id': '4ab979d5-acac-4b3e-83de-6e7be1133da0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:ca:84', 'vm-uuid': '3ee7c47f-372e-4855-993b-3539a5c474aa'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:27 user nova-compute[73469]: INFO os_vif [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ca:84,bridge_name='br-int',has_traffic_filtering=True,id=4ab979d5-acac-4b3e-83de-6e7be1133da0,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ab979d5-ac')
Aug 22 03:27:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:27:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] No VIF found with MAC fa:16:3e:ce:ca:84, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:27:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-e57093f7-c813-4eee-b75a-a16f95a59390 req-98412f24-dcb4-4724-a63f-a0a8cdab1f9d service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Received event network-vif-plugged-4ab979d5-acac-4b3e-83de-6e7be1133da0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:27:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e57093f7-c813-4eee-b75a-a16f95a59390 req-98412f24-dcb4-4724-a63f-a0a8cdab1f9d service nova] Acquiring lock "3ee7c47f-372e-4855-993b-3539a5c474aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:27:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e57093f7-c813-4eee-b75a-a16f95a59390 req-98412f24-dcb4-4724-a63f-a0a8cdab1f9d service nova] Lock "3ee7c47f-372e-4855-993b-3539a5c474aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:27:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-e57093f7-c813-4eee-b75a-a16f95a59390 req-98412f24-dcb4-4724-a63f-a0a8cdab1f9d service nova] Lock "3ee7c47f-372e-4855-993b-3539a5c474aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:27:28 user nova-compute[73469]: DEBUG nova.compute.manager [req-e57093f7-c813-4eee-b75a-a16f95a59390 req-98412f24-dcb4-4724-a63f-a0a8cdab1f9d service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] No waiting events found dispatching network-vif-plugged-4ab979d5-acac-4b3e-83de-6e7be1133da0 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:27:28 user nova-compute[73469]: WARNING nova.compute.manager [req-e57093f7-c813-4eee-b75a-a16f95a59390 req-98412f24-dcb4-4724-a63f-a0a8cdab1f9d service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Received unexpected event network-vif-plugged-4ab979d5-acac-4b3e-83de-6e7be1133da0 for instance with vm_state building and task_state spawning.
Aug 22 03:27:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:30 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674850.390453, 3ee7c47f-372e-4855-993b-3539a5c474aa => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:27:30 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] VM Resumed (Lifecycle Event)
Aug 22 03:27:30 user nova-compute[73469]: DEBUG nova.compute.manager [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:27:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:27:30 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Instance spawned successfully.
Aug 22 03:27:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:27:30 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:27:30 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:27:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:27:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:27:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:27:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:27:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:27:30 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:27:30 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:27:30 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674850.393653, 3ee7c47f-372e-4855-993b-3539a5c474aa => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:27:30 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] VM Started (Lifecycle Event)
Aug 22 03:27:30 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:27:30 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:27:30 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:27:30 user nova-compute[73469]: INFO nova.compute.manager [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Took 4.84 seconds to spawn the instance on the hypervisor.
Aug 22 03:27:30 user nova-compute[73469]: DEBUG nova.compute.manager [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:27:30 user nova-compute[73469]: INFO nova.compute.manager [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Took 15.94 seconds to build instance.
Aug 22 03:27:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d1679d19-2bf8-4718-a2c5-9093f8636dc7 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "3ee7c47f-372e-4855-993b-3539a5c474aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.042s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:27:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-8f62c45b-2927-4e62-8c6b-82d625aa10df req-b2cabd40-0f39-4737-8a68-8dcce0fd92b5 service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Received event network-vif-plugged-4ab979d5-acac-4b3e-83de-6e7be1133da0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:27:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8f62c45b-2927-4e62-8c6b-82d625aa10df req-b2cabd40-0f39-4737-8a68-8dcce0fd92b5 service nova] Acquiring lock "3ee7c47f-372e-4855-993b-3539a5c474aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:27:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8f62c45b-2927-4e62-8c6b-82d625aa10df req-b2cabd40-0f39-4737-8a68-8dcce0fd92b5 service nova] Lock "3ee7c47f-372e-4855-993b-3539a5c474aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:27:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8f62c45b-2927-4e62-8c6b-82d625aa10df req-b2cabd40-0f39-4737-8a68-8dcce0fd92b5 service nova] Lock "3ee7c47f-372e-4855-993b-3539a5c474aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:27:30 user nova-compute[73469]: DEBUG nova.compute.manager [req-8f62c45b-2927-4e62-8c6b-82d625aa10df req-b2cabd40-0f39-4737-8a68-8dcce0fd92b5 service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] No waiting events found dispatching network-vif-plugged-4ab979d5-acac-4b3e-83de-6e7be1133da0 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:27:30 user nova-compute[73469]: WARNING nova.compute.manager [req-8f62c45b-2927-4e62-8c6b-82d625aa10df req-b2cabd40-0f39-4737-8a68-8dcce0fd92b5 service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Received unexpected event network-vif-plugged-4ab979d5-acac-4b3e-83de-6e7be1133da0 for instance with vm_state active and task_state None.
Aug 22 03:27:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:47 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:27:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:52 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:27:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:28:02 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:28:02 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:28:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:28:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-0b20349a-8916-4c73-b47a-ada7a89c62ce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:28:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-0b20349a-8916-4c73-b47a-ada7a89c62ce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:28:02 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:28:03 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Updating instance_info_cache with network_info: [{"id": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "address": "fa:16:3e:27:6b:e0", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf0ed07-bc", "ovs_interfaceid": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:28:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-0b20349a-8916-4c73-b47a-ada7a89c62ce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:28:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:28:04 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:28:04 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:28:04 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:28:05 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:28:06 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:28:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:28:08 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:28:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:28:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:28:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:28:08 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:28:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:28:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:28:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:28:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:28:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:28:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:28:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:28:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:28:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:28:09 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:28:09 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:28:09 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8505MB free_disk=25.01419448852539GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:28:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:28:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:28:09 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a313534c-121a-4d89-92c9-c3ba40b78c99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:28:09 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 0b20349a-8916-4c73-b47a-ada7a89c62ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:28:09 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 3ee7c47f-372e-4855-993b-3539a5c474aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:28:09 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:28:09 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:28:09 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:28:09 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:28:09 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:28:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:28:10 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:28:10 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:28:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:28:14 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:28:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:28:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:28:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:28:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:28:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:28:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:28:22 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:28:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Verify base images {{(pid=73469) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73469) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Image id 6772c3c0-c19a-41db-956f-74b7e2a8fcc3 yields fingerprint 1df8b7feec6a5dac3605e847abf2342f397ed344 {{(pid=73469) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 22 03:28:28 user nova-compute[73469]: INFO nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] image 6772c3c0-c19a-41db-956f-74b7e2a8fcc3 at (/opt/stack/data/nova/instances/_base/1df8b7feec6a5dac3605e847abf2342f397ed344): checking
Aug 22 03:28:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] image 6772c3c0-c19a-41db-956f-74b7e2a8fcc3 at (/opt/stack/data/nova/instances/_base/1df8b7feec6a5dac3605e847abf2342f397ed344): image is in use {{(pid=73469) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Image id a2a344d0-c924-4f6a-b6e6-23be8c2d6ded yields fingerprint 27334ffc5b443608f49049e639053f2a9cc58bbc {{(pid=73469) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 22 03:28:28 user nova-compute[73469]: INFO nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] image a2a344d0-c924-4f6a-b6e6-23be8c2d6ded at (/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc): checking
Aug 22 03:28:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] image a2a344d0-c924-4f6a-b6e6-23be8c2d6ded at (/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc): image is in use {{(pid=73469) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] 0b20349a-8916-4c73-b47a-ada7a89c62ce is a valid instance name {{(pid=73469) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] 0b20349a-8916-4c73-b47a-ada7a89c62ce has a disk file {{(pid=73469) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 0b20349a-8916-4c73-b47a-ada7a89c62ce is backed by 1df8b7feec6a5dac3605e847abf2342f397ed344 {{(pid=73469) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] a313534c-121a-4d89-92c9-c3ba40b78c99 is a valid instance name {{(pid=73469) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] a313534c-121a-4d89-92c9-c3ba40b78c99 has a disk file {{(pid=73469) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a313534c-121a-4d89-92c9-c3ba40b78c99 is backed by 27334ffc5b443608f49049e639053f2a9cc58bbc {{(pid=73469) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] 3ee7c47f-372e-4855-993b-3539a5c474aa is a valid instance name {{(pid=73469) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 22 03:28:28 user nova-compute[73469]: WARNING nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Unknown base file: /opt/stack/data/nova/instances/_base/dc4152c281a7f32648acccda271cabd3ab60b30f
Aug 22 03:28:28 user nova-compute[73469]: WARNING nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Unknown base file: /opt/stack/data/nova/instances/_base/59718c6b0b9635a96b3e42d4e4978356d15a2687
Aug 22 03:28:28 user nova-compute[73469]: WARNING nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5d024a34e4ff0162280fbf83cf1134b4e1104813
Aug 22 03:28:28 user nova-compute[73469]: WARNING nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c1d13c2dfe30a89c5c60755e449836585222ceff
Aug 22 03:28:28 user nova-compute[73469]: WARNING nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Unknown base file: /opt/stack/data/nova/instances/_base/34a2e19293ced1a09651fa91b79b7ae3c870548f
Aug 22 03:28:28 user nova-compute[73469]: WARNING nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Unknown base file: /opt/stack/data/nova/instances/_base/69f43ca870176f5696a6ffbd09c7d8bf27c566ad
Aug 22 03:28:28 user nova-compute[73469]: WARNING nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3
Aug 22 03:28:28 user nova-compute[73469]: WARNING nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Unknown base file: /opt/stack/data/nova/instances/_base/dd3d75ce1a1ca9f409ccd559944ce38f88da297b
Aug 22 03:28:28 user nova-compute[73469]: INFO nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Active base files: /opt/stack/data/nova/instances/_base/1df8b7feec6a5dac3605e847abf2342f397ed344 /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc
Aug 22 03:28:28 user nova-compute[73469]: INFO nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Removable base files: /opt/stack/data/nova/instances/_base/dc4152c281a7f32648acccda271cabd3ab60b30f /opt/stack/data/nova/instances/_base/59718c6b0b9635a96b3e42d4e4978356d15a2687 /opt/stack/data/nova/instances/_base/5d024a34e4ff0162280fbf83cf1134b4e1104813 /opt/stack/data/nova/instances/_base/c1d13c2dfe30a89c5c60755e449836585222ceff /opt/stack/data/nova/instances/_base/34a2e19293ced1a09651fa91b79b7ae3c870548f /opt/stack/data/nova/instances/_base/69f43ca870176f5696a6ffbd09c7d8bf27c566ad /opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3 /opt/stack/data/nova/instances/_base/dd3d75ce1a1ca9f409ccd559944ce38f88da297b
Aug 22 03:28:28 user nova-compute[73469]: INFO nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dc4152c281a7f32648acccda271cabd3ab60b30f
Aug 22 03:28:28 user nova-compute[73469]: INFO nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/59718c6b0b9635a96b3e42d4e4978356d15a2687
Aug 22 03:28:28 user nova-compute[73469]: INFO nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5d024a34e4ff0162280fbf83cf1134b4e1104813
Aug 22 03:28:28 user nova-compute[73469]: INFO nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c1d13c2dfe30a89c5c60755e449836585222ceff
Aug 22 03:28:28 user nova-compute[73469]: INFO nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/34a2e19293ced1a09651fa91b79b7ae3c870548f
Aug 22 03:28:28 user nova-compute[73469]: INFO nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/69f43ca870176f5696a6ffbd09c7d8bf27c566ad
Aug 22 03:28:28 user nova-compute[73469]: INFO nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ca0536a4d5400c1f5093e19d00b02c8cdde318b3
Aug 22 03:28:28 user nova-compute[73469]: INFO nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dd3d75ce1a1ca9f409ccd559944ce38f88da297b
Aug 22 03:28:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Verification complete {{(pid=73469) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Verify swap images {{(pid=73469) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 22 03:28:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.imagecache [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Verify ephemeral images {{(pid=73469) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 22 03:28:32 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:28:37 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:28:42 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:28:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG nova.compute.manager [req-a451fd31-b747-4066-8022-8b29e9cb185d req-5d1826e0-534d-4b9f-9aaa-56de0ce5803d service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Received event network-changed-4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG nova.compute.manager [req-a451fd31-b747-4066-8022-8b29e9cb185d req-5d1826e0-534d-4b9f-9aaa-56de0ce5803d service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Refreshing instance network info cache due to event network-changed-4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a451fd31-b747-4066-8022-8b29e9cb185d req-5d1826e0-534d-4b9f-9aaa-56de0ce5803d service nova] Acquiring lock "refresh_cache-0b20349a-8916-4c73-b47a-ada7a89c62ce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a451fd31-b747-4066-8022-8b29e9cb185d req-5d1826e0-534d-4b9f-9aaa-56de0ce5803d service nova] Acquired lock "refresh_cache-0b20349a-8916-4c73-b47a-ada7a89c62ce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG nova.network.neutron [req-a451fd31-b747-4066-8022-8b29e9cb185d req-5d1826e0-534d-4b9f-9aaa-56de0ce5803d service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Refreshing network info cache for port 4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "0b20349a-8916-4c73-b47a-ada7a89c62ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "0b20349a-8916-4c73-b47a-ada7a89c62ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "0b20349a-8916-4c73-b47a-ada7a89c62ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "0b20349a-8916-4c73-b47a-ada7a89c62ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "0b20349a-8916-4c73-b47a-ada7a89c62ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:28:44 user nova-compute[73469]: INFO nova.compute.manager [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Terminating instance
Aug 22 03:28:44 user nova-compute[73469]: DEBUG nova.compute.manager [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG nova.compute.manager [req-51e24740-d620-4a58-a214-79ce29ff9932 req-fd4ed170-3b1f-4a40-bce6-c1ed1f01d4af service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Received event network-vif-unplugged-4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-51e24740-d620-4a58-a214-79ce29ff9932 req-fd4ed170-3b1f-4a40-bce6-c1ed1f01d4af service nova] Acquiring lock "0b20349a-8916-4c73-b47a-ada7a89c62ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-51e24740-d620-4a58-a214-79ce29ff9932 req-fd4ed170-3b1f-4a40-bce6-c1ed1f01d4af service nova] Lock "0b20349a-8916-4c73-b47a-ada7a89c62ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-51e24740-d620-4a58-a214-79ce29ff9932 req-fd4ed170-3b1f-4a40-bce6-c1ed1f01d4af service nova] Lock "0b20349a-8916-4c73-b47a-ada7a89c62ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG nova.compute.manager [req-51e24740-d620-4a58-a214-79ce29ff9932 req-fd4ed170-3b1f-4a40-bce6-c1ed1f01d4af service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] No waiting events found dispatching network-vif-unplugged-4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG nova.compute.manager [req-51e24740-d620-4a58-a214-79ce29ff9932 req-fd4ed170-3b1f-4a40-bce6-c1ed1f01d4af service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Received event network-vif-unplugged-4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:28:44 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Instance destroyed successfully.
Aug 22 03:28:44 user nova-compute[73469]: DEBUG nova.objects.instance [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lazy-loading 'resources' on Instance uuid 0b20349a-8916-4c73-b47a-ada7a89c62ce {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:23:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-975460297',display_name='tempest-TestStampPattern-server-975460297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-975460297',id=45,image_ref='6772c3c0-c19a-41db-956f-74b7e2a8fcc3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbbf7G0NOfRw/WveQo0wMklCRaQB6z4T276+FgSZHUtpkblbgKXhU3Q61VXJyHD1Dzj3wZj9gC/PhXMUryNTwkrTRmn8xreypCMtIoDaSoL2VUGYyY09H8O2SvcUlZQjA==',key_name='tempest-TestStampPattern-1767620429',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:23:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='467cfd0cdd79427b95292f684a990ac7',ramdisk_id='',reservation_id='r-kjghuk5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a313534c-121a-4d89-92c9-c3ba40b78c99',image_min_disk='1',image_min_ram='0',image_owner_id='467cfd0cdd79427b95292f684a990ac7',image_owner_project_name='tempest-TestStampPattern-912449456',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-912449456-project-member',image_user_id='96518602ea5a41749a90e53b39cc6eb2',owner_project_name='tempest-TestStampPattern-912449456',owner_user_name='tempest-TestStampPattern-912449456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:23:43Z,user_data=None,user_id='96518602ea5a41749a90e53b39cc6eb2',uuid=0b20349a-8916-4c73-b47a-ada7a89c62ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "address": "fa:16:3e:27:6b:e0", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf0ed07-bc", "ovs_interfaceid": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Converting VIF {"id": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "address": "fa:16:3e:27:6b:e0", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf0ed07-bc", "ovs_interfaceid": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:6b:e0,bridge_name='br-int',has_traffic_filtering=True,id=4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c,network=Network(8f171a1d-8c92-4090-8e32-9bdda50c1c8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf0ed07-bc') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG os_vif [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:6b:e0,bridge_name='br-int',has_traffic_filtering=True,id=4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c,network=Network(8f171a1d-8c92-4090-8e32-9bdda50c1c8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf0ed07-bc') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bf0ed07-bc, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:28:44 user nova-compute[73469]: INFO os_vif [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:6b:e0,bridge_name='br-int',has_traffic_filtering=True,id=4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c,network=Network(8f171a1d-8c92-4090-8e32-9bdda50c1c8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf0ed07-bc')
Aug 22 03:28:44 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Deleting instance files /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce_del
Aug 22 03:28:44 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Deletion of /opt/stack/data/nova/instances/0b20349a-8916-4c73-b47a-ada7a89c62ce_del complete
Aug 22 03:28:44 user nova-compute[73469]: INFO nova.compute.manager [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 22 03:28:44 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:28:44 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:28:45 user nova-compute[73469]: DEBUG nova.network.neutron [req-a451fd31-b747-4066-8022-8b29e9cb185d req-5d1826e0-534d-4b9f-9aaa-56de0ce5803d service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Updated VIF entry in instance network info cache for port 4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:28:45 user nova-compute[73469]: DEBUG nova.network.neutron [req-a451fd31-b747-4066-8022-8b29e9cb185d req-5d1826e0-534d-4b9f-9aaa-56de0ce5803d service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Updating instance_info_cache with network_info: [{"id": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "address": "fa:16:3e:27:6b:e0", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf0ed07-bc", "ovs_interfaceid": "4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:28:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a451fd31-b747-4066-8022-8b29e9cb185d req-5d1826e0-534d-4b9f-9aaa-56de0ce5803d service nova] Releasing lock "refresh_cache-0b20349a-8916-4c73-b47a-ada7a89c62ce" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:28:45 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:28:45 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Took 0.63 seconds to deallocate network for instance.
Aug 22 03:28:45 user nova-compute[73469]: DEBUG nova.compute.manager [req-eade7db5-a43f-4968-82e9-20431b1e80ec req-a5e45260-222c-4c09-ab94-10e4a5b2423a service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Received event network-vif-deleted-4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:28:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:28:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:28:45 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:28:45 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:28:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:28:45 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Deleted allocations for instance 0b20349a-8916-4c73-b47a-ada7a89c62ce
Aug 22 03:28:45 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-359ffcce-77ba-42de-a3ee-9585908d7fc2 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "0b20349a-8916-4c73-b47a-ada7a89c62ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.693s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:28:46 user nova-compute[73469]: DEBUG nova.compute.manager [req-48c1c823-e39c-437d-8a52-0df5c46cde80 req-43b22c0e-8edd-47b3-8474-e584b9a6e61d service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Received event network-vif-plugged-4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:28:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-48c1c823-e39c-437d-8a52-0df5c46cde80 req-43b22c0e-8edd-47b3-8474-e584b9a6e61d service nova] Acquiring lock "0b20349a-8916-4c73-b47a-ada7a89c62ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:28:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-48c1c823-e39c-437d-8a52-0df5c46cde80 req-43b22c0e-8edd-47b3-8474-e584b9a6e61d service nova] Lock "0b20349a-8916-4c73-b47a-ada7a89c62ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:28:46 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-48c1c823-e39c-437d-8a52-0df5c46cde80 req-43b22c0e-8edd-47b3-8474-e584b9a6e61d service nova] Lock "0b20349a-8916-4c73-b47a-ada7a89c62ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:28:46 user nova-compute[73469]: DEBUG nova.compute.manager [req-48c1c823-e39c-437d-8a52-0df5c46cde80 req-43b22c0e-8edd-47b3-8474-e584b9a6e61d service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] No waiting events found dispatching network-vif-plugged-4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:28:46 user nova-compute[73469]: WARNING nova.compute.manager [req-48c1c823-e39c-437d-8a52-0df5c46cde80 req-43b22c0e-8edd-47b3-8474-e584b9a6e61d service nova] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Received unexpected event network-vif-plugged-4bf0ed07-bc8b-4fd2-a54b-277a5e2aca9c for instance with vm_state deleted and task_state None.
Aug 22 03:28:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:28:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:28:59 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692674924.8022833, 0b20349a-8916-4c73-b47a-ada7a89c62ce => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:28:59 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] VM Stopped (Lifecycle Event)
Aug 22 03:28:59 user nova-compute[73469]: DEBUG nova.compute.manager [None req-45809ddf-5fa7-4fa7-a7c5-fe841f7996a8 None None] [instance: 0b20349a-8916-4c73-b47a-ada7a89c62ce] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:28:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:01 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:29:02 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:29:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:29:02 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:29:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:29:02 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:29:02 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:29:02 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid a313534c-121a-4d89-92c9-c3ba40b78c99 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:29:03 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Updating instance_info_cache with network_info: [{"id": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "address": "fa:16:3e:69:71:05", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2855f6eb-f5", "ovs_interfaceid": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:29:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:29:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:29:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:05 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:29:05 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:29:05 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:29:06 user nova-compute[73469]: DEBUG nova.compute.manager [req-f771659c-b6a7-48f1-b745-0340fae383fe req-e3079573-a402-44ce-b1f5-eabbc8af141a service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Received event network-changed-4ab979d5-acac-4b3e-83de-6e7be1133da0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:29:06 user nova-compute[73469]: DEBUG nova.compute.manager [req-f771659c-b6a7-48f1-b745-0340fae383fe req-e3079573-a402-44ce-b1f5-eabbc8af141a service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Refreshing instance network info cache due to event network-changed-4ab979d5-acac-4b3e-83de-6e7be1133da0. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:29:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f771659c-b6a7-48f1-b745-0340fae383fe req-e3079573-a402-44ce-b1f5-eabbc8af141a service nova] Acquiring lock "refresh_cache-3ee7c47f-372e-4855-993b-3539a5c474aa" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:29:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f771659c-b6a7-48f1-b745-0340fae383fe req-e3079573-a402-44ce-b1f5-eabbc8af141a service nova] Acquired lock "refresh_cache-3ee7c47f-372e-4855-993b-3539a5c474aa" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:29:06 user nova-compute[73469]: DEBUG nova.network.neutron [req-f771659c-b6a7-48f1-b745-0340fae383fe req-e3079573-a402-44ce-b1f5-eabbc8af141a service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Refreshing network info cache for port 4ab979d5-acac-4b3e-83de-6e7be1133da0 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:29:06 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:29:06 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:29:07 user nova-compute[73469]: DEBUG nova.network.neutron [req-f771659c-b6a7-48f1-b745-0340fae383fe req-e3079573-a402-44ce-b1f5-eabbc8af141a service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Updated VIF entry in instance network info cache for port 4ab979d5-acac-4b3e-83de-6e7be1133da0. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:29:07 user nova-compute[73469]: DEBUG nova.network.neutron [req-f771659c-b6a7-48f1-b745-0340fae383fe req-e3079573-a402-44ce-b1f5-eabbc8af141a service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Updating instance_info_cache with network_info: [{"id": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "address": "fa:16:3e:ce:ca:84", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab979d5-ac", "ovs_interfaceid": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:29:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f771659c-b6a7-48f1-b745-0340fae383fe req-e3079573-a402-44ce-b1f5-eabbc8af141a service nova] Releasing lock "refresh_cache-3ee7c47f-372e-4855-993b-3539a5c474aa" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:29:07 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:29:07 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 22 03:29:08 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:29:08 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:29:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:29:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:29:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:29:08 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:29:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:29:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:29:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:29:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:29:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:29:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:09 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:29:09 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:29:09 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8616MB free_disk=25.01433563232422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:29:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:29:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:29:09 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a313534c-121a-4d89-92c9-c3ba40b78c99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:29:09 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 3ee7c47f-372e-4855-993b-3539a5c474aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:29:09 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:29:09 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:29:09 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:29:09 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:29:09 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:29:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:29:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:11 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:29:11 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:29:11 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:29:11 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 22 03:29:11 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] There are 0 instances to clean {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 22 03:29:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:14 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:29:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:29:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:29:18 user nova-compute[73469]: DEBUG nova.compute.manager [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:29:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:29:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:29:18 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:29:18 user nova-compute[73469]: INFO nova.compute.claims [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Claim successful on node user
Aug 22 03:29:18 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:29:18 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:29:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.226s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:29:18 user nova-compute[73469]: DEBUG nova.compute.manager [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:29:19 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:29:19 user nova-compute[73469]: DEBUG nova.compute.manager [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:29:19 user nova-compute[73469]: DEBUG nova.network.neutron [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:29:19 user nova-compute[73469]: DEBUG nova.compute.manager [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:29:19 user nova-compute[73469]: INFO nova.virt.block_device [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Booting with volume snapshot 1d56f4a1-db74-4b49-935a-3dccc7a47911 at /dev/vda
Aug 22 03:29:19 user nova-compute[73469]: DEBUG nova.policy [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c2b396a267549f4b7911646251a4094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9878ef4b06740e9af1fc5aff14417ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:29:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:29:20 user nova-compute[73469]: DEBUG nova.network.neutron [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Successfully created port: 12443aa0-6128-4fca-b107-6090609b458f {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:29:20 user nova-compute[73469]: DEBUG nova.network.neutron [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Successfully updated port: 12443aa0-6128-4fca-b107-6090609b458f {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:29:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "refresh_cache-92f403fc-913a-4cad-9cf8-cb35b3372e9c" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:29:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquired lock "refresh_cache-92f403fc-913a-4cad-9cf8-cb35b3372e9c" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:29:20 user nova-compute[73469]: DEBUG nova.network.neutron [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:29:20 user nova-compute[73469]: DEBUG nova.compute.manager [req-4238b253-f7a9-4eee-a1a0-e300dcfc44b6 req-09bb5e9f-a92b-416b-b148-4cc70fa52d0a service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Received event network-changed-12443aa0-6128-4fca-b107-6090609b458f {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:29:20 user nova-compute[73469]: DEBUG nova.compute.manager [req-4238b253-f7a9-4eee-a1a0-e300dcfc44b6 req-09bb5e9f-a92b-416b-b148-4cc70fa52d0a service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Refreshing instance network info cache due to event network-changed-12443aa0-6128-4fca-b107-6090609b458f. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:29:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4238b253-f7a9-4eee-a1a0-e300dcfc44b6 req-09bb5e9f-a92b-416b-b148-4cc70fa52d0a service nova] Acquiring lock "refresh_cache-92f403fc-913a-4cad-9cf8-cb35b3372e9c" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:29:20 user nova-compute[73469]: DEBUG nova.network.neutron [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:29:21 user nova-compute[73469]: DEBUG nova.network.neutron [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Updating instance_info_cache with network_info: [{"id": "12443aa0-6128-4fca-b107-6090609b458f", "address": "fa:16:3e:53:66:82", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12443aa0-61", "ovs_interfaceid": "12443aa0-6128-4fca-b107-6090609b458f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:29:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Releasing lock "refresh_cache-92f403fc-913a-4cad-9cf8-cb35b3372e9c" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:29:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Instance network_info: |[{"id": "12443aa0-6128-4fca-b107-6090609b458f", "address": "fa:16:3e:53:66:82", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12443aa0-61", "ovs_interfaceid": "12443aa0-6128-4fca-b107-6090609b458f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:29:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4238b253-f7a9-4eee-a1a0-e300dcfc44b6 req-09bb5e9f-a92b-416b-b148-4cc70fa52d0a service nova] Acquired lock "refresh_cache-92f403fc-913a-4cad-9cf8-cb35b3372e9c" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:29:21 user nova-compute[73469]: DEBUG nova.network.neutron [req-4238b253-f7a9-4eee-a1a0-e300dcfc44b6 req-09bb5e9f-a92b-416b-b148-4cc70fa52d0a service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Refreshing network info cache for port 12443aa0-6128-4fca-b107-6090609b458f {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:29:21 user nova-compute[73469]: DEBUG nova.network.neutron [req-4238b253-f7a9-4eee-a1a0-e300dcfc44b6 req-09bb5e9f-a92b-416b-b148-4cc70fa52d0a service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Updated VIF entry in instance network info cache for port 12443aa0-6128-4fca-b107-6090609b458f. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:29:21 user nova-compute[73469]: DEBUG nova.network.neutron [req-4238b253-f7a9-4eee-a1a0-e300dcfc44b6 req-09bb5e9f-a92b-416b-b148-4cc70fa52d0a service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Updating instance_info_cache with network_info: [{"id": "12443aa0-6128-4fca-b107-6090609b458f", "address": "fa:16:3e:53:66:82", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12443aa0-61", "ovs_interfaceid": "12443aa0-6128-4fca-b107-6090609b458f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:29:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4238b253-f7a9-4eee-a1a0-e300dcfc44b6 req-09bb5e9f-a92b-416b-b148-4cc70fa52d0a service nova] Releasing lock "refresh_cache-92f403fc-913a-4cad-9cf8-cb35b3372e9c" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:29:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:24 user nova-compute[73469]: DEBUG os_brick.utils [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:29:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:29:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:29:24 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[303fe50d-8e3d-4b8d-8757-3117e80ba8e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:29:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:29:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:29:24 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[171dfb06-8aaa-403c-83c1-2d868ceeb310]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:29:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:29:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:29:24 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d600e7-2335-4f9e-b484-ebddd5e4b9e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:29:24 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43cc569-92fc-46ac-aa53-1b43d5318623]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:29:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:29:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:29:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:29:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:29:25 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:29:25 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:29:25 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc86bc4d-5bfd-46d0-aa6c-c62da62278e3]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:29:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:29:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:29:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:29:25 user nova-compute[73469]: DEBUG os_brick.utils [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:29:25 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Updating existing volume attachment record: 03c4bf9e-36a7-4cab-a0d3-ff41e3867bd4 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:29:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:29:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:29 user nova-compute[73469]: WARNING nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor.
Aug 22 03:29:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid a313534c-121a-4d89-92c9-c3ba40b78c99 {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 03:29:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid 3ee7c47f-372e-4855-993b-3539a5c474aa {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 03:29:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid 92f403fc-913a-4cad-9cf8-cb35b3372e9c {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 03:29:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "a313534c-121a-4d89-92c9-c3ba40b78c99" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:29:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:29:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "3ee7c47f-372e-4855-993b-3539a5c474aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:29:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "3ee7c47f-372e-4855-993b-3539a5c474aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:29:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:29:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:29:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "3ee7c47f-372e-4855-993b-3539a5c474aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:29:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.compute.manager [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:29:35 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Creating image(s)
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Did not create local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Ensure instance console log exists: /opt/stack/data/nova/instances/92f403fc-913a-4cad-9cf8-cb35b3372e9c/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Start _get_guest_xml network_info=[{"id": "12443aa0-6128-4fca-b107-6090609b458f", "address": "fa:16:3e:53:66:82", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12443aa0-61", "ovs_interfaceid": "12443aa0-6128-4fca-b107-6090609b458f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-22T03:29:08Z,direct_url=<?>,disk_format='qcow2',id=c63b5836-d5c2-48c5-9331-729ca9c90d9d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1842290386',owner='f9878ef4b06740e9af1fc5aff14417ab',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-22T03:29:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '03c4bf9e-36a7-4cab-a0d3-ff41e3867bd4', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fPdcCREy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '92f403fc-913a-4cad-9cf8-cb35b3372e9c', 'attached_at': '', 'detached_at': '', 'volume_id': '231f9b62-c675-4c6d-a9ff-4d59306b2ceb', 'serial': '231f9b62-c675-4c6d-a9ff-4d59306b2ceb'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:29:35 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:29:35 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-22T03:29:08Z,direct_url=<?>,disk_format='qcow2',id=c63b5836-d5c2-48c5-9331-729ca9c90d9d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1842290386',owner='f9878ef4b06740e9af1fc5aff14417ab',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-22T03:29:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fPdcCREy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:29:35 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:29:35 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:29:35 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[17151b0c-0943-4df4-bbc3-cfeca9fcd2b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:29:35 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e3f3ff-5936-4240-bc68-de5271b40faa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb] added
Aug 22 03:29:35 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc81288-1c6e-40c6-bf51-d86af22f2a5c]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94a639a-582d-4ca7-8c69-f441788ba4f9]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fPdcCREy {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fPdcCREy" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[548dede3-f79d-4695-a6df-a15592b27069]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fPdcCREy'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9307462e-5433-459d-ac60-7a0e6811bbac]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83678e7-a635-49a8-95cf-c8cbc152712d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 (non-flash)
Aug 22 03:29:35 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 (non-flash)
Aug 22 03:29:35 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[560a9e54-3ef2-4923-9301-e6f7eeb06096]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb, portal: 172.16.0.220,3260]
Aug 22 03:29:35 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb, portal: 172.16.0.220,3260] successful.
Aug 22 03:29:35 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ae44f6-1598-4361-96c5-2f71db805b37]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f670e1-f30f-4e0b-8cb9-62b020018b81]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 (non-flash)
Aug 22 03:29:35 user nova-compute[73469]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb (non-flash)
Aug 22 03:29:35 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 (non-flash)
Aug 22 03:29:35 user nova-compute[73469]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb (non-flash)
Aug 22 03:29:35 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfc0314-c5f4-46d6-8fab-b0c11924591b]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:29:35 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fPdcCREy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23039636435633264', 'path': '/dev/sdc'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039636435633264', 'path': '/dev/sdc'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:29:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-968681542',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-968681542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-968681542',id=48,image_ref='c63b5836-d5c2-48c5-9331-729ca9c90d9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLF+b4jK0trUFQSb4xM3flo95Fbs20eZ4r2ttiRtJp2CsO+Z+JhIgPvSrWLZ+Xg3vN5WpzyfN+NeGoPdTCSzcbAXdWAzYisibAaRCJRNmieo03lQ21v8Bnmk0Cr+aupCkQ==',key_name='tempest-keypair-1972646588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9878ef4b06740e9af1fc5aff14417ab',ramdisk_id='',reservation_id='r-5ias5kmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1927887073',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1927887073',owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:29:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c2b396a267549f4b7911646251a4094',uuid=92f403fc-913a-4cad-9cf8-cb35b3372e9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12443aa0-6128-4fca-b107-6090609b458f", "address": "fa:16:3e:53:66:82", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12443aa0-61", "ovs_interfaceid": "12443aa0-6128-4fca-b107-6090609b458f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converting VIF {"id": "12443aa0-6128-4fca-b107-6090609b458f", "address": "fa:16:3e:53:66:82", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12443aa0-61", "ovs_interfaceid": "12443aa0-6128-4fca-b107-6090609b458f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:66:82,bridge_name='br-int',has_traffic_filtering=True,id=12443aa0-6128-4fca-b107-6090609b458f,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12443aa0-61') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG nova.objects.instance [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lazy-loading 'pci_devices' on Instance uuid 92f403fc-913a-4cad-9cf8-cb35b3372e9c {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:29:36 user nova-compute[73469]:   <uuid>92f403fc-913a-4cad-9cf8-cb35b3372e9c</uuid>
Aug 22 03:29:36 user nova-compute[73469]:   <name>instance-00000030</name>
Aug 22 03:29:36 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:29:36 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:29:36 user nova-compute[73469]:   <metadata>
Aug 22 03:29:36 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:29:36 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:29:36 user nova-compute[73469]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-968681542</nova:name>
Aug 22 03:29:36 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:29:35</nova:creationTime>
Aug 22 03:29:36 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:29:36 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:29:36 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:29:36 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:29:36 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:29:36 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:29:36 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:29:36 user nova-compute[73469]:       <nova:owner>
Aug 22 03:29:36 user nova-compute[73469]:         <nova:user uuid="8c2b396a267549f4b7911646251a4094">tempest-TestVolumeBootPattern-1927887073-project-member</nova:user>
Aug 22 03:29:36 user nova-compute[73469]:         <nova:project uuid="f9878ef4b06740e9af1fc5aff14417ab">tempest-TestVolumeBootPattern-1927887073</nova:project>
Aug 22 03:29:36 user nova-compute[73469]:       </nova:owner>
Aug 22 03:29:36 user nova-compute[73469]:       <nova:root type="image" uuid="c63b5836-d5c2-48c5-9331-729ca9c90d9d"/>
Aug 22 03:29:36 user nova-compute[73469]:       <nova:ports>
Aug 22 03:29:36 user nova-compute[73469]:         <nova:port uuid="12443aa0-6128-4fca-b107-6090609b458f">
Aug 22 03:29:36 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 22 03:29:36 user nova-compute[73469]:         </nova:port>
Aug 22 03:29:36 user nova-compute[73469]:       </nova:ports>
Aug 22 03:29:36 user nova-compute[73469]:     </nova:instance>
Aug 22 03:29:36 user nova-compute[73469]:   </metadata>
Aug 22 03:29:36 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:29:36 user nova-compute[73469]:     <system>
Aug 22 03:29:36 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:29:36 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:29:36 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:29:36 user nova-compute[73469]:       <entry name="serial">92f403fc-913a-4cad-9cf8-cb35b3372e9c</entry>
Aug 22 03:29:36 user nova-compute[73469]:       <entry name="uuid">92f403fc-913a-4cad-9cf8-cb35b3372e9c</entry>
Aug 22 03:29:36 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:29:36 user nova-compute[73469]:     </system>
Aug 22 03:29:36 user nova-compute[73469]:   </sysinfo>
Aug 22 03:29:36 user nova-compute[73469]:   <os>
Aug 22 03:29:36 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:29:36 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:29:36 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:29:36 user nova-compute[73469]:   </os>
Aug 22 03:29:36 user nova-compute[73469]:   <features>
Aug 22 03:29:36 user nova-compute[73469]:     <acpi/>
Aug 22 03:29:36 user nova-compute[73469]:     <apic/>
Aug 22 03:29:36 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:29:36 user nova-compute[73469]:   </features>
Aug 22 03:29:36 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:29:36 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:29:36 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:29:36 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:29:36 user nova-compute[73469]:   </clock>
Aug 22 03:29:36 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:29:36 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:29:36 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:29:36 user nova-compute[73469]:   </cpu>
Aug 22 03:29:36 user nova-compute[73469]:   <devices>
Aug 22 03:29:36 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:29:36 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:29:36 user nova-compute[73469]:       <source dev="/dev/sdc"/>
Aug 22 03:29:36 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:29:36 user nova-compute[73469]:       <serial>231f9b62-c675-4c6d-a9ff-4d59306b2ceb</serial>
Aug 22 03:29:36 user nova-compute[73469]:     </disk>
Aug 22 03:29:36 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:29:36 user nova-compute[73469]:       <mac address="fa:16:3e:53:66:82"/>
Aug 22 03:29:36 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:29:36 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:29:36 user nova-compute[73469]:       <target dev="tap12443aa0-61"/>
Aug 22 03:29:36 user nova-compute[73469]:     </interface>
Aug 22 03:29:36 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:29:36 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/92f403fc-913a-4cad-9cf8-cb35b3372e9c/console.log" append="off"/>
Aug 22 03:29:36 user nova-compute[73469]:     </serial>
Aug 22 03:29:36 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:29:36 user nova-compute[73469]:     <video>
Aug 22 03:29:36 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:29:36 user nova-compute[73469]:     </video>
Aug 22 03:29:36 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:29:36 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:29:36 user nova-compute[73469]:     </rng>
Aug 22 03:29:36 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:29:36 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:29:36 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:29:36 user nova-compute[73469]:     </memballoon>
Aug 22 03:29:36 user nova-compute[73469]:   </devices>
Aug 22 03:29:36 user nova-compute[73469]: </domain>
Aug 22 03:29:36 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:29:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-968681542',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-968681542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-968681542',id=48,image_ref='c63b5836-d5c2-48c5-9331-729ca9c90d9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLF+b4jK0trUFQSb4xM3flo95Fbs20eZ4r2ttiRtJp2CsO+Z+JhIgPvSrWLZ+Xg3vN5WpzyfN+NeGoPdTCSzcbAXdWAzYisibAaRCJRNmieo03lQ21v8Bnmk0Cr+aupCkQ==',key_name='tempest-keypair-1972646588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9878ef4b06740e9af1fc5aff14417ab',ramdisk_id='',reservation_id='r-5ias5kmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1927887073',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1927887073',owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:29:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c2b396a267549f4b7911646251a4094',uuid=92f403fc-913a-4cad-9cf8-cb35b3372e9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12443aa0-6128-4fca-b107-6090609b458f", "address": "fa:16:3e:53:66:82", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12443aa0-61", "ovs_interfaceid": "12443aa0-6128-4fca-b107-6090609b458f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converting VIF {"id": "12443aa0-6128-4fca-b107-6090609b458f", "address": "fa:16:3e:53:66:82", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12443aa0-61", "ovs_interfaceid": "12443aa0-6128-4fca-b107-6090609b458f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:66:82,bridge_name='br-int',has_traffic_filtering=True,id=12443aa0-6128-4fca-b107-6090609b458f,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12443aa0-61') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG os_vif [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:66:82,bridge_name='br-int',has_traffic_filtering=True,id=12443aa0-6128-4fca-b107-6090609b458f,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12443aa0-61') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12443aa0-61, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap12443aa0-61, col_values=(('external_ids', {'iface-id': '12443aa0-6128-4fca-b107-6090609b458f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:66:82', 'vm-uuid': '92f403fc-913a-4cad-9cf8-cb35b3372e9c'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:36 user nova-compute[73469]: INFO os_vif [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:66:82,bridge_name='br-int',has_traffic_filtering=True,id=12443aa0-6128-4fca-b107-6090609b458f,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12443aa0-61')
Aug 22 03:29:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:29:36 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] No VIF found with MAC fa:16:3e:53:66:82, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:29:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-33fd1b48-4f44-48ba-bb0c-c39243a542b5 req-21ec2e4f-ca89-47e7-9366-33d815ba6e52 service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Received event network-vif-plugged-12443aa0-6128-4fca-b107-6090609b458f {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:29:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-33fd1b48-4f44-48ba-bb0c-c39243a542b5 req-21ec2e4f-ca89-47e7-9366-33d815ba6e52 service nova] Acquiring lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:29:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-33fd1b48-4f44-48ba-bb0c-c39243a542b5 req-21ec2e4f-ca89-47e7-9366-33d815ba6e52 service nova] Lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:29:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-33fd1b48-4f44-48ba-bb0c-c39243a542b5 req-21ec2e4f-ca89-47e7-9366-33d815ba6e52 service nova] Lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:29:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-33fd1b48-4f44-48ba-bb0c-c39243a542b5 req-21ec2e4f-ca89-47e7-9366-33d815ba6e52 service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] No waiting events found dispatching network-vif-plugged-12443aa0-6128-4fca-b107-6090609b458f {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:29:38 user nova-compute[73469]: WARNING nova.compute.manager [req-33fd1b48-4f44-48ba-bb0c-c39243a542b5 req-21ec2e4f-ca89-47e7-9366-33d815ba6e52 service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Received unexpected event network-vif-plugged-12443aa0-6128-4fca-b107-6090609b458f for instance with vm_state building and task_state spawning.
Aug 22 03:29:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:40 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674980.4416611, 92f403fc-913a-4cad-9cf8-cb35b3372e9c => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:29:40 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] VM Resumed (Lifecycle Event)
Aug 22 03:29:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:29:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:29:40 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Instance spawned successfully.
Aug 22 03:29:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:29:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:29:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:29:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:29:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:29:40 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:29:40 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692674980.4450655, 92f403fc-913a-4cad-9cf8-cb35b3372e9c => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:29:40 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] VM Started (Lifecycle Event)
Aug 22 03:29:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:29:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:29:40 user nova-compute[73469]: DEBUG nova.compute.manager [req-827574b4-0b14-40ca-832e-2e6652e04b71 req-4e1ee31f-3f3c-4cb4-b815-b8d24c0da032 service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Received event network-vif-plugged-12443aa0-6128-4fca-b107-6090609b458f {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:29:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-827574b4-0b14-40ca-832e-2e6652e04b71 req-4e1ee31f-3f3c-4cb4-b815-b8d24c0da032 service nova] Acquiring lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:29:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-827574b4-0b14-40ca-832e-2e6652e04b71 req-4e1ee31f-3f3c-4cb4-b815-b8d24c0da032 service nova] Lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:29:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-827574b4-0b14-40ca-832e-2e6652e04b71 req-4e1ee31f-3f3c-4cb4-b815-b8d24c0da032 service nova] Lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:29:40 user nova-compute[73469]: DEBUG nova.compute.manager [req-827574b4-0b14-40ca-832e-2e6652e04b71 req-4e1ee31f-3f3c-4cb4-b815-b8d24c0da032 service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] No waiting events found dispatching network-vif-plugged-12443aa0-6128-4fca-b107-6090609b458f {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:29:40 user nova-compute[73469]: WARNING nova.compute.manager [req-827574b4-0b14-40ca-832e-2e6652e04b71 req-4e1ee31f-3f3c-4cb4-b815-b8d24c0da032 service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Received unexpected event network-vif-plugged-12443aa0-6128-4fca-b107-6090609b458f for instance with vm_state building and task_state spawning.
Aug 22 03:29:40 user nova-compute[73469]: INFO nova.compute.manager [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Took 5.15 seconds to spawn the instance on the hypervisor.
Aug 22 03:29:40 user nova-compute[73469]: DEBUG nova.compute.manager [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:29:40 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:29:40 user nova-compute[73469]: INFO nova.compute.manager [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Took 21.96 seconds to build instance.
Aug 22 03:29:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-358ddb9a-f9f9-4787-b63a-97c0d4357b55 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.057s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:29:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.836s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:29:40 user nova-compute[73469]: INFO nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 22 03:29:40 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:29:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:29:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:29:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:29:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:29:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-7e076cba-ac50-4e5e-833d-0160e81a34d1 req-e62f4c5c-3331-4f22-8cd6-2b46b67ad68f service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received event network-changed-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-7e076cba-ac50-4e5e-833d-0160e81a34d1 req-e62f4c5c-3331-4f22-8cd6-2b46b67ad68f service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Refreshing instance network info cache due to event network-changed-2855f6eb-f5d9-46a6-a9d1-6b00ae364250. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7e076cba-ac50-4e5e-833d-0160e81a34d1 req-e62f4c5c-3331-4f22-8cd6-2b46b67ad68f service nova] Acquiring lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7e076cba-ac50-4e5e-833d-0160e81a34d1 req-e62f4c5c-3331-4f22-8cd6-2b46b67ad68f service nova] Acquired lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG nova.network.neutron [req-7e076cba-ac50-4e5e-833d-0160e81a34d1 req-e62f4c5c-3331-4f22-8cd6-2b46b67ad68f service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Refreshing network info cache for port 2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "a313534c-121a-4d89-92c9-c3ba40b78c99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:29:49 user nova-compute[73469]: INFO nova.compute.manager [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Terminating instance
Aug 22 03:29:49 user nova-compute[73469]: DEBUG nova.compute.manager [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-4a151360-fbd6-484c-885d-d09def95e3ef req-d9b77056-8e71-451c-bff1-979354e18c1a service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received event network-vif-unplugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4a151360-fbd6-484c-885d-d09def95e3ef req-d9b77056-8e71-451c-bff1-979354e18c1a service nova] Acquiring lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4a151360-fbd6-484c-885d-d09def95e3ef req-d9b77056-8e71-451c-bff1-979354e18c1a service nova] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-4a151360-fbd6-484c-885d-d09def95e3ef req-d9b77056-8e71-451c-bff1-979354e18c1a service nova] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-4a151360-fbd6-484c-885d-d09def95e3ef req-d9b77056-8e71-451c-bff1-979354e18c1a service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] No waiting events found dispatching network-vif-unplugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-4a151360-fbd6-484c-885d-d09def95e3ef req-d9b77056-8e71-451c-bff1-979354e18c1a service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received event network-vif-unplugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:50 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Instance destroyed successfully.
Aug 22 03:29:50 user nova-compute[73469]: DEBUG nova.objects.instance [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lazy-loading 'resources' on Instance uuid a313534c-121a-4d89-92c9-c3ba40b78c99 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:29:50 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:20:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-677344581',display_name='tempest-TestStampPattern-server-677344581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-677344581',id=44,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbbf7G0NOfRw/WveQo0wMklCRaQB6z4T276+FgSZHUtpkblbgKXhU3Q61VXJyHD1Dzj3wZj9gC/PhXMUryNTwkrTRmn8xreypCMtIoDaSoL2VUGYyY09H8O2SvcUlZQjA==',key_name='tempest-TestStampPattern-1767620429',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:20:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='467cfd0cdd79427b95292f684a990ac7',ramdisk_id='',reservation_id='r-i1izifv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-912449456',owner_user_name='tempest-TestStampPattern-912449456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:23:32Z,user_data=None,user_id='96518602ea5a41749a90e53b39cc6eb2',uuid=a313534c-121a-4d89-92c9-c3ba40b78c99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "address": "fa:16:3e:69:71:05", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2855f6eb-f5", "ovs_interfaceid": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:29:50 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Converting VIF {"id": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "address": "fa:16:3e:69:71:05", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2855f6eb-f5", "ovs_interfaceid": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:29:50 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:71:05,bridge_name='br-int',has_traffic_filtering=True,id=2855f6eb-f5d9-46a6-a9d1-6b00ae364250,network=Network(8f171a1d-8c92-4090-8e32-9bdda50c1c8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2855f6eb-f5') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:29:50 user nova-compute[73469]: DEBUG os_vif [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:71:05,bridge_name='br-int',has_traffic_filtering=True,id=2855f6eb-f5d9-46a6-a9d1-6b00ae364250,network=Network(8f171a1d-8c92-4090-8e32-9bdda50c1c8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2855f6eb-f5') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:29:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2855f6eb-f5, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:29:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:29:50 user nova-compute[73469]: INFO os_vif [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:71:05,bridge_name='br-int',has_traffic_filtering=True,id=2855f6eb-f5d9-46a6-a9d1-6b00ae364250,network=Network(8f171a1d-8c92-4090-8e32-9bdda50c1c8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2855f6eb-f5')
Aug 22 03:29:50 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Deleting instance files /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99_del
Aug 22 03:29:50 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Deletion of /opt/stack/data/nova/instances/a313534c-121a-4d89-92c9-c3ba40b78c99_del complete
Aug 22 03:29:50 user nova-compute[73469]: INFO nova.compute.manager [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 22 03:29:50 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:29:50 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:29:50 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:29:50 user nova-compute[73469]: DEBUG nova.network.neutron [req-7e076cba-ac50-4e5e-833d-0160e81a34d1 req-e62f4c5c-3331-4f22-8cd6-2b46b67ad68f service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Updated VIF entry in instance network info cache for port 2855f6eb-f5d9-46a6-a9d1-6b00ae364250. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:29:50 user nova-compute[73469]: DEBUG nova.network.neutron [req-7e076cba-ac50-4e5e-833d-0160e81a34d1 req-e62f4c5c-3331-4f22-8cd6-2b46b67ad68f service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Updating instance_info_cache with network_info: [{"id": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "address": "fa:16:3e:69:71:05", "network": {"id": "8f171a1d-8c92-4090-8e32-9bdda50c1c8e", "bridge": "br-int", "label": "tempest-TestStampPattern-858870448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "467cfd0cdd79427b95292f684a990ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2855f6eb-f5", "ovs_interfaceid": "2855f6eb-f5d9-46a6-a9d1-6b00ae364250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:29:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-7e076cba-ac50-4e5e-833d-0160e81a34d1 req-e62f4c5c-3331-4f22-8cd6-2b46b67ad68f service nova] Releasing lock "refresh_cache-a313534c-121a-4d89-92c9-c3ba40b78c99" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:29:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:29:51 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Took 1.16 seconds to deallocate network for instance.
Aug 22 03:29:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:29:51 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Deleted allocations for instance a313534c-121a-4d89-92c9-c3ba40b78c99
Aug 22 03:29:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-16dc64c7-d37b-495e-bc4b-4693bc69d875 tempest-TestStampPattern-912449456 tempest-TestStampPattern-912449456-project-member] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.376s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG nova.compute.manager [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received event network-vif-plugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] Acquiring lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG nova.compute.manager [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] No waiting events found dispatching network-vif-plugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:29:51 user nova-compute[73469]: WARNING nova.compute.manager [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received unexpected event network-vif-plugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 for instance with vm_state deleted and task_state None.
Aug 22 03:29:51 user nova-compute[73469]: DEBUG nova.compute.manager [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received event network-vif-plugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] Acquiring lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG nova.compute.manager [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] No waiting events found dispatching network-vif-plugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:29:51 user nova-compute[73469]: WARNING nova.compute.manager [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received unexpected event network-vif-plugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 for instance with vm_state deleted and task_state None.
Aug 22 03:29:51 user nova-compute[73469]: DEBUG nova.compute.manager [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received event network-vif-plugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] Acquiring lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG nova.compute.manager [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] No waiting events found dispatching network-vif-plugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:29:51 user nova-compute[73469]: WARNING nova.compute.manager [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received unexpected event network-vif-plugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 for instance with vm_state deleted and task_state None.
Aug 22 03:29:51 user nova-compute[73469]: DEBUG nova.compute.manager [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received event network-vif-unplugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] Acquiring lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:29:51 user nova-compute[73469]: DEBUG nova.compute.manager [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] No waiting events found dispatching network-vif-unplugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:29:51 user nova-compute[73469]: WARNING nova.compute.manager [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received unexpected event network-vif-unplugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 for instance with vm_state deleted and task_state None.
Aug 22 03:29:51 user nova-compute[73469]: DEBUG nova.compute.manager [req-f2fba9af-cc1f-40de-a549-a233a8719adf req-e854ac71-d9cf-42f2-a26b-cfc6d9647410 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received event network-vif-deleted-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:29:53 user nova-compute[73469]: DEBUG nova.compute.manager [req-00311e4e-57f8-4c17-b89d-f1393181ce10 req-be4fdd3f-9dcd-4b5d-9fb9-a53ff737f7e0 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received event network-vif-plugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:29:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-00311e4e-57f8-4c17-b89d-f1393181ce10 req-be4fdd3f-9dcd-4b5d-9fb9-a53ff737f7e0 service nova] Acquiring lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:29:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-00311e4e-57f8-4c17-b89d-f1393181ce10 req-be4fdd3f-9dcd-4b5d-9fb9-a53ff737f7e0 service nova] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:29:53 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-00311e4e-57f8-4c17-b89d-f1393181ce10 req-be4fdd3f-9dcd-4b5d-9fb9-a53ff737f7e0 service nova] Lock "a313534c-121a-4d89-92c9-c3ba40b78c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:29:53 user nova-compute[73469]: DEBUG nova.compute.manager [req-00311e4e-57f8-4c17-b89d-f1393181ce10 req-be4fdd3f-9dcd-4b5d-9fb9-a53ff737f7e0 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] No waiting events found dispatching network-vif-plugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:29:53 user nova-compute[73469]: WARNING nova.compute.manager [req-00311e4e-57f8-4c17-b89d-f1393181ce10 req-be4fdd3f-9dcd-4b5d-9fb9-a53ff737f7e0 service nova] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Received unexpected event network-vif-plugged-2855f6eb-f5d9-46a6-a9d1-6b00ae364250 for instance with vm_state deleted and task_state None.
Aug 22 03:29:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:29:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:30:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:30:03 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:30:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:30:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-3ee7c47f-372e-4855-993b-3539a5c474aa" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:30:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-3ee7c47f-372e-4855-993b-3539a5c474aa" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:30:03 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:30:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:30:04 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Updating instance_info_cache with network_info: [{"id": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "address": "fa:16:3e:ce:ca:84", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab979d5-ac", "ovs_interfaceid": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:30:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-3ee7c47f-372e-4855-993b-3539a5c474aa" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:30:04 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:30:05 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692674990.0003088, a313534c-121a-4d89-92c9-c3ba40b78c99 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:30:05 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] VM Stopped (Lifecycle Event)
Aug 22 03:30:05 user nova-compute[73469]: DEBUG nova.compute.manager [None req-a75c8d25-fc44-4230-9774-f32904692d56 None None] [instance: a313534c-121a-4d89-92c9-c3ba40b78c99] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:30:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:30:06 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:30:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:30:07 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:30:07 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:30:08 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:30:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:30:09 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:30:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:30:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:30:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:30:09 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:30:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:30:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:30:09 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:30:09 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:30:09 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8568MB free_disk=25.12957000732422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:30:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:30:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:30:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:30:10 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 3ee7c47f-372e-4855-993b-3539a5c474aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:30:10 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 92f403fc-913a-4cad-9cf8-cb35b3372e9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:30:10 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:30:10 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:30:10 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing inventories for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 22 03:30:10 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Updating ProviderTree inventory for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 22 03:30:10 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Updating inventory in ProviderTree for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 22 03:30:10 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing aggregate associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, aggregates: None {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 22 03:30:10 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing trait associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 22 03:30:10 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:30:10 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:30:10 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:30:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:30:12 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:30:12 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:30:14 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:30:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:30:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:30:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:30:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:30:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:30:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:30:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:30:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:30:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:30:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:30:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:30:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:30:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:30:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:30:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:30:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:30:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:30:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:30:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:30:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:30:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:30:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:31:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:31:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:31:05 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:31:05 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:31:05 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:31:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-3ee7c47f-372e-4855-993b-3539a5c474aa" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:31:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-3ee7c47f-372e-4855-993b-3539a5c474aa" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:31:05 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:31:05 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid 3ee7c47f-372e-4855-993b-3539a5c474aa {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:31:06 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Updating instance_info_cache with network_info: [{"id": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "address": "fa:16:3e:ce:ca:84", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab979d5-ac", "ovs_interfaceid": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:31:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-3ee7c47f-372e-4855-993b-3539a5c474aa" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:31:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:31:07 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:31:08 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:31:08 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:31:08 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:31:08 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:31:09 user nova-compute[73469]: DEBUG nova.compute.manager [req-bdf41086-d654-4837-b398-e336dacf1708 req-d4b739d3-7536-4ca9-8f38-20fb95ddb19c service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Received event network-changed-12443aa0-6128-4fca-b107-6090609b458f {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:31:09 user nova-compute[73469]: DEBUG nova.compute.manager [req-bdf41086-d654-4837-b398-e336dacf1708 req-d4b739d3-7536-4ca9-8f38-20fb95ddb19c service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Refreshing instance network info cache due to event network-changed-12443aa0-6128-4fca-b107-6090609b458f. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:31:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bdf41086-d654-4837-b398-e336dacf1708 req-d4b739d3-7536-4ca9-8f38-20fb95ddb19c service nova] Acquiring lock "refresh_cache-92f403fc-913a-4cad-9cf8-cb35b3372e9c" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:31:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bdf41086-d654-4837-b398-e336dacf1708 req-d4b739d3-7536-4ca9-8f38-20fb95ddb19c service nova] Acquired lock "refresh_cache-92f403fc-913a-4cad-9cf8-cb35b3372e9c" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:31:09 user nova-compute[73469]: DEBUG nova.network.neutron [req-bdf41086-d654-4837-b398-e336dacf1708 req-d4b739d3-7536-4ca9-8f38-20fb95ddb19c service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Refreshing network info cache for port 12443aa0-6128-4fca-b107-6090609b458f {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:31:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:31:10 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:31:10 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:31:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:31:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:31:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:31:10 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:31:10 user nova-compute[73469]: DEBUG nova.network.neutron [req-bdf41086-d654-4837-b398-e336dacf1708 req-d4b739d3-7536-4ca9-8f38-20fb95ddb19c service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Updated VIF entry in instance network info cache for port 12443aa0-6128-4fca-b107-6090609b458f. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:31:10 user nova-compute[73469]: DEBUG nova.network.neutron [req-bdf41086-d654-4837-b398-e336dacf1708 req-d4b739d3-7536-4ca9-8f38-20fb95ddb19c service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Updating instance_info_cache with network_info: [{"id": "12443aa0-6128-4fca-b107-6090609b458f", "address": "fa:16:3e:53:66:82", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12443aa0-61", "ovs_interfaceid": "12443aa0-6128-4fca-b107-6090609b458f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:31:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-bdf41086-d654-4837-b398-e336dacf1708 req-d4b739d3-7536-4ca9-8f38-20fb95ddb19c service nova] Releasing lock "refresh_cache-92f403fc-913a-4cad-9cf8-cb35b3372e9c" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:31:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:31:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:31:10 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:31:10 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:31:10 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8688MB free_disk=25.126834869384766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:31:11 user nova-compute[73469]: INFO nova.compute.manager [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Terminating instance
Aug 22 03:31:11 user nova-compute[73469]: DEBUG nova.compute.manager [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 3ee7c47f-372e-4855-993b-3539a5c474aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 92f403fc-913a-4cad-9cf8-cb35b3372e9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG nova.compute.manager [req-ad9c5ba0-3b77-4b86-a256-0c0014f78462 req-bc60a7e1-e905-4223-9ef9-1966df0320d0 service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Received event network-vif-unplugged-12443aa0-6128-4fca-b107-6090609b458f {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ad9c5ba0-3b77-4b86-a256-0c0014f78462 req-bc60a7e1-e905-4223-9ef9-1966df0320d0 service nova] Acquiring lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ad9c5ba0-3b77-4b86-a256-0c0014f78462 req-bc60a7e1-e905-4223-9ef9-1966df0320d0 service nova] Lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ad9c5ba0-3b77-4b86-a256-0c0014f78462 req-bc60a7e1-e905-4223-9ef9-1966df0320d0 service nova] Lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG nova.compute.manager [req-ad9c5ba0-3b77-4b86-a256-0c0014f78462 req-bc60a7e1-e905-4223-9ef9-1966df0320d0 service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] No waiting events found dispatching network-vif-unplugged-12443aa0-6128-4fca-b107-6090609b458f {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG nova.compute.manager [req-ad9c5ba0-3b77-4b86-a256-0c0014f78462 req-bc60a7e1-e905-4223-9ef9-1966df0320d0 service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Received event network-vif-unplugged-12443aa0-6128-4fca-b107-6090609b458f for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:31:11 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Instance destroyed successfully.
Aug 22 03:31:11 user nova-compute[73469]: DEBUG nova.objects.instance [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lazy-loading 'resources' on Instance uuid 92f403fc-913a-4cad-9cf8-cb35b3372e9c {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:29:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-968681542',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-968681542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-968681542',id=48,image_ref='c63b5836-d5c2-48c5-9331-729ca9c90d9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLF+b4jK0trUFQSb4xM3flo95Fbs20eZ4r2ttiRtJp2CsO+Z+JhIgPvSrWLZ+Xg3vN5WpzyfN+NeGoPdTCSzcbAXdWAzYisibAaRCJRNmieo03lQ21v8Bnmk0Cr+aupCkQ==',key_name='tempest-keypair-1972646588',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:29:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9878ef4b06740e9af1fc5aff14417ab',ramdisk_id='',reservation_id='r-5ias5kmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1927887073',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1927887073',owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:29:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c2b396a267549f4b7911646251a4094',uuid=92f403fc-913a-4cad-9cf8-cb35b3372e9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12443aa0-6128-4fca-b107-6090609b458f", "address": "fa:16:3e:53:66:82", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12443aa0-61", "ovs_interfaceid": "12443aa0-6128-4fca-b107-6090609b458f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converting VIF {"id": "12443aa0-6128-4fca-b107-6090609b458f", "address": "fa:16:3e:53:66:82", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12443aa0-61", "ovs_interfaceid": "12443aa0-6128-4fca-b107-6090609b458f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:66:82,bridge_name='br-int',has_traffic_filtering=True,id=12443aa0-6128-4fca-b107-6090609b458f,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12443aa0-61') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG os_vif [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:66:82,bridge_name='br-int',has_traffic_filtering=True,id=12443aa0-6128-4fca-b107-6090609b458f,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12443aa0-61') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12443aa0-61, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:31:11 user nova-compute[73469]: INFO os_vif [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:66:82,bridge_name='br-int',has_traffic_filtering=True,id=12443aa0-6128-4fca-b107-6090609b458f,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12443aa0-61')
Aug 22 03:31:11 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fPdcCREy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:31:11 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:31:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cf0dda-a207-4108-9700-a49350a54f4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be72667-4935-44d2-b791-8571f9e5ebc9]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 (non-flash)
Aug 22 03:31:11 user nova-compute[73469]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb (non-flash)
Aug 22 03:31:11 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 (non-flash)
Aug 22 03:31:11 user nova-compute[73469]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb (non-flash)
Aug 22 03:31:11 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a415c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb'): ({'sdc'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Removing single pathed devices sdc {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb80fd66-bfc5-4c71-bc1e-f7ddfc9190e4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[691373bd-4b46-4f43-8028-70f33aafe532]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Flushing IO for device /dev/sdc {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0eb2a3f-66b3-4b8f-b3e5-7c975dd3f14d]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22777f1-285b-4b75-b54d-d30b4f51bf14]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO56ac3665-09cd5c2d0bbc5585', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_56ac3665', '/dev/disk/by-id/scsi-23039636435633264') {{(pid=84378) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74d8b3e-44dc-4c1e-a196-194de9916e18]: (4, None) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fec48c9-c66a-458d-8ab8-318d44d598ef]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:31:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:31:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:31:12 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b465ccd6-2fd7-4ecb-bb93-6f2fc5d636c6]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:31:12 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb, portal: 172.16.0.220,3260]
Aug 22 03:31:12 user nova-compute[73469]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb, portal: 172.16.0.220,3260] successful.
Aug 22 03:31:12 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:31:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:31:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231f9b62-c675-4c6d-a9ff-4d59306b2ceb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:31:12 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e19b7a8-f54e-4cce-8e21-b6ed661d2cd8]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:31:12 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:31:12 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:31:12 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] <== disconnect_volume: return (297ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:31:12 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:31:12 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Deleting instance files /opt/stack/data/nova/instances/92f403fc-913a-4cad-9cf8-cb35b3372e9c_del
Aug 22 03:31:12 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Deletion of /opt/stack/data/nova/instances/92f403fc-913a-4cad-9cf8-cb35b3372e9c_del complete
Aug 22 03:31:12 user nova-compute[73469]: INFO nova.compute.manager [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 22 03:31:12 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:31:12 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:31:12 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:31:12 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:31:12 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:31:12 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:31:12 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Took 0.76 seconds to deallocate network for instance.
Aug 22 03:31:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-b0805dd3-01c6-47a0-b847-447266e2db7c req-ec0ff614-873f-4fb6-91db-502a91a6a6f5 service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Received event network-vif-deleted-12443aa0-6128-4fca-b107-6090609b458f {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:31:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-6442abd2-5a4b-4f85-a511-4209a5ef7937 req-d52cf04e-1601-4114-9962-1bcd50b48879 service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Received event network-vif-plugged-12443aa0-6128-4fca-b107-6090609b458f {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:31:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6442abd2-5a4b-4f85-a511-4209a5ef7937 req-d52cf04e-1601-4114-9962-1bcd50b48879 service nova] Acquiring lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:31:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6442abd2-5a4b-4f85-a511-4209a5ef7937 req-d52cf04e-1601-4114-9962-1bcd50b48879 service nova] Lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:31:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6442abd2-5a4b-4f85-a511-4209a5ef7937 req-d52cf04e-1601-4114-9962-1bcd50b48879 service nova] Lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:31:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-6442abd2-5a4b-4f85-a511-4209a5ef7937 req-d52cf04e-1601-4114-9962-1bcd50b48879 service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] No waiting events found dispatching network-vif-plugged-12443aa0-6128-4fca-b107-6090609b458f {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:31:13 user nova-compute[73469]: WARNING nova.compute.manager [req-6442abd2-5a4b-4f85-a511-4209a5ef7937 req-d52cf04e-1601-4114-9962-1bcd50b48879 service nova] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Received unexpected event network-vif-plugged-12443aa0-6128-4fca-b107-6090609b458f for instance with vm_state active and task_state deleting.
Aug 22 03:31:13 user nova-compute[73469]: INFO nova.compute.manager [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Took 0.75 seconds to detach 1 volumes for instance.
Aug 22 03:31:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Deleting volume: 231f9b62-c675-4c6d-a9ff-4d59306b2ceb {{(pid=73469) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 22 03:31:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:31:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:31:13 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:31:13 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:31:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:31:13 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Deleted allocations for instance 92f403fc-913a-4cad-9cf8-cb35b3372e9c
Aug 22 03:31:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:31:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-62f75143-954f-4186-a9c0-5ffd83fe79c0 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "92f403fc-913a-4cad-9cf8-cb35b3372e9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.196s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:31:15 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:31:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:31:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:31:26 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692675071.74263, 92f403fc-913a-4cad-9cf8-cb35b3372e9c => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:31:26 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] VM Stopped (Lifecycle Event)
Aug 22 03:31:26 user nova-compute[73469]: DEBUG nova.compute.manager [None req-69835e9b-b494-4b56-b7b3-0cdd64d2e9a4 None None] [instance: 92f403fc-913a-4cad-9cf8-cb35b3372e9c] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:31:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:31:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:31:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:31:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:31:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:31:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:31:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:31:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:31:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:31:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:31:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:31:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:32:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:32:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:32:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:32:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:32:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:32:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:32:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:32:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "3ee7c47f-372e-4855-993b-3539a5c474aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:32:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "3ee7c47f-372e-4855-993b-3539a5c474aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:32:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "3ee7c47f-372e-4855-993b-3539a5c474aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:32:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "3ee7c47f-372e-4855-993b-3539a5c474aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:32:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "3ee7c47f-372e-4855-993b-3539a5c474aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:32:07 user nova-compute[73469]: INFO nova.compute.manager [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Terminating instance
Aug 22 03:32:07 user nova-compute[73469]: DEBUG nova.compute.manager [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:32:07 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:32:07 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:32:07 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Didn't find any instances for network info cache update. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 22 03:32:07 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:32:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:32:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:32:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:32:07 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:32:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-22e0a9a2-64cf-4764-8c2b-52aae5f8a938 req-3e66755a-e6f3-4e7f-b3e1-3630e688ad4b service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Received event network-vif-unplugged-4ab979d5-acac-4b3e-83de-6e7be1133da0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:32:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-22e0a9a2-64cf-4764-8c2b-52aae5f8a938 req-3e66755a-e6f3-4e7f-b3e1-3630e688ad4b service nova] Acquiring lock "3ee7c47f-372e-4855-993b-3539a5c474aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:32:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-22e0a9a2-64cf-4764-8c2b-52aae5f8a938 req-3e66755a-e6f3-4e7f-b3e1-3630e688ad4b service nova] Lock "3ee7c47f-372e-4855-993b-3539a5c474aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:32:07 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-22e0a9a2-64cf-4764-8c2b-52aae5f8a938 req-3e66755a-e6f3-4e7f-b3e1-3630e688ad4b service nova] Lock "3ee7c47f-372e-4855-993b-3539a5c474aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:32:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-22e0a9a2-64cf-4764-8c2b-52aae5f8a938 req-3e66755a-e6f3-4e7f-b3e1-3630e688ad4b service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] No waiting events found dispatching network-vif-unplugged-4ab979d5-acac-4b3e-83de-6e7be1133da0 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:32:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-22e0a9a2-64cf-4764-8c2b-52aae5f8a938 req-3e66755a-e6f3-4e7f-b3e1-3630e688ad4b service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Received event network-vif-unplugged-4ab979d5-acac-4b3e-83de-6e7be1133da0 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:32:08 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Instance destroyed successfully.
Aug 22 03:32:08 user nova-compute[73469]: DEBUG nova.objects.instance [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lazy-loading 'resources' on Instance uuid 3ee7c47f-372e-4855-993b-3539a5c474aa {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:27:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1397359901',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1397359901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1397359901',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoyTZp+WTuZnA513B5xopgb43qDL+5CxcfblhVI4qpM6E9uKIcUGfqo1Osl57NbPf4k3UwxAQaaZnWKGvejneBWgd1CUr/WENgI+4kaFVhuhTN12nQyjIElknKVoDc4kg==',key_name='tempest-keypair-127698107',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:27:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9878ef4b06740e9af1fc5aff14417ab',ramdisk_id='',reservation_id='r-qm5ubclz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1927887073',owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:27:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c2b396a267549f4b7911646251a4094',uuid=3ee7c47f-372e-4855-993b-3539a5c474aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "address": "fa:16:3e:ce:ca:84", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab979d5-ac", "ovs_interfaceid": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converting VIF {"id": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "address": "fa:16:3e:ce:ca:84", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab979d5-ac", "ovs_interfaceid": "4ab979d5-acac-4b3e-83de-6e7be1133da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ca:84,bridge_name='br-int',has_traffic_filtering=True,id=4ab979d5-acac-4b3e-83de-6e7be1133da0,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ab979d5-ac') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_vif [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ca:84,bridge_name='br-int',has_traffic_filtering=True,id=4ab979d5-acac-4b3e-83de-6e7be1133da0,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ab979d5-ac') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ab979d5-ac, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:32:08 user nova-compute[73469]: INFO os_vif [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ca:84,bridge_name='br-int',has_traffic_filtering=True,id=4ab979d5-acac-4b3e-83de-6e7be1133da0,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ab979d5-ac')
Aug 22 03:32:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AyQNlYti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:32:08 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d4dd10-af33-4e07-beb0-3348b87a6c4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5795366a-b777-4c55-8a0e-a8947ed03e7a]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 (non-flash)
Aug 22 03:32:08 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 (non-flash)
Aug 22 03:32:08 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4646170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb50587a-449e-4fd1-a623-d78ee481b991]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c89ec3-ce63-4425-b3e1-8a8854f3bc18]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43f47cb-9558-4f21-acaa-3d138cf6f999]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38cf2cf-4b08-41f3-862a-6a42f0897ff5]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23062653165313632', '/dev/disk/by-id/scsi-1SCST_BIO2cc81e0a-0be1e162e105d4c8', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2cc81e0a') {{(pid=84378) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e449ab3-559a-47ff-bf00-e73d3a5928eb]: (4, None) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bcafc1-5ba1-4711-b83b-5dcd92290c5b]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b839b861-fa88-441d-b1be-36863b59400f]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701, portal: 172.16.0.220,3260]
Aug 22 03:32:08 user nova-compute[73469]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701, portal: 172.16.0.220,3260] successful.
Aug 22 03:32:08 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c32d07-fdef-4fff-8ccf-608137154701 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1c02c2-7fde-4ec7-baf2-7997c9480ba4]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] <== disconnect_volume: return (288ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:32:08 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Deleting instance files /opt/stack/data/nova/instances/3ee7c47f-372e-4855-993b-3539a5c474aa_del
Aug 22 03:32:08 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Deletion of /opt/stack/data/nova/instances/3ee7c47f-372e-4855-993b-3539a5c474aa_del complete
Aug 22 03:32:08 user nova-compute[73469]: INFO nova.compute.manager [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 22 03:32:08 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:32:08 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:32:09 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:32:09 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Took 0.70 seconds to deallocate network for instance.
Aug 22 03:32:09 user nova-compute[73469]: DEBUG nova.compute.manager [req-063cd82f-2131-4d95-99cd-20173dc70ecb req-35209248-542f-4c6e-a548-c40f12ffab3e service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Received event network-vif-plugged-4ab979d5-acac-4b3e-83de-6e7be1133da0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:32:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-063cd82f-2131-4d95-99cd-20173dc70ecb req-35209248-542f-4c6e-a548-c40f12ffab3e service nova] Acquiring lock "3ee7c47f-372e-4855-993b-3539a5c474aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:32:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-063cd82f-2131-4d95-99cd-20173dc70ecb req-35209248-542f-4c6e-a548-c40f12ffab3e service nova] Lock "3ee7c47f-372e-4855-993b-3539a5c474aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:32:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-063cd82f-2131-4d95-99cd-20173dc70ecb req-35209248-542f-4c6e-a548-c40f12ffab3e service nova] Lock "3ee7c47f-372e-4855-993b-3539a5c474aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:32:09 user nova-compute[73469]: DEBUG nova.compute.manager [req-063cd82f-2131-4d95-99cd-20173dc70ecb req-35209248-542f-4c6e-a548-c40f12ffab3e service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] No waiting events found dispatching network-vif-plugged-4ab979d5-acac-4b3e-83de-6e7be1133da0 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:32:09 user nova-compute[73469]: WARNING nova.compute.manager [req-063cd82f-2131-4d95-99cd-20173dc70ecb req-35209248-542f-4c6e-a548-c40f12ffab3e service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Received unexpected event network-vif-plugged-4ab979d5-acac-4b3e-83de-6e7be1133da0 for instance with vm_state active and task_state deleting.
Aug 22 03:32:09 user nova-compute[73469]: DEBUG nova.compute.manager [req-063cd82f-2131-4d95-99cd-20173dc70ecb req-35209248-542f-4c6e-a548-c40f12ffab3e service nova] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Received event network-vif-deleted-4ab979d5-acac-4b3e-83de-6e7be1133da0 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:32:10 user nova-compute[73469]: INFO nova.compute.manager [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Took 0.74 seconds to detach 1 volumes for instance.
Aug 22 03:32:10 user nova-compute[73469]: DEBUG nova.compute.manager [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Deleting volume: d8c32d07-fdef-4fff-8ccf-608137154701 {{(pid=73469) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 22 03:32:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:32:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:32:10 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:32:10 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:32:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:32:10 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Deleted allocations for instance 3ee7c47f-372e-4855-993b-3539a5c474aa
Aug 22 03:32:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-61e745c5-599d-48ea-9aaa-c5bee873392f tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "3ee7c47f-372e-4855-993b-3539a5c474aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.905s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:32:10 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:32:10 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:32:10 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:32:11 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:32:12 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:32:12 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:32:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:32:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:32:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:32:12 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:32:12 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:32:12 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:32:12 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8896MB free_disk=25.125747680664062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:32:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:32:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:32:12 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:32:12 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:32:13 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:32:13 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:32:13 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:32:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:32:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:32:14 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:32:17 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:32:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:32:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:32:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:32:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:32:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:32:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:32:23 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692675128.1814542, 3ee7c47f-372e-4855-993b-3539a5c474aa => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:32:23 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] VM Stopped (Lifecycle Event)
Aug 22 03:32:23 user nova-compute[73469]: DEBUG nova.compute.manager [None req-8a6931f5-76d4-455c-ab17-c0522722fe83 None None] [instance: 3ee7c47f-372e-4855-993b-3539a5c474aa] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:32:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:32:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:32:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:32:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:32:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:32:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:32:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:32:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:32:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:32:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:32:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:32:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:32:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:32:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:33:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:08 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:33:08 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:33:08 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:33:08 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Didn't find any instances for network info cache update. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 22 03:33:08 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:33:10 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:33:11 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:33:11 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:33:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:33:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:33:11 user nova-compute[73469]: DEBUG nova.compute.manager [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:33:12 user nova-compute[73469]: INFO nova.compute.claims [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Claim successful on node user
Aug 22 03:33:12 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.179s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG nova.compute.manager [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG nova.compute.manager [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG nova.network.neutron [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:33:12 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:33:12 user nova-compute[73469]: DEBUG nova.compute.manager [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:33:12 user nova-compute[73469]: INFO nova.virt.block_device [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Booting with volume 92257668-86b5-4869-9fbb-02f3fb8f1d28 at /dev/vda
Aug 22 03:33:12 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG nova.policy [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c2b396a267549f4b7911646251a4094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9878ef4b06740e9af1fc5aff14417ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG os_brick.utils [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8164c0-4db6-4821-9ac0-776824e8f27e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a09f1c-d0f5-4742-8a11-bd0b40bc6e6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f7499d-1db1-4a4a-ad78-68a45a02192d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c21667-62d8-47bd-8bf1-626749d8b20a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:33:12 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:33:12 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92fb102-0c43-4262-ba4c-254596795487]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG os_brick.utils [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:33:12 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Updating existing volume attachment record: be1d6f8b-42ac-47cf-a045-b3d060000450 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:33:13 user nova-compute[73469]: DEBUG nova.network.neutron [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Successfully created port: e9a5856f-10cf-494b-a1f6-6a32235b5cd1 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:33:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:13 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:33:13 user nova-compute[73469]: DEBUG nova.network.neutron [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Successfully updated port: e9a5856f-10cf-494b-a1f6-6a32235b5cd1 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:33:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "refresh_cache-a19cd1f6-ea9b-4cfb-80ba-0368191187d6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:33:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquired lock "refresh_cache-a19cd1f6-ea9b-4cfb-80ba-0368191187d6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:33:13 user nova-compute[73469]: DEBUG nova.network.neutron [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:33:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-db58e970-6537-4864-89cb-6f87bba54ef7 req-1cb70ca4-74bf-45f4-bc41-b8e85ca50448 service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Received event network-changed-e9a5856f-10cf-494b-a1f6-6a32235b5cd1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:33:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-db58e970-6537-4864-89cb-6f87bba54ef7 req-1cb70ca4-74bf-45f4-bc41-b8e85ca50448 service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Refreshing instance network info cache due to event network-changed-e9a5856f-10cf-494b-a1f6-6a32235b5cd1. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:33:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-db58e970-6537-4864-89cb-6f87bba54ef7 req-1cb70ca4-74bf-45f4-bc41-b8e85ca50448 service nova] Acquiring lock "refresh_cache-a19cd1f6-ea9b-4cfb-80ba-0368191187d6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:33:13 user nova-compute[73469]: DEBUG nova.network.neutron [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:33:14 user nova-compute[73469]: DEBUG nova.network.neutron [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Updating instance_info_cache with network_info: [{"id": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "address": "fa:16:3e:e5:f9:97", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9a5856f-10", "ovs_interfaceid": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:33:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Releasing lock "refresh_cache-a19cd1f6-ea9b-4cfb-80ba-0368191187d6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:33:14 user nova-compute[73469]: DEBUG nova.compute.manager [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Instance network_info: |[{"id": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "address": "fa:16:3e:e5:f9:97", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9a5856f-10", "ovs_interfaceid": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:33:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-db58e970-6537-4864-89cb-6f87bba54ef7 req-1cb70ca4-74bf-45f4-bc41-b8e85ca50448 service nova] Acquired lock "refresh_cache-a19cd1f6-ea9b-4cfb-80ba-0368191187d6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:33:14 user nova-compute[73469]: DEBUG nova.network.neutron [req-db58e970-6537-4864-89cb-6f87bba54ef7 req-1cb70ca4-74bf-45f4-bc41-b8e85ca50448 service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Refreshing network info cache for port e9a5856f-10cf-494b-a1f6-6a32235b5cd1 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:33:14 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:33:14 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:33:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:33:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:33:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:33:14 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:33:14 user nova-compute[73469]: DEBUG nova.network.neutron [req-db58e970-6537-4864-89cb-6f87bba54ef7 req-1cb70ca4-74bf-45f4-bc41-b8e85ca50448 service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Updated VIF entry in instance network info cache for port e9a5856f-10cf-494b-a1f6-6a32235b5cd1. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:33:14 user nova-compute[73469]: DEBUG nova.network.neutron [req-db58e970-6537-4864-89cb-6f87bba54ef7 req-1cb70ca4-74bf-45f4-bc41-b8e85ca50448 service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Updating instance_info_cache with network_info: [{"id": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "address": "fa:16:3e:e5:f9:97", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9a5856f-10", "ovs_interfaceid": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:33:14 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:33:14 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:33:14 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8908MB free_disk=25.124279022216797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:33:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:33:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:33:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-db58e970-6537-4864-89cb-6f87bba54ef7 req-1cb70ca4-74bf-45f4-bc41-b8e85ca50448 service nova] Releasing lock "refresh_cache-a19cd1f6-ea9b-4cfb-80ba-0368191187d6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:33:14 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a19cd1f6-ea9b-4cfb-80ba-0368191187d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:33:14 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:33:14 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:33:15 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:33:15 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:33:15 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:33:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:33:16 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:33:17 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:33:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:33:22 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Creating image(s)
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Did not create local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Ensure instance console log exists: /opt/stack/data/nova/instances/a19cd1f6-ea9b-4cfb-80ba-0368191187d6/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Start _get_guest_xml network_info=[{"id": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "address": "fa:16:3e:e5:f9:97", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9a5856f-10", "ovs_interfaceid": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'be1d6f8b-42ac-47cf-a045-b3d060000450', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhCISELw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a19cd1f6-ea9b-4cfb-80ba-0368191187d6', 'attached_at': '', 'detached_at': '', 'volume_id': '92257668-86b5-4869-9fbb-02f3fb8f1d28', 'serial': '92257668-86b5-4869-9fbb-02f3fb8f1d28'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:33:22 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:33:22 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhCISELw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:33:22 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:33:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:33:22 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:33:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:33:22 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:33:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb36480-654b-4aec-9ae0-5de4009827e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:33:22 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b683942-77fe-4df8-9d28-1632825cdb13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28] added
Aug 22 03:33:22 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[199fc234-9162-4593-b30e-037b6a2699ab]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb62f9f5-a9bf-4625-aa82-b2e96dcb2f9a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QhCISELw {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QhCISELw" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc64037-0d07-4c54-b4dc-fab29278b847]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QhCISELw'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:33:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74bbdbc-f9cd-4fb0-bf53-a95c5f601d45]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd234b5-431f-49da-b62b-b4528d2cbd42]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:33:23 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:33:23 user nova-compute[73469]:  {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:33:23 user nova-compute[73469]: WARNING os_brick.initiator.connectors.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 22 03:33:23 user nova-compute[73469]: 
Aug 22 03:33:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d9cd1d-bf08-4f82-b9c4-764887676976]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28, portal: 172.16.0.220,3260]
Aug 22 03:33:23 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28, portal: 172.16.0.220,3260] successful.
Aug 22 03:33:23 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecef8655-d9d0-41b8-8dc6-b247fc4d001f]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[26191250-c981-4092-a3af-6ae6a8f10459]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)
Aug 22 03:33:23 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)
Aug 22 03:33:23 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0336ce07-e4e7-41a0-8fed-91565214a402]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:33:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhCISELw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23534346134336435', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534346134336435', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2007696115',display_name='tempest-TestVolumeBootPattern-server-2007696115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2007696115',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyXJlUIljrr/X6pCzTVMN6wtxEVyqHosXjh8Bb+rOY+cvXhCH956AGTGPXRAXpA5TdDrTYNYOqLaI+VzWwIfiH3E8kMOPz3Dv0BSa0v5eRTC5A60kbA4/zvvaIssE+pwQ==',key_name='tempest-TestVolumeBootPattern-1529823206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9878ef4b06740e9af1fc5aff14417ab',ramdisk_id='',reservation_id='r-j26dla0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1927887073',owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:33:12Z,user_data=None,user_id='8c2b396a267549f4b7911646251a4094',uuid=a19cd1f6-ea9b-4cfb-80ba-0368191187d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "address": "fa:16:3e:e5:f9:97", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9a5856f-10", "ovs_interfaceid": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converting VIF {"id": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "address": "fa:16:3e:e5:f9:97", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9a5856f-10", "ovs_interfaceid": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=e9a5856f-10cf-494b-a1f6-6a32235b5cd1,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9a5856f-10') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG nova.objects.instance [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lazy-loading 'pci_devices' on Instance uuid a19cd1f6-ea9b-4cfb-80ba-0368191187d6 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:33:24 user nova-compute[73469]:   <uuid>a19cd1f6-ea9b-4cfb-80ba-0368191187d6</uuid>
Aug 22 03:33:24 user nova-compute[73469]:   <name>instance-00000031</name>
Aug 22 03:33:24 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:33:24 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:33:24 user nova-compute[73469]:   <metadata>
Aug 22 03:33:24 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:33:24 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:33:24 user nova-compute[73469]:       <nova:name>tempest-TestVolumeBootPattern-server-2007696115</nova:name>
Aug 22 03:33:24 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:33:22</nova:creationTime>
Aug 22 03:33:24 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:33:24 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:33:24 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:33:24 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:33:24 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:33:24 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:33:24 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:33:24 user nova-compute[73469]:       <nova:owner>
Aug 22 03:33:24 user nova-compute[73469]:         <nova:user uuid="8c2b396a267549f4b7911646251a4094">tempest-TestVolumeBootPattern-1927887073-project-member</nova:user>
Aug 22 03:33:24 user nova-compute[73469]:         <nova:project uuid="f9878ef4b06740e9af1fc5aff14417ab">tempest-TestVolumeBootPattern-1927887073</nova:project>
Aug 22 03:33:24 user nova-compute[73469]:       </nova:owner>
Aug 22 03:33:24 user nova-compute[73469]:       <nova:ports>
Aug 22 03:33:24 user nova-compute[73469]:         <nova:port uuid="e9a5856f-10cf-494b-a1f6-6a32235b5cd1">
Aug 22 03:33:24 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 22 03:33:24 user nova-compute[73469]:         </nova:port>
Aug 22 03:33:24 user nova-compute[73469]:       </nova:ports>
Aug 22 03:33:24 user nova-compute[73469]:     </nova:instance>
Aug 22 03:33:24 user nova-compute[73469]:   </metadata>
Aug 22 03:33:24 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:33:24 user nova-compute[73469]:     <system>
Aug 22 03:33:24 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:33:24 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:33:24 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:33:24 user nova-compute[73469]:       <entry name="serial">a19cd1f6-ea9b-4cfb-80ba-0368191187d6</entry>
Aug 22 03:33:24 user nova-compute[73469]:       <entry name="uuid">a19cd1f6-ea9b-4cfb-80ba-0368191187d6</entry>
Aug 22 03:33:24 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:33:24 user nova-compute[73469]:     </system>
Aug 22 03:33:24 user nova-compute[73469]:   </sysinfo>
Aug 22 03:33:24 user nova-compute[73469]:   <os>
Aug 22 03:33:24 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:33:24 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:33:24 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:33:24 user nova-compute[73469]:   </os>
Aug 22 03:33:24 user nova-compute[73469]:   <features>
Aug 22 03:33:24 user nova-compute[73469]:     <acpi/>
Aug 22 03:33:24 user nova-compute[73469]:     <apic/>
Aug 22 03:33:24 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:33:24 user nova-compute[73469]:   </features>
Aug 22 03:33:24 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:33:24 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:33:24 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:33:24 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:33:24 user nova-compute[73469]:   </clock>
Aug 22 03:33:24 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:33:24 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:33:24 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:33:24 user nova-compute[73469]:   </cpu>
Aug 22 03:33:24 user nova-compute[73469]:   <devices>
Aug 22 03:33:24 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:33:24 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:33:24 user nova-compute[73469]:       <source dev="/dev/sdb"/>
Aug 22 03:33:24 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:33:24 user nova-compute[73469]:       <serial>92257668-86b5-4869-9fbb-02f3fb8f1d28</serial>
Aug 22 03:33:24 user nova-compute[73469]:     </disk>
Aug 22 03:33:24 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:33:24 user nova-compute[73469]:       <mac address="fa:16:3e:e5:f9:97"/>
Aug 22 03:33:24 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:33:24 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:33:24 user nova-compute[73469]:       <target dev="tape9a5856f-10"/>
Aug 22 03:33:24 user nova-compute[73469]:     </interface>
Aug 22 03:33:24 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:33:24 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/a19cd1f6-ea9b-4cfb-80ba-0368191187d6/console.log" append="off"/>
Aug 22 03:33:24 user nova-compute[73469]:     </serial>
Aug 22 03:33:24 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:33:24 user nova-compute[73469]:     <video>
Aug 22 03:33:24 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:33:24 user nova-compute[73469]:     </video>
Aug 22 03:33:24 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:33:24 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:33:24 user nova-compute[73469]:     </rng>
Aug 22 03:33:24 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:33:24 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:33:24 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:33:24 user nova-compute[73469]:     </memballoon>
Aug 22 03:33:24 user nova-compute[73469]:   </devices>
Aug 22 03:33:24 user nova-compute[73469]: </domain>
Aug 22 03:33:24 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2007696115',display_name='tempest-TestVolumeBootPattern-server-2007696115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2007696115',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyXJlUIljrr/X6pCzTVMN6wtxEVyqHosXjh8Bb+rOY+cvXhCH956AGTGPXRAXpA5TdDrTYNYOqLaI+VzWwIfiH3E8kMOPz3Dv0BSa0v5eRTC5A60kbA4/zvvaIssE+pwQ==',key_name='tempest-TestVolumeBootPattern-1529823206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9878ef4b06740e9af1fc5aff14417ab',ramdisk_id='',reservation_id='r-j26dla0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1927887073',owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:33:12Z,user_data=None,user_id='8c2b396a267549f4b7911646251a4094',uuid=a19cd1f6-ea9b-4cfb-80ba-0368191187d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "address": "fa:16:3e:e5:f9:97", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9a5856f-10", "ovs_interfaceid": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converting VIF {"id": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "address": "fa:16:3e:e5:f9:97", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9a5856f-10", "ovs_interfaceid": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=e9a5856f-10cf-494b-a1f6-6a32235b5cd1,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9a5856f-10') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG os_vif [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=e9a5856f-10cf-494b-a1f6-6a32235b5cd1,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9a5856f-10') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9a5856f-10, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9a5856f-10, col_values=(('external_ids', {'iface-id': 'e9a5856f-10cf-494b-a1f6-6a32235b5cd1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:f9:97', 'vm-uuid': 'a19cd1f6-ea9b-4cfb-80ba-0368191187d6'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:24 user nova-compute[73469]: INFO os_vif [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=e9a5856f-10cf-494b-a1f6-6a32235b5cd1,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9a5856f-10')
Aug 22 03:33:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:33:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] No VIF found with MAC fa:16:3e:e5:f9:97, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:33:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:25 user nova-compute[73469]: DEBUG nova.compute.manager [req-5ab5bbf8-e93e-4348-b72b-929cf9a62db1 req-a7c90a2f-8996-4f3b-ac0f-6748409b152e service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Received event network-vif-plugged-e9a5856f-10cf-494b-a1f6-6a32235b5cd1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:33:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5ab5bbf8-e93e-4348-b72b-929cf9a62db1 req-a7c90a2f-8996-4f3b-ac0f-6748409b152e service nova] Acquiring lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:33:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5ab5bbf8-e93e-4348-b72b-929cf9a62db1 req-a7c90a2f-8996-4f3b-ac0f-6748409b152e service nova] Lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:33:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5ab5bbf8-e93e-4348-b72b-929cf9a62db1 req-a7c90a2f-8996-4f3b-ac0f-6748409b152e service nova] Lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:33:25 user nova-compute[73469]: DEBUG nova.compute.manager [req-5ab5bbf8-e93e-4348-b72b-929cf9a62db1 req-a7c90a2f-8996-4f3b-ac0f-6748409b152e service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] No waiting events found dispatching network-vif-plugged-e9a5856f-10cf-494b-a1f6-6a32235b5cd1 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:33:25 user nova-compute[73469]: WARNING nova.compute.manager [req-5ab5bbf8-e93e-4348-b72b-929cf9a62db1 req-a7c90a2f-8996-4f3b-ac0f-6748409b152e service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Received unexpected event network-vif-plugged-e9a5856f-10cf-494b-a1f6-6a32235b5cd1 for instance with vm_state building and task_state spawning.
Aug 22 03:33:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:27 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692675207.4956686, a19cd1f6-ea9b-4cfb-80ba-0368191187d6 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:33:27 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] VM Resumed (Lifecycle Event)
Aug 22 03:33:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:33:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:33:27 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Instance spawned successfully.
Aug 22 03:33:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:33:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:33:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:33:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:33:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:33:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:33:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:33:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:33:27 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:33:27 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:33:27 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692675207.4966815, a19cd1f6-ea9b-4cfb-80ba-0368191187d6 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:33:27 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] VM Started (Lifecycle Event)
Aug 22 03:33:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:33:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:33:27 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:33:27 user nova-compute[73469]: INFO nova.compute.manager [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Took 4.78 seconds to spawn the instance on the hypervisor.
Aug 22 03:33:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:33:27 user nova-compute[73469]: INFO nova.compute.manager [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Took 15.62 seconds to build instance.
Aug 22 03:33:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-58de500e-a473-4ea6-88c6-a9ba11f4c58a tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.708s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:33:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-14d28303-c7db-43b8-82fb-667c669db03e req-4f273067-3bec-4481-a1de-6dc0c9c4fb08 service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Received event network-vif-plugged-e9a5856f-10cf-494b-a1f6-6a32235b5cd1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:33:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-14d28303-c7db-43b8-82fb-667c669db03e req-4f273067-3bec-4481-a1de-6dc0c9c4fb08 service nova] Acquiring lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:33:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-14d28303-c7db-43b8-82fb-667c669db03e req-4f273067-3bec-4481-a1de-6dc0c9c4fb08 service nova] Lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:33:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-14d28303-c7db-43b8-82fb-667c669db03e req-4f273067-3bec-4481-a1de-6dc0c9c4fb08 service nova] Lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:33:27 user nova-compute[73469]: DEBUG nova.compute.manager [req-14d28303-c7db-43b8-82fb-667c669db03e req-4f273067-3bec-4481-a1de-6dc0c9c4fb08 service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] No waiting events found dispatching network-vif-plugged-e9a5856f-10cf-494b-a1f6-6a32235b5cd1 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:33:27 user nova-compute[73469]: WARNING nova.compute.manager [req-14d28303-c7db-43b8-82fb-667c669db03e req-4f273067-3bec-4481-a1de-6dc0c9c4fb08 service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Received unexpected event network-vif-plugged-e9a5856f-10cf-494b-a1f6-6a32235b5cd1 for instance with vm_state active and task_state None.
Aug 22 03:33:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:33:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:33:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:33:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:33:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:33:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:33:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:34:02 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:34:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:34:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:34:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:34:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:34:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:34:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:34:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:34:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:34:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:34:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:34:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:34:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:34:10 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:34:10 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:34:10 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:34:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-a19cd1f6-ea9b-4cfb-80ba-0368191187d6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:34:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-a19cd1f6-ea9b-4cfb-80ba-0368191187d6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:34:10 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:34:10 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid a19cd1f6-ea9b-4cfb-80ba-0368191187d6 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:34:11 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Updating instance_info_cache with network_info: [{"id": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "address": "fa:16:3e:e5:f9:97", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9a5856f-10", "ovs_interfaceid": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:34:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-a19cd1f6-ea9b-4cfb-80ba-0368191187d6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:34:11 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:34:11 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:34:12 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:34:13 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:34:13 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:34:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:34:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:34:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:34:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:34:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:34:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:34:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:34:14 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:34:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:34:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:34:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:34:14 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:34:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:34:14 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:34:14 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:34:14 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=25.122882843017578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:34:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:34:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:34:15 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance a19cd1f6-ea9b-4cfb-80ba-0368191187d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:34:15 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:34:15 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:34:15 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:34:15 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:34:15 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:34:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:34:16 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:34:16 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:34:16 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:34:16 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 22 03:34:18 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:34:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:34:21 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:34:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 22 03:34:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] There are 0 instances to clean {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 22 03:34:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:34:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:34:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:34:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:34:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:34:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:34:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:34:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:34:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:34:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:34:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:34:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:34:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:34:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:34:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:34:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:34:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:34:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:34:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:34:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:34:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:34:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:34:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:34:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:34:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:34:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:34:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:34:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:34:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:34:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:34:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:34:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:34:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:04 user nova-compute[73469]: DEBUG nova.compute.manager [req-b84b0974-0297-4c50-8ce8-df954cd73b54 req-7f7791cb-f78d-4414-b6a7-f4438aecf89f service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Received event network-changed-e9a5856f-10cf-494b-a1f6-6a32235b5cd1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:35:04 user nova-compute[73469]: DEBUG nova.compute.manager [req-b84b0974-0297-4c50-8ce8-df954cd73b54 req-7f7791cb-f78d-4414-b6a7-f4438aecf89f service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Refreshing instance network info cache due to event network-changed-e9a5856f-10cf-494b-a1f6-6a32235b5cd1. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:35:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b84b0974-0297-4c50-8ce8-df954cd73b54 req-7f7791cb-f78d-4414-b6a7-f4438aecf89f service nova] Acquiring lock "refresh_cache-a19cd1f6-ea9b-4cfb-80ba-0368191187d6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:35:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b84b0974-0297-4c50-8ce8-df954cd73b54 req-7f7791cb-f78d-4414-b6a7-f4438aecf89f service nova] Acquired lock "refresh_cache-a19cd1f6-ea9b-4cfb-80ba-0368191187d6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:35:04 user nova-compute[73469]: DEBUG nova.network.neutron [req-b84b0974-0297-4c50-8ce8-df954cd73b54 req-7f7791cb-f78d-4414-b6a7-f4438aecf89f service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Refreshing network info cache for port e9a5856f-10cf-494b-a1f6-6a32235b5cd1 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:35:05 user nova-compute[73469]: DEBUG nova.network.neutron [req-b84b0974-0297-4c50-8ce8-df954cd73b54 req-7f7791cb-f78d-4414-b6a7-f4438aecf89f service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Updated VIF entry in instance network info cache for port e9a5856f-10cf-494b-a1f6-6a32235b5cd1. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:35:05 user nova-compute[73469]: DEBUG nova.network.neutron [req-b84b0974-0297-4c50-8ce8-df954cd73b54 req-7f7791cb-f78d-4414-b6a7-f4438aecf89f service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Updating instance_info_cache with network_info: [{"id": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "address": "fa:16:3e:e5:f9:97", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9a5856f-10", "ovs_interfaceid": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:35:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b84b0974-0297-4c50-8ce8-df954cd73b54 req-7f7791cb-f78d-4414-b6a7-f4438aecf89f service nova] Releasing lock "refresh_cache-a19cd1f6-ea9b-4cfb-80ba-0368191187d6" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:35:06 user nova-compute[73469]: INFO nova.compute.manager [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Terminating instance
Aug 22 03:35:06 user nova-compute[73469]: DEBUG nova.compute.manager [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG nova.compute.manager [req-5a0b004c-7158-49bb-a131-8b241327cea6 req-904c3753-439f-4f20-844f-394a6e707101 service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Received event network-vif-unplugged-e9a5856f-10cf-494b-a1f6-6a32235b5cd1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5a0b004c-7158-49bb-a131-8b241327cea6 req-904c3753-439f-4f20-844f-394a6e707101 service nova] Acquiring lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5a0b004c-7158-49bb-a131-8b241327cea6 req-904c3753-439f-4f20-844f-394a6e707101 service nova] Lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5a0b004c-7158-49bb-a131-8b241327cea6 req-904c3753-439f-4f20-844f-394a6e707101 service nova] Lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG nova.compute.manager [req-5a0b004c-7158-49bb-a131-8b241327cea6 req-904c3753-439f-4f20-844f-394a6e707101 service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] No waiting events found dispatching network-vif-unplugged-e9a5856f-10cf-494b-a1f6-6a32235b5cd1 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG nova.compute.manager [req-5a0b004c-7158-49bb-a131-8b241327cea6 req-904c3753-439f-4f20-844f-394a6e707101 service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Received event network-vif-unplugged-e9a5856f-10cf-494b-a1f6-6a32235b5cd1 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG nova.compute.manager [req-5a0b004c-7158-49bb-a131-8b241327cea6 req-904c3753-439f-4f20-844f-394a6e707101 service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Received event network-vif-plugged-e9a5856f-10cf-494b-a1f6-6a32235b5cd1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5a0b004c-7158-49bb-a131-8b241327cea6 req-904c3753-439f-4f20-844f-394a6e707101 service nova] Acquiring lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5a0b004c-7158-49bb-a131-8b241327cea6 req-904c3753-439f-4f20-844f-394a6e707101 service nova] Lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5a0b004c-7158-49bb-a131-8b241327cea6 req-904c3753-439f-4f20-844f-394a6e707101 service nova] Lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG nova.compute.manager [req-5a0b004c-7158-49bb-a131-8b241327cea6 req-904c3753-439f-4f20-844f-394a6e707101 service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] No waiting events found dispatching network-vif-plugged-e9a5856f-10cf-494b-a1f6-6a32235b5cd1 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:35:06 user nova-compute[73469]: WARNING nova.compute.manager [req-5a0b004c-7158-49bb-a131-8b241327cea6 req-904c3753-439f-4f20-844f-394a6e707101 service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Received unexpected event network-vif-plugged-e9a5856f-10cf-494b-a1f6-6a32235b5cd1 for instance with vm_state active and task_state deleting.
Aug 22 03:35:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:06 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Instance destroyed successfully.
Aug 22 03:35:06 user nova-compute[73469]: DEBUG nova.objects.instance [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lazy-loading 'resources' on Instance uuid a19cd1f6-ea9b-4cfb-80ba-0368191187d6 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2007696115',display_name='tempest-TestVolumeBootPattern-server-2007696115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2007696115',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyXJlUIljrr/X6pCzTVMN6wtxEVyqHosXjh8Bb+rOY+cvXhCH956AGTGPXRAXpA5TdDrTYNYOqLaI+VzWwIfiH3E8kMOPz3Dv0BSa0v5eRTC5A60kbA4/zvvaIssE+pwQ==',key_name='tempest-TestVolumeBootPattern-1529823206',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:33:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9878ef4b06740e9af1fc5aff14417ab',ramdisk_id='',reservation_id='r-j26dla0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1927887073',owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:33:28Z,user_data=None,user_id='8c2b396a267549f4b7911646251a4094',uuid=a19cd1f6-ea9b-4cfb-80ba-0368191187d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "address": "fa:16:3e:e5:f9:97", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9a5856f-10", "ovs_interfaceid": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converting VIF {"id": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "address": "fa:16:3e:e5:f9:97", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9a5856f-10", "ovs_interfaceid": "e9a5856f-10cf-494b-a1f6-6a32235b5cd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=e9a5856f-10cf-494b-a1f6-6a32235b5cd1,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9a5856f-10') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG os_vif [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=e9a5856f-10cf-494b-a1f6-6a32235b5cd1,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9a5856f-10') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9a5856f-10, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:35:06 user nova-compute[73469]: INFO os_vif [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=e9a5856f-10cf-494b-a1f6-6a32235b5cd1,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9a5856f-10')
Aug 22 03:35:06 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhCISELw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:35:06 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:35:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[66708a72-cdfe-43be-a098-13ad5ef82e0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[879d0559-36d3-4f0a-90ea-2ca80373c807]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)
Aug 22 03:35:06 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)
Aug 22 03:35:06 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f798052b880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[818732dd-d1be-4213-8626-fc585fba0b08]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ab5bde-3513-4c9c-aabe-278573e1e209]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dffa60-4607-4560-b09b-751f160017ec]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[020a4bf1-f5fc-4eea-be1f-720fa0d194c3]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e0b0c12f', '/dev/disk/by-id/scsi-1SCST_BIOe0b0c12f-544a43d5a16bebfa', '/dev/disk/by-id/scsi-23534346134336435') {{(pid=84378) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9de9a1-b04e-438c-a35f-12f418a15ca8]: (4, None) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:35:06 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:35:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:35:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cef384a-2d5b-420e-9e96-f95fb1d28b68]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:35:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:35:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:35:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:35:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[775a8b23-e647-4499-bdca-e9bb87a01179]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:35:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28, portal: 172.16.0.220,3260]
Aug 22 03:35:07 user nova-compute[73469]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28, portal: 172.16.0.220,3260] successful.
Aug 22 03:35:07 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:35:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:35:07 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:35:07 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee00aca0-05d9-4e1d-b766-88d0b644125e]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:35:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:35:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:35:07 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] <== disconnect_volume: return (265ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:35:07 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:35:07 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Deleting instance files /opt/stack/data/nova/instances/a19cd1f6-ea9b-4cfb-80ba-0368191187d6_del
Aug 22 03:35:07 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Deletion of /opt/stack/data/nova/instances/a19cd1f6-ea9b-4cfb-80ba-0368191187d6_del complete
Aug 22 03:35:07 user nova-compute[73469]: INFO nova.compute.manager [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 22 03:35:07 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:35:07 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:35:07 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:35:07 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:35:07 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Took 0.77 seconds to deallocate network for instance.
Aug 22 03:35:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-6109ab23-c3ba-4db6-bf08-a7ad8dda0e08 req-fe73d581-ef88-4c82-98b2-7c3ccbd514f8 service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Received event network-vif-deleted-e9a5856f-10cf-494b-a1f6-6a32235b5cd1 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:35:07 user nova-compute[73469]: INFO nova.compute.manager [req-6109ab23-c3ba-4db6-bf08-a7ad8dda0e08 req-fe73d581-ef88-4c82-98b2-7c3ccbd514f8 service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Neutron deleted interface e9a5856f-10cf-494b-a1f6-6a32235b5cd1; detaching it from the instance and deleting it from the info cache
Aug 22 03:35:07 user nova-compute[73469]: DEBUG nova.network.neutron [req-6109ab23-c3ba-4db6-bf08-a7ad8dda0e08 req-fe73d581-ef88-4c82-98b2-7c3ccbd514f8 service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:35:07 user nova-compute[73469]: DEBUG nova.compute.manager [req-6109ab23-c3ba-4db6-bf08-a7ad8dda0e08 req-fe73d581-ef88-4c82-98b2-7c3ccbd514f8 service nova] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Detach interface failed, port_id=e9a5856f-10cf-494b-a1f6-6a32235b5cd1, reason: Instance a19cd1f6-ea9b-4cfb-80ba-0368191187d6 could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 03:35:08 user nova-compute[73469]: INFO nova.compute.manager [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Took 0.75 seconds to detach 1 volumes for instance.
Aug 22 03:35:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:35:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:35:08 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:35:08 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:35:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:35:08 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Deleted allocations for instance a19cd1f6-ea9b-4cfb-80ba-0368191187d6
Aug 22 03:35:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f98eaa3e-81b7-442e-984b-6af05b7f5b90 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "a19cd1f6-ea9b-4cfb-80ba-0368191187d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.905s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:35:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:10 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:35:11 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:35:11 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:35:11 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:35:11 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Didn't find any instances for network info cache update. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 22 03:35:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:13 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:35:13 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:35:14 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:35:15 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:35:15 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:35:16 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:35:16 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:35:16 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:35:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:35:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:35:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:35:16 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:35:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:16 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:35:16 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:35:16 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8905MB free_disk=25.122051239013672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:35:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:35:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:35:17 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:35:17 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:35:17 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing inventories for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 22 03:35:17 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Updating ProviderTree inventory for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 22 03:35:17 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Updating inventory in ProviderTree for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 22 03:35:17 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing aggregate associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, aggregates: None {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 22 03:35:17 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing trait associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 22 03:35:17 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:35:17 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:35:17 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:35:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:35:21 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:35:21 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692675306.775836, a19cd1f6-ea9b-4cfb-80ba-0368191187d6 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:35:21 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] VM Stopped (Lifecycle Event)
Aug 22 03:35:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-c1070c77-129e-4020-abff-4f4d8728ce04 None None] [instance: a19cd1f6-ea9b-4cfb-80ba-0368191187d6] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:35:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:35:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:35:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:35:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:35:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:35:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:35:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:35:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:35:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:35:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:35:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:35:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:35:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:35:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:35:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:35:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:35:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:35:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:35:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:35:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:35:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:35:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:35:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:35:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:35:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:35:57 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:35:57 user nova-compute[73469]: INFO nova.compute.claims [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Claim successful on node user
Aug 22 03:35:58 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:35:58 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:35:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:35:58 user nova-compute[73469]: INFO nova.virt.block_device [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Booting with volume 92257668-86b5-4869-9fbb-02f3fb8f1d28 at /dev/vda
Aug 22 03:35:58 user nova-compute[73469]: DEBUG nova.policy [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c2b396a267549f4b7911646251a4094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9878ef4b06740e9af1fc5aff14417ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG os_brick.utils [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5cd2e2-f285-4918-9adf-388c74579c46]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf778df-3ce8-4bbe-b5ea-80564fb8baf0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa8b97a-e0c6-40fb-81dd-6084343ac3c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f34534b-266e-4d64-b91c-01d588a8248d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:35:58 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:35:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[71878b77-ef38-4191-93c4-92cc70799578]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG os_brick.utils [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Updating existing volume attachment record: 5f9593e7-8983-4763-a4c3-881bc7b6f724 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:35:58 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Successfully created port: a608dce2-1e56-44d3-bf7b-64071a603010 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:35:59 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Successfully updated port: a608dce2-1e56-44d3-bf7b-64071a603010 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:35:59 user nova-compute[73469]: DEBUG nova.compute.manager [req-76089267-6911-429d-941e-9210f5ce6e51 req-f619baf4-44f0-4b9c-a9f7-0506ff08c70b service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Received event network-changed-a608dce2-1e56-44d3-bf7b-64071a603010 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:35:59 user nova-compute[73469]: DEBUG nova.compute.manager [req-76089267-6911-429d-941e-9210f5ce6e51 req-f619baf4-44f0-4b9c-a9f7-0506ff08c70b service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Refreshing instance network info cache due to event network-changed-a608dce2-1e56-44d3-bf7b-64071a603010. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:35:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-76089267-6911-429d-941e-9210f5ce6e51 req-f619baf4-44f0-4b9c-a9f7-0506ff08c70b service nova] Acquiring lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:35:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-76089267-6911-429d-941e-9210f5ce6e51 req-f619baf4-44f0-4b9c-a9f7-0506ff08c70b service nova] Acquired lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:35:59 user nova-compute[73469]: DEBUG nova.network.neutron [req-76089267-6911-429d-941e-9210f5ce6e51 req-f619baf4-44f0-4b9c-a9f7-0506ff08c70b service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Refreshing network info cache for port a608dce2-1e56-44d3-bf7b-64071a603010 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:36:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:36:00 user nova-compute[73469]: DEBUG nova.network.neutron [req-76089267-6911-429d-941e-9210f5ce6e51 req-f619baf4-44f0-4b9c-a9f7-0506ff08c70b service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:36:00 user nova-compute[73469]: DEBUG nova.network.neutron [req-76089267-6911-429d-941e-9210f5ce6e51 req-f619baf4-44f0-4b9c-a9f7-0506ff08c70b service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:36:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-76089267-6911-429d-941e-9210f5ce6e51 req-f619baf4-44f0-4b9c-a9f7-0506ff08c70b service nova] Releasing lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:36:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquired lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:36:00 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:36:00 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:36:00 user nova-compute[73469]: DEBUG nova.network.neutron [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Updating instance_info_cache with network_info: [{"id": "a608dce2-1e56-44d3-bf7b-64071a603010", "address": "fa:16:3e:63:9e:fa", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa608dce2-1e", "ovs_interfaceid": "a608dce2-1e56-44d3-bf7b-64071a603010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:36:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Releasing lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:36:00 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Instance network_info: |[{"id": "a608dce2-1e56-44d3-bf7b-64071a603010", "address": "fa:16:3e:63:9e:fa", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa608dce2-1e", "ovs_interfaceid": "a608dce2-1e56-44d3-bf7b-64071a603010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:36:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:36:08 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Creating image(s)
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Did not create local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Ensure instance console log exists: /opt/stack/data/nova/instances/f7f8aeca-fe0b-4aa5-a614-294ffb285689/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Start _get_guest_xml network_info=[{"id": "a608dce2-1e56-44d3-bf7b-64071a603010", "address": "fa:16:3e:63:9e:fa", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa608dce2-1e", "ovs_interfaceid": "a608dce2-1e56-44d3-bf7b-64071a603010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '5f9593e7-8983-4763-a4c3-881bc7b6f724', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhCISELw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7f8aeca-fe0b-4aa5-a614-294ffb285689', 'attached_at': '', 'detached_at': '', 'volume_id': '92257668-86b5-4869-9fbb-02f3fb8f1d28', 'serial': '92257668-86b5-4869-9fbb-02f3fb8f1d28'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:36:08 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:36:08 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhCISELw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:36:08 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:36:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:36:08 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:36:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:36:08 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[13581f8a-a135-4abf-9af2-6f1e58ca7f3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:36:08 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4c433b-168d-4eaf-a1af-3eb104f4faad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28] added
Aug 22 03:36:08 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d21df1-847e-4e99-a1a9-54d2228d111c]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc0975d-cf07-4b62-be31-25684a75e77b]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QhCISELw {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QhCISELw" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0aadbbf-ba9e-4f57-852e-6c1a6d560682]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QhCISELw'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4238cef6-5cfd-42a2-9a5c-17b9afd62b8b]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc87bd3-acdb-403c-8ea0-381088bbf27b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:36:08 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:36:08 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:36:08 user nova-compute[73469]:  {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:36:08 user nova-compute[73469]: WARNING os_brick.initiator.connectors.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 22 03:36:08 user nova-compute[73469]: 
Aug 22 03:36:08 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c924d845-e838-49c6-9eb2-cc5798078eaf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28, portal: 172.16.0.220,3260]
Aug 22 03:36:09 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28, portal: 172.16.0.220,3260] successful.
Aug 22 03:36:09 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b14ca9-c57c-4c9b-9d15-6218d2669ada]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[29160f18-4e2d-462c-b01d-3a496f05f098]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)
Aug 22 03:36:09 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)
Aug 22 03:36:09 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7be2f9-a432-4b39-9610-9e4531515677]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:36:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhCISELw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23534346134336435', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534346134336435', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:35:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-291471319',display_name='tempest-TestVolumeBootPattern-server-291471319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-291471319',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyXJlUIljrr/X6pCzTVMN6wtxEVyqHosXjh8Bb+rOY+cvXhCH956AGTGPXRAXpA5TdDrTYNYOqLaI+VzWwIfiH3E8kMOPz3Dv0BSa0v5eRTC5A60kbA4/zvvaIssE+pwQ==',key_name='tempest-TestVolumeBootPattern-1529823206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9878ef4b06740e9af1fc5aff14417ab',ramdisk_id='',reservation_id='r-vpu6gfkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1927887073',owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:35:58Z,user_data=None,user_id='8c2b396a267549f4b7911646251a4094',uuid=f7f8aeca-fe0b-4aa5-a614-294ffb285689,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a608dce2-1e56-44d3-bf7b-64071a603010", "address": "fa:16:3e:63:9e:fa", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa608dce2-1e", "ovs_interfaceid": "a608dce2-1e56-44d3-bf7b-64071a603010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converting VIF {"id": "a608dce2-1e56-44d3-bf7b-64071a603010", "address": "fa:16:3e:63:9e:fa", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa608dce2-1e", "ovs_interfaceid": "a608dce2-1e56-44d3-bf7b-64071a603010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:9e:fa,bridge_name='br-int',has_traffic_filtering=True,id=a608dce2-1e56-44d3-bf7b-64071a603010,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa608dce2-1e') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lazy-loading 'pci_devices' on Instance uuid f7f8aeca-fe0b-4aa5-a614-294ffb285689 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:36:10 user nova-compute[73469]:   <uuid>f7f8aeca-fe0b-4aa5-a614-294ffb285689</uuid>
Aug 22 03:36:10 user nova-compute[73469]:   <name>instance-00000032</name>
Aug 22 03:36:10 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:36:10 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:36:10 user nova-compute[73469]:   <metadata>
Aug 22 03:36:10 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:36:10 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:36:10 user nova-compute[73469]:       <nova:name>tempest-TestVolumeBootPattern-server-291471319</nova:name>
Aug 22 03:36:10 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:36:08</nova:creationTime>
Aug 22 03:36:10 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:36:10 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:36:10 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:36:10 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:36:10 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:36:10 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:36:10 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:36:10 user nova-compute[73469]:       <nova:owner>
Aug 22 03:36:10 user nova-compute[73469]:         <nova:user uuid="8c2b396a267549f4b7911646251a4094">tempest-TestVolumeBootPattern-1927887073-project-member</nova:user>
Aug 22 03:36:10 user nova-compute[73469]:         <nova:project uuid="f9878ef4b06740e9af1fc5aff14417ab">tempest-TestVolumeBootPattern-1927887073</nova:project>
Aug 22 03:36:10 user nova-compute[73469]:       </nova:owner>
Aug 22 03:36:10 user nova-compute[73469]:       <nova:ports>
Aug 22 03:36:10 user nova-compute[73469]:         <nova:port uuid="a608dce2-1e56-44d3-bf7b-64071a603010">
Aug 22 03:36:10 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 22 03:36:10 user nova-compute[73469]:         </nova:port>
Aug 22 03:36:10 user nova-compute[73469]:       </nova:ports>
Aug 22 03:36:10 user nova-compute[73469]:     </nova:instance>
Aug 22 03:36:10 user nova-compute[73469]:   </metadata>
Aug 22 03:36:10 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:36:10 user nova-compute[73469]:     <system>
Aug 22 03:36:10 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:36:10 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:36:10 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:36:10 user nova-compute[73469]:       <entry name="serial">f7f8aeca-fe0b-4aa5-a614-294ffb285689</entry>
Aug 22 03:36:10 user nova-compute[73469]:       <entry name="uuid">f7f8aeca-fe0b-4aa5-a614-294ffb285689</entry>
Aug 22 03:36:10 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:36:10 user nova-compute[73469]:     </system>
Aug 22 03:36:10 user nova-compute[73469]:   </sysinfo>
Aug 22 03:36:10 user nova-compute[73469]:   <os>
Aug 22 03:36:10 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:36:10 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:36:10 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:36:10 user nova-compute[73469]:   </os>
Aug 22 03:36:10 user nova-compute[73469]:   <features>
Aug 22 03:36:10 user nova-compute[73469]:     <acpi/>
Aug 22 03:36:10 user nova-compute[73469]:     <apic/>
Aug 22 03:36:10 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:36:10 user nova-compute[73469]:   </features>
Aug 22 03:36:10 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:36:10 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:36:10 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:36:10 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:36:10 user nova-compute[73469]:   </clock>
Aug 22 03:36:10 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:36:10 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:36:10 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:36:10 user nova-compute[73469]:   </cpu>
Aug 22 03:36:10 user nova-compute[73469]:   <devices>
Aug 22 03:36:10 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:36:10 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:36:10 user nova-compute[73469]:       <source dev="/dev/sdb"/>
Aug 22 03:36:10 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:36:10 user nova-compute[73469]:       <serial>92257668-86b5-4869-9fbb-02f3fb8f1d28</serial>
Aug 22 03:36:10 user nova-compute[73469]:     </disk>
Aug 22 03:36:10 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:36:10 user nova-compute[73469]:       <mac address="fa:16:3e:63:9e:fa"/>
Aug 22 03:36:10 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:36:10 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:36:10 user nova-compute[73469]:       <target dev="tapa608dce2-1e"/>
Aug 22 03:36:10 user nova-compute[73469]:     </interface>
Aug 22 03:36:10 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:36:10 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/f7f8aeca-fe0b-4aa5-a614-294ffb285689/console.log" append="off"/>
Aug 22 03:36:10 user nova-compute[73469]:     </serial>
Aug 22 03:36:10 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:36:10 user nova-compute[73469]:     <video>
Aug 22 03:36:10 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:36:10 user nova-compute[73469]:     </video>
Aug 22 03:36:10 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:36:10 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:36:10 user nova-compute[73469]:     </rng>
Aug 22 03:36:10 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:36:10 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:36:10 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:36:10 user nova-compute[73469]:     </memballoon>
Aug 22 03:36:10 user nova-compute[73469]:   </devices>
Aug 22 03:36:10 user nova-compute[73469]: </domain>
Aug 22 03:36:10 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:35:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-291471319',display_name='tempest-TestVolumeBootPattern-server-291471319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-291471319',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyXJlUIljrr/X6pCzTVMN6wtxEVyqHosXjh8Bb+rOY+cvXhCH956AGTGPXRAXpA5TdDrTYNYOqLaI+VzWwIfiH3E8kMOPz3Dv0BSa0v5eRTC5A60kbA4/zvvaIssE+pwQ==',key_name='tempest-TestVolumeBootPattern-1529823206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9878ef4b06740e9af1fc5aff14417ab',ramdisk_id='',reservation_id='r-vpu6gfkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1927887073',owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:35:58Z,user_data=None,user_id='8c2b396a267549f4b7911646251a4094',uuid=f7f8aeca-fe0b-4aa5-a614-294ffb285689,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a608dce2-1e56-44d3-bf7b-64071a603010", "address": "fa:16:3e:63:9e:fa", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa608dce2-1e", "ovs_interfaceid": "a608dce2-1e56-44d3-bf7b-64071a603010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converting VIF {"id": "a608dce2-1e56-44d3-bf7b-64071a603010", "address": "fa:16:3e:63:9e:fa", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa608dce2-1e", "ovs_interfaceid": "a608dce2-1e56-44d3-bf7b-64071a603010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:9e:fa,bridge_name='br-int',has_traffic_filtering=True,id=a608dce2-1e56-44d3-bf7b-64071a603010,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa608dce2-1e') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG os_vif [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:9e:fa,bridge_name='br-int',has_traffic_filtering=True,id=a608dce2-1e56-44d3-bf7b-64071a603010,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa608dce2-1e') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa608dce2-1e, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa608dce2-1e, col_values=(('external_ids', {'iface-id': 'a608dce2-1e56-44d3-bf7b-64071a603010', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:9e:fa', 'vm-uuid': 'f7f8aeca-fe0b-4aa5-a614-294ffb285689'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:10 user nova-compute[73469]: INFO os_vif [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:9e:fa,bridge_name='br-int',has_traffic_filtering=True,id=a608dce2-1e56-44d3-bf7b-64071a603010,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa608dce2-1e')
Aug 22 03:36:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:36:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] No VIF found with MAC fa:16:3e:63:9e:fa, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:36:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:11 user nova-compute[73469]: DEBUG nova.compute.manager [req-5952d141-077f-4ef5-990f-56551d99361d req-3baba639-5fd7-4493-b747-4167038fa0b0 service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Received event network-vif-plugged-a608dce2-1e56-44d3-bf7b-64071a603010 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:36:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5952d141-077f-4ef5-990f-56551d99361d req-3baba639-5fd7-4493-b747-4167038fa0b0 service nova] Acquiring lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:36:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5952d141-077f-4ef5-990f-56551d99361d req-3baba639-5fd7-4493-b747-4167038fa0b0 service nova] Lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:36:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5952d141-077f-4ef5-990f-56551d99361d req-3baba639-5fd7-4493-b747-4167038fa0b0 service nova] Lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:36:11 user nova-compute[73469]: DEBUG nova.compute.manager [req-5952d141-077f-4ef5-990f-56551d99361d req-3baba639-5fd7-4493-b747-4167038fa0b0 service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] No waiting events found dispatching network-vif-plugged-a608dce2-1e56-44d3-bf7b-64071a603010 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:36:11 user nova-compute[73469]: WARNING nova.compute.manager [req-5952d141-077f-4ef5-990f-56551d99361d req-3baba639-5fd7-4493-b747-4167038fa0b0 service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Received unexpected event network-vif-plugged-a608dce2-1e56-44d3-bf7b-64071a603010 for instance with vm_state building and task_state spawning.
Aug 22 03:36:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:12 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Skipping network cache update for instance because it is Building. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Didn't find any instances for network info cache update. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692675373.5789654, f7f8aeca-fe0b-4aa5-a614-294ffb285689 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:36:13 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] VM Resumed (Lifecycle Event)
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:36:13 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Instance spawned successfully.
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:36:13 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692675373.581648, f7f8aeca-fe0b-4aa5-a614-294ffb285689 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:36:13 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] VM Started (Lifecycle Event)
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-2ae91e1e-230f-46f7-abb4-a020fc5aeab9 req-7ad2e158-2c9c-4931-8edf-a5a7b77dcc5d service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Received event network-vif-plugged-a608dce2-1e56-44d3-bf7b-64071a603010 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2ae91e1e-230f-46f7-abb4-a020fc5aeab9 req-7ad2e158-2c9c-4931-8edf-a5a7b77dcc5d service nova] Acquiring lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2ae91e1e-230f-46f7-abb4-a020fc5aeab9 req-7ad2e158-2c9c-4931-8edf-a5a7b77dcc5d service nova] Lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2ae91e1e-230f-46f7-abb4-a020fc5aeab9 req-7ad2e158-2c9c-4931-8edf-a5a7b77dcc5d service nova] Lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.compute.manager [req-2ae91e1e-230f-46f7-abb4-a020fc5aeab9 req-7ad2e158-2c9c-4931-8edf-a5a7b77dcc5d service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] No waiting events found dispatching network-vif-plugged-a608dce2-1e56-44d3-bf7b-64071a603010 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:36:13 user nova-compute[73469]: WARNING nova.compute.manager [req-2ae91e1e-230f-46f7-abb4-a020fc5aeab9 req-7ad2e158-2c9c-4931-8edf-a5a7b77dcc5d service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Received unexpected event network-vif-plugged-a608dce2-1e56-44d3-bf7b-64071a603010 for instance with vm_state building and task_state spawning.
Aug 22 03:36:13 user nova-compute[73469]: INFO nova.compute.manager [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Took 4.97 seconds to spawn the instance on the hypervisor.
Aug 22 03:36:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:36:13 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:36:13 user nova-compute[73469]: INFO nova.compute.manager [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Took 15.92 seconds to build instance.
Aug 22 03:36:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ada262b8-8324-4085-9d84-3633f8df4db1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.009s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:36:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:14 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:36:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:15 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:36:16 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:36:16 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:36:17 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:36:17 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:36:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:36:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:36:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:36:17 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:36:17 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:36:17 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:36:17 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:36:17 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8837MB free_disk=25.120460510253906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:36:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:36:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:36:18 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f7f8aeca-fe0b-4aa5-a614-294ffb285689 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:36:18 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:36:18 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:36:18 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:36:18 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:36:18 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:36:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:36:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:19 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:36:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:20 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:36:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:36:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:36:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:37:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:37:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:37:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:37:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:37:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:37:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:37:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:37:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:37:12 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:37:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:37:15 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:37:15 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:37:15 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:37:15 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:37:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:37:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:37:15 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:37:15 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid f7f8aeca-fe0b-4aa5-a614-294ffb285689 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:37:16 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Updating instance_info_cache with network_info: [{"id": "a608dce2-1e56-44d3-bf7b-64071a603010", "address": "fa:16:3e:63:9e:fa", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa608dce2-1e", "ovs_interfaceid": "a608dce2-1e56-44d3-bf7b-64071a603010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:37:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:37:16 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:37:16 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:37:16 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:37:17 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:37:17 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:37:17 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:37:18 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:37:19 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:37:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:37:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:37:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:37:19 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:37:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:37:19 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:37:19 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:37:19 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8789MB free_disk=25.119781494140625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:37:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:37:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:37:20 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f7f8aeca-fe0b-4aa5-a614-294ffb285689 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:37:20 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:37:20 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:37:20 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:37:20 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:37:20 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:37:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:37:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:37:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:37:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:37:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:37:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:37:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:37:21 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:37:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:37:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:37:35 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:37:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:37:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:37:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:37:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-6bb0d45e-3bde-4b20-a999-5cc6eebd0583 req-47b7adb8-f33d-42b9-98ed-a3d760131962 service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Received event network-changed-a608dce2-1e56-44d3-bf7b-64071a603010 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:37:49 user nova-compute[73469]: DEBUG nova.compute.manager [req-6bb0d45e-3bde-4b20-a999-5cc6eebd0583 req-47b7adb8-f33d-42b9-98ed-a3d760131962 service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Refreshing instance network info cache due to event network-changed-a608dce2-1e56-44d3-bf7b-64071a603010. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:37:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6bb0d45e-3bde-4b20-a999-5cc6eebd0583 req-47b7adb8-f33d-42b9-98ed-a3d760131962 service nova] Acquiring lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:37:49 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6bb0d45e-3bde-4b20-a999-5cc6eebd0583 req-47b7adb8-f33d-42b9-98ed-a3d760131962 service nova] Acquired lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:37:49 user nova-compute[73469]: DEBUG nova.network.neutron [req-6bb0d45e-3bde-4b20-a999-5cc6eebd0583 req-47b7adb8-f33d-42b9-98ed-a3d760131962 service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Refreshing network info cache for port a608dce2-1e56-44d3-bf7b-64071a603010 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:37:50 user nova-compute[73469]: DEBUG nova.network.neutron [req-6bb0d45e-3bde-4b20-a999-5cc6eebd0583 req-47b7adb8-f33d-42b9-98ed-a3d760131962 service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Updated VIF entry in instance network info cache for port a608dce2-1e56-44d3-bf7b-64071a603010. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:37:50 user nova-compute[73469]: DEBUG nova.network.neutron [req-6bb0d45e-3bde-4b20-a999-5cc6eebd0583 req-47b7adb8-f33d-42b9-98ed-a3d760131962 service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Updating instance_info_cache with network_info: [{"id": "a608dce2-1e56-44d3-bf7b-64071a603010", "address": "fa:16:3e:63:9e:fa", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa608dce2-1e", "ovs_interfaceid": "a608dce2-1e56-44d3-bf7b-64071a603010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:37:50 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-6bb0d45e-3bde-4b20-a999-5cc6eebd0583 req-47b7adb8-f33d-42b9-98ed-a3d760131962 service nova] Releasing lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:37:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:37:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:37:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:37:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:38:03 user nova-compute[73469]: INFO nova.compute.claims [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Claim successful on node user
Aug 22 03:38:03 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:38:03 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:38:03 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:38:03 user nova-compute[73469]: INFO nova.virt.block_device [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Booting with volume 3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f at /dev/vda
Aug 22 03:38:03 user nova-compute[73469]: DEBUG nova.policy [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c2b396a267549f4b7911646251a4094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9878ef4b06740e9af1fc5aff14417ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG os_brick.utils [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[98813163-562c-4096-9c05-166b7dd2a66c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff0db4e-a242-4bc6-8256-26f1a059ebf4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc149ac3-741f-4ff4-8ef7-a5a9f6f5342d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[693cbb4b-39df-49ca-94cf-ea3aae6b367f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:38:03 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:38:03 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a14562-a707-4df5-b6a7-cce7d13dda04]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:38:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:38:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:38:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:38:04 user nova-compute[73469]: DEBUG os_brick.utils [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:38:04 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Updating existing volume attachment record: 618b3fa0-30c3-41cf-ae0e-916e16ade202 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:38:04 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Successfully created port: 74c83fd2-34a8-49e4-bebc-c0e8e494bf82 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:38:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:05 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Successfully updated port: 74c83fd2-34a8-49e4-bebc-c0e8e494bf82 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:38:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "refresh_cache-43cbd3c1-4c94-41f4-9d7c-c531af640cea" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:38:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquired lock "refresh_cache-43cbd3c1-4c94-41f4-9d7c-c531af640cea" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:38:05 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:38:05 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:38:05 user nova-compute[73469]: DEBUG nova.compute.manager [req-8a1df1cc-2de1-4477-8a36-46a812f90a69 req-bc895393-d8c2-4df8-a2b9-5e81bf5ce89c service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Received event network-changed-74c83fd2-34a8-49e4-bebc-c0e8e494bf82 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:38:05 user nova-compute[73469]: DEBUG nova.compute.manager [req-8a1df1cc-2de1-4477-8a36-46a812f90a69 req-bc895393-d8c2-4df8-a2b9-5e81bf5ce89c service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Refreshing instance network info cache due to event network-changed-74c83fd2-34a8-49e4-bebc-c0e8e494bf82. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:38:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8a1df1cc-2de1-4477-8a36-46a812f90a69 req-bc895393-d8c2-4df8-a2b9-5e81bf5ce89c service nova] Acquiring lock "refresh_cache-43cbd3c1-4c94-41f4-9d7c-c531af640cea" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:38:05 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Updating instance_info_cache with network_info: [{"id": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "address": "fa:16:3e:46:15:1c", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c83fd2-34", "ovs_interfaceid": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:38:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Releasing lock "refresh_cache-43cbd3c1-4c94-41f4-9d7c-c531af640cea" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:38:05 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Instance network_info: |[{"id": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "address": "fa:16:3e:46:15:1c", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c83fd2-34", "ovs_interfaceid": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:38:05 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8a1df1cc-2de1-4477-8a36-46a812f90a69 req-bc895393-d8c2-4df8-a2b9-5e81bf5ce89c service nova] Acquired lock "refresh_cache-43cbd3c1-4c94-41f4-9d7c-c531af640cea" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:38:05 user nova-compute[73469]: DEBUG nova.network.neutron [req-8a1df1cc-2de1-4477-8a36-46a812f90a69 req-bc895393-d8c2-4df8-a2b9-5e81bf5ce89c service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Refreshing network info cache for port 74c83fd2-34a8-49e4-bebc-c0e8e494bf82 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:38:06 user nova-compute[73469]: DEBUG nova.network.neutron [req-8a1df1cc-2de1-4477-8a36-46a812f90a69 req-bc895393-d8c2-4df8-a2b9-5e81bf5ce89c service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Updated VIF entry in instance network info cache for port 74c83fd2-34a8-49e4-bebc-c0e8e494bf82. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:38:06 user nova-compute[73469]: DEBUG nova.network.neutron [req-8a1df1cc-2de1-4477-8a36-46a812f90a69 req-bc895393-d8c2-4df8-a2b9-5e81bf5ce89c service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Updating instance_info_cache with network_info: [{"id": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "address": "fa:16:3e:46:15:1c", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c83fd2-34", "ovs_interfaceid": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:38:06 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-8a1df1cc-2de1-4477-8a36-46a812f90a69 req-bc895393-d8c2-4df8-a2b9-5e81bf5ce89c service nova] Releasing lock "refresh_cache-43cbd3c1-4c94-41f4-9d7c-c531af640cea" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:38:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:12 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:38:14 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Creating image(s)
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Did not create local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Ensure instance console log exists: /opt/stack/data/nova/instances/43cbd3c1-4c94-41f4-9d7c-c531af640cea/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Start _get_guest_xml network_info=[{"id": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "address": "fa:16:3e:46:15:1c", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c83fd2-34", "ovs_interfaceid": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '618b3fa0-30c3-41cf-ae0e-916e16ade202', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuzrCgce', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '43cbd3c1-4c94-41f4-9d7c-c531af640cea', 'attached_at': '', 'detached_at': '', 'volume_id': '3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f', 'serial': '3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:38:14 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:38:14 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuzrCgce', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:38:14 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:38:14 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:38:14 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ea0afd-a823-44b0-a958-dfbf9fcbf7ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:38:14 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6b33db-e564-443f-bb6f-3223b3ae7ebe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f] added
Aug 22 03:38:14 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdaae6f1-86df-4bff-a0a7-83ac3a502fd7]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[181ce868-0b26-4d29-a47e-d37d6945f7cc]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NuzrCgce {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NuzrCgce" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8037f286-724c-4e24-bff6-6e2e611ce4cf]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NuzrCgce'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82e687d-115e-4f70-bfea-c709c48e889e]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebff2216-8a82-41cb-92ca-2fe1361aebf7]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)
Aug 22 03:38:14 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)
Aug 22 03:38:14 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3efe9e6-2cc6-4f36-8a10-8b8e2e65d154]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f, portal: 172.16.0.220,3260]
Aug 22 03:38:14 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f, portal: 172.16.0.220,3260] successful.
Aug 22 03:38:14 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6498b2-7f33-4178-8260-6949c20c2a7b]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[807fcef8-1909-4032-a498-7aa0004cbe69]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)
Aug 22 03:38:14 user nova-compute[73469]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f (non-flash)
Aug 22 03:38:14 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)
Aug 22 03:38:14 user nova-compute[73469]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f (non-flash)
Aug 22 03:38:14 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3499d669-1611-4010-98e1-8c3d883abd35]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:38:14 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuzrCgce', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23665613030643434', 'path': '/dev/sdc'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665613030643434', 'path': '/dev/sdc'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:38:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-872722932',display_name='tempest-TestVolumeBootPattern-server-872722932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-872722932',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyXJlUIljrr/X6pCzTVMN6wtxEVyqHosXjh8Bb+rOY+cvXhCH956AGTGPXRAXpA5TdDrTYNYOqLaI+VzWwIfiH3E8kMOPz3Dv0BSa0v5eRTC5A60kbA4/zvvaIssE+pwQ==',key_name='tempest-TestVolumeBootPattern-1529823206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9878ef4b06740e9af1fc5aff14417ab',ramdisk_id='',reservation_id='r-hwwku98q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1927887073',owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:38:04Z,user_data=None,user_id='8c2b396a267549f4b7911646251a4094',uuid=43cbd3c1-4c94-41f4-9d7c-c531af640cea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "address": "fa:16:3e:46:15:1c", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c83fd2-34", "ovs_interfaceid": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converting VIF {"id": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "address": "fa:16:3e:46:15:1c", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c83fd2-34", "ovs_interfaceid": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:15:1c,bridge_name='br-int',has_traffic_filtering=True,id=74c83fd2-34a8-49e4-bebc-c0e8e494bf82,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c83fd2-34') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lazy-loading 'pci_devices' on Instance uuid 43cbd3c1-4c94-41f4-9d7c-c531af640cea {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:38:15 user nova-compute[73469]:   <uuid>43cbd3c1-4c94-41f4-9d7c-c531af640cea</uuid>
Aug 22 03:38:15 user nova-compute[73469]:   <name>instance-00000033</name>
Aug 22 03:38:15 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:38:15 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:38:15 user nova-compute[73469]:   <metadata>
Aug 22 03:38:15 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:38:15 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:38:15 user nova-compute[73469]:       <nova:name>tempest-TestVolumeBootPattern-server-872722932</nova:name>
Aug 22 03:38:15 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:38:14</nova:creationTime>
Aug 22 03:38:15 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:38:15 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:38:15 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:38:15 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:38:15 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:38:15 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:38:15 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:38:15 user nova-compute[73469]:       <nova:owner>
Aug 22 03:38:15 user nova-compute[73469]:         <nova:user uuid="8c2b396a267549f4b7911646251a4094">tempest-TestVolumeBootPattern-1927887073-project-member</nova:user>
Aug 22 03:38:15 user nova-compute[73469]:         <nova:project uuid="f9878ef4b06740e9af1fc5aff14417ab">tempest-TestVolumeBootPattern-1927887073</nova:project>
Aug 22 03:38:15 user nova-compute[73469]:       </nova:owner>
Aug 22 03:38:15 user nova-compute[73469]:       <nova:ports>
Aug 22 03:38:15 user nova-compute[73469]:         <nova:port uuid="74c83fd2-34a8-49e4-bebc-c0e8e494bf82">
Aug 22 03:38:15 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 22 03:38:15 user nova-compute[73469]:         </nova:port>
Aug 22 03:38:15 user nova-compute[73469]:       </nova:ports>
Aug 22 03:38:15 user nova-compute[73469]:     </nova:instance>
Aug 22 03:38:15 user nova-compute[73469]:   </metadata>
Aug 22 03:38:15 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:38:15 user nova-compute[73469]:     <system>
Aug 22 03:38:15 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:38:15 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:38:15 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:38:15 user nova-compute[73469]:       <entry name="serial">43cbd3c1-4c94-41f4-9d7c-c531af640cea</entry>
Aug 22 03:38:15 user nova-compute[73469]:       <entry name="uuid">43cbd3c1-4c94-41f4-9d7c-c531af640cea</entry>
Aug 22 03:38:15 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:38:15 user nova-compute[73469]:     </system>
Aug 22 03:38:15 user nova-compute[73469]:   </sysinfo>
Aug 22 03:38:15 user nova-compute[73469]:   <os>
Aug 22 03:38:15 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:38:15 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:38:15 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:38:15 user nova-compute[73469]:   </os>
Aug 22 03:38:15 user nova-compute[73469]:   <features>
Aug 22 03:38:15 user nova-compute[73469]:     <acpi/>
Aug 22 03:38:15 user nova-compute[73469]:     <apic/>
Aug 22 03:38:15 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:38:15 user nova-compute[73469]:   </features>
Aug 22 03:38:15 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:38:15 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:38:15 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:38:15 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:38:15 user nova-compute[73469]:   </clock>
Aug 22 03:38:15 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:38:15 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:38:15 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:38:15 user nova-compute[73469]:   </cpu>
Aug 22 03:38:15 user nova-compute[73469]:   <devices>
Aug 22 03:38:15 user nova-compute[73469]:     <disk type="block" device="disk">
Aug 22 03:38:15 user nova-compute[73469]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:38:15 user nova-compute[73469]:       <source dev="/dev/sdc"/>
Aug 22 03:38:15 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:38:15 user nova-compute[73469]:       <serial>3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f</serial>
Aug 22 03:38:15 user nova-compute[73469]:     </disk>
Aug 22 03:38:15 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:38:15 user nova-compute[73469]:       <mac address="fa:16:3e:46:15:1c"/>
Aug 22 03:38:15 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:38:15 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:38:15 user nova-compute[73469]:       <target dev="tap74c83fd2-34"/>
Aug 22 03:38:15 user nova-compute[73469]:     </interface>
Aug 22 03:38:15 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:38:15 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/43cbd3c1-4c94-41f4-9d7c-c531af640cea/console.log" append="off"/>
Aug 22 03:38:15 user nova-compute[73469]:     </serial>
Aug 22 03:38:15 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:38:15 user nova-compute[73469]:     <video>
Aug 22 03:38:15 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:38:15 user nova-compute[73469]:     </video>
Aug 22 03:38:15 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:38:15 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:38:15 user nova-compute[73469]:     </rng>
Aug 22 03:38:15 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:38:15 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:38:15 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:38:15 user nova-compute[73469]:     </memballoon>
Aug 22 03:38:15 user nova-compute[73469]:   </devices>
Aug 22 03:38:15 user nova-compute[73469]: </domain>
Aug 22 03:38:15 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:38:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-872722932',display_name='tempest-TestVolumeBootPattern-server-872722932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-872722932',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyXJlUIljrr/X6pCzTVMN6wtxEVyqHosXjh8Bb+rOY+cvXhCH956AGTGPXRAXpA5TdDrTYNYOqLaI+VzWwIfiH3E8kMOPz3Dv0BSa0v5eRTC5A60kbA4/zvvaIssE+pwQ==',key_name='tempest-TestVolumeBootPattern-1529823206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9878ef4b06740e9af1fc5aff14417ab',ramdisk_id='',reservation_id='r-hwwku98q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1927887073',owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:38:04Z,user_data=None,user_id='8c2b396a267549f4b7911646251a4094',uuid=43cbd3c1-4c94-41f4-9d7c-c531af640cea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "address": "fa:16:3e:46:15:1c", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c83fd2-34", "ovs_interfaceid": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converting VIF {"id": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "address": "fa:16:3e:46:15:1c", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c83fd2-34", "ovs_interfaceid": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:15:1c,bridge_name='br-int',has_traffic_filtering=True,id=74c83fd2-34a8-49e4-bebc-c0e8e494bf82,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c83fd2-34') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG os_vif [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:15:1c,bridge_name='br-int',has_traffic_filtering=True,id=74c83fd2-34a8-49e4-bebc-c0e8e494bf82,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c83fd2-34') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74c83fd2-34, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74c83fd2-34, col_values=(('external_ids', {'iface-id': '74c83fd2-34a8-49e4-bebc-c0e8e494bf82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:15:1c', 'vm-uuid': '43cbd3c1-4c94-41f4-9d7c-c531af640cea'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:15 user nova-compute[73469]: INFO os_vif [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:15:1c,bridge_name='br-int',has_traffic_filtering=True,id=74c83fd2-34a8-49e4-bebc-c0e8e494bf82,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c83fd2-34')
Aug 22 03:38:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:38:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] No VIF found with MAC fa:16:3e:46:15:1c, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:38:16 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:38:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:17 user nova-compute[73469]: DEBUG nova.compute.manager [req-28c8b378-ba14-4029-a216-f3c4107ac94b req-a6d4ab70-64d5-42e4-83e6-5c4aca03e77d service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Received event network-vif-plugged-74c83fd2-34a8-49e4-bebc-c0e8e494bf82 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:38:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-28c8b378-ba14-4029-a216-f3c4107ac94b req-a6d4ab70-64d5-42e4-83e6-5c4aca03e77d service nova] Acquiring lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:38:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-28c8b378-ba14-4029-a216-f3c4107ac94b req-a6d4ab70-64d5-42e4-83e6-5c4aca03e77d service nova] Lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:38:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-28c8b378-ba14-4029-a216-f3c4107ac94b req-a6d4ab70-64d5-42e4-83e6-5c4aca03e77d service nova] Lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:38:17 user nova-compute[73469]: DEBUG nova.compute.manager [req-28c8b378-ba14-4029-a216-f3c4107ac94b req-a6d4ab70-64d5-42e4-83e6-5c4aca03e77d service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] No waiting events found dispatching network-vif-plugged-74c83fd2-34a8-49e4-bebc-c0e8e494bf82 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:38:17 user nova-compute[73469]: WARNING nova.compute.manager [req-28c8b378-ba14-4029-a216-f3c4107ac94b req-a6d4ab70-64d5-42e4-83e6-5c4aca03e77d service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Received unexpected event network-vif-plugged-74c83fd2-34a8-49e4-bebc-c0e8e494bf82 for instance with vm_state building and task_state spawning.
Aug 22 03:38:17 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:17 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:38:17 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:38:17 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:38:17 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Skipping network cache update for instance because it is Building. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 22 03:38:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:38:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:38:17 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:38:17 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid f7f8aeca-fe0b-4aa5-a614-294ffb285689 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:38:18 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Updating instance_info_cache with network_info: [{"id": "a608dce2-1e56-44d3-bf7b-64071a603010", "address": "fa:16:3e:63:9e:fa", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa608dce2-1e", "ovs_interfaceid": "a608dce2-1e56-44d3-bf7b-64071a603010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:38:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:38:18 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:38:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:19 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692675499.1886427, 43cbd3c1-4c94-41f4-9d7c-c531af640cea => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:38:19 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] VM Resumed (Lifecycle Event)
Aug 22 03:38:19 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:38:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:38:19 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Instance spawned successfully.
Aug 22 03:38:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:38:19 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:38:19 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:38:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:38:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:38:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:38:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:38:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:38:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:38:19 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:38:19 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692675499.190176, 43cbd3c1-4c94-41f4-9d7c-c531af640cea => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:38:19 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] VM Started (Lifecycle Event)
Aug 22 03:38:19 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:38:19 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:38:19 user nova-compute[73469]: INFO nova.compute.manager [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Took 4.82 seconds to spawn the instance on the hypervisor.
Aug 22 03:38:19 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:38:19 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:38:19 user nova-compute[73469]: INFO nova.compute.manager [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Took 15.96 seconds to build instance.
Aug 22 03:38:19 user nova-compute[73469]: DEBUG nova.compute.manager [req-2e86f2e8-aa65-49d7-a113-3949150b4797 req-22e71340-162f-456a-b3ba-c25443d4ece1 service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Received event network-vif-plugged-74c83fd2-34a8-49e4-bebc-c0e8e494bf82 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:38:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2e86f2e8-aa65-49d7-a113-3949150b4797 req-22e71340-162f-456a-b3ba-c25443d4ece1 service nova] Acquiring lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:38:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2e86f2e8-aa65-49d7-a113-3949150b4797 req-22e71340-162f-456a-b3ba-c25443d4ece1 service nova] Lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:38:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-2e86f2e8-aa65-49d7-a113-3949150b4797 req-22e71340-162f-456a-b3ba-c25443d4ece1 service nova] Lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:38:19 user nova-compute[73469]: DEBUG nova.compute.manager [req-2e86f2e8-aa65-49d7-a113-3949150b4797 req-22e71340-162f-456a-b3ba-c25443d4ece1 service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] No waiting events found dispatching network-vif-plugged-74c83fd2-34a8-49e4-bebc-c0e8e494bf82 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:38:19 user nova-compute[73469]: WARNING nova.compute.manager [req-2e86f2e8-aa65-49d7-a113-3949150b4797 req-22e71340-162f-456a-b3ba-c25443d4ece1 service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Received unexpected event network-vif-plugged-74c83fd2-34a8-49e4-bebc-c0e8e494bf82 for instance with vm_state active and task_state None.
Aug 22 03:38:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1fd5a91f-d060-43a0-b2ea-a842cef4a86d tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.116s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:38:19 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:38:19 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:38:19 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:38:20 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:38:20 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:38:20 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:38:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:38:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:38:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:38:20 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:38:20 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:38:20 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:38:20 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:20 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:38:20 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:38:20 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8741MB free_disk=25.11798095703125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:38:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:38:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:38:21 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f7f8aeca-fe0b-4aa5-a614-294ffb285689 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:38:21 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 43cbd3c1-4c94-41f4-9d7c-c531af640cea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:38:21 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:38:21 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:38:21 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:38:21 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:38:21 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:38:21 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:38:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:30 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:38:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:39:01 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:39:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:39:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:39:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:39:06 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:07 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:39:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:14 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:39:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:39:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:39:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:39:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:39:16 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:16 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:39:16 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:39:17 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:39:17 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:39:17 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:39:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:39:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:39:17 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:39:17 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid f7f8aeca-fe0b-4aa5-a614-294ffb285689 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:39:18 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Updating instance_info_cache with network_info: [{"id": "a608dce2-1e56-44d3-bf7b-64071a603010", "address": "fa:16:3e:63:9e:fa", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa608dce2-1e", "ovs_interfaceid": "a608dce2-1e56-44d3-bf7b-64071a603010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:39:18 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:39:18 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:39:18 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:39:20 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:39:20 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:39:20 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:39:20 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:39:20 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 22 03:39:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:39:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:39:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:39:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:39:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:21 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:39:21 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:39:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 22 03:39:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] There are 0 instances to clean {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 22 03:39:22 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:39:22 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:39:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:39:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:39:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:39:22 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:39:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:39:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:39:22 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:39:22 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:39:22 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8706MB free_disk=25.117305755615234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:39:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:39:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:39:23 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f7f8aeca-fe0b-4aa5-a614-294ffb285689 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:39:23 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance 43cbd3c1-4c94-41f4-9d7c-c531af640cea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:39:23 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:39:23 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:39:23 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:39:23 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:39:23 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:39:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:39:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:39:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:39:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:39:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:39:26 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:31 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:33 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:39:33 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid f7f8aeca-fe0b-4aa5-a614-294ffb285689 {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 03:39:33 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid 43cbd3c1-4c94-41f4-9d7c-c531af640cea {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 03:39:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:39:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:39:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:39:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:39:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:39:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:39:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:41 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:46 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:51 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-b305abe4-0f93-4444-ad6e-7e79d21dc414 req-ca1a2313-44c3-4148-b290-0499629024a0 service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Received event network-changed-74c83fd2-34a8-49e4-bebc-c0e8e494bf82 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:39:55 user nova-compute[73469]: DEBUG nova.compute.manager [req-b305abe4-0f93-4444-ad6e-7e79d21dc414 req-ca1a2313-44c3-4148-b290-0499629024a0 service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Refreshing instance network info cache due to event network-changed-74c83fd2-34a8-49e4-bebc-c0e8e494bf82. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:39:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b305abe4-0f93-4444-ad6e-7e79d21dc414 req-ca1a2313-44c3-4148-b290-0499629024a0 service nova] Acquiring lock "refresh_cache-43cbd3c1-4c94-41f4-9d7c-c531af640cea" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:39:55 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b305abe4-0f93-4444-ad6e-7e79d21dc414 req-ca1a2313-44c3-4148-b290-0499629024a0 service nova] Acquired lock "refresh_cache-43cbd3c1-4c94-41f4-9d7c-c531af640cea" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:39:55 user nova-compute[73469]: DEBUG nova.network.neutron [req-b305abe4-0f93-4444-ad6e-7e79d21dc414 req-ca1a2313-44c3-4148-b290-0499629024a0 service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Refreshing network info cache for port 74c83fd2-34a8-49e4-bebc-c0e8e494bf82 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:39:55 user nova-compute[73469]: DEBUG nova.network.neutron [req-b305abe4-0f93-4444-ad6e-7e79d21dc414 req-ca1a2313-44c3-4148-b290-0499629024a0 service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Updated VIF entry in instance network info cache for port 74c83fd2-34a8-49e4-bebc-c0e8e494bf82. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:39:55 user nova-compute[73469]: DEBUG nova.network.neutron [req-b305abe4-0f93-4444-ad6e-7e79d21dc414 req-ca1a2313-44c3-4148-b290-0499629024a0 service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Updating instance_info_cache with network_info: [{"id": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "address": "fa:16:3e:46:15:1c", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c83fd2-34", "ovs_interfaceid": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:39:56 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b305abe4-0f93-4444-ad6e-7e79d21dc414 req-ca1a2313-44c3-4148-b290-0499629024a0 service nova] Releasing lock "refresh_cache-43cbd3c1-4c94-41f4-9d7c-c531af640cea" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:39:56 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:39:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:39:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:39:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:39:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:39:57 user nova-compute[73469]: INFO nova.compute.manager [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Terminating instance
Aug 22 03:39:57 user nova-compute[73469]: DEBUG nova.compute.manager [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:39:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:57 user nova-compute[73469]: DEBUG nova.compute.manager [req-969c825b-079e-4316-880f-c98fd9001028 req-2d9f002c-aa78-45c8-a967-e116b17e0737 service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Received event network-changed-74c83fd2-34a8-49e4-bebc-c0e8e494bf82 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:39:57 user nova-compute[73469]: DEBUG nova.compute.manager [req-969c825b-079e-4316-880f-c98fd9001028 req-2d9f002c-aa78-45c8-a967-e116b17e0737 service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Refreshing instance network info cache due to event network-changed-74c83fd2-34a8-49e4-bebc-c0e8e494bf82. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:39:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-969c825b-079e-4316-880f-c98fd9001028 req-2d9f002c-aa78-45c8-a967-e116b17e0737 service nova] Acquiring lock "refresh_cache-43cbd3c1-4c94-41f4-9d7c-c531af640cea" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:39:57 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-969c825b-079e-4316-880f-c98fd9001028 req-2d9f002c-aa78-45c8-a967-e116b17e0737 service nova] Acquired lock "refresh_cache-43cbd3c1-4c94-41f4-9d7c-c531af640cea" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:39:57 user nova-compute[73469]: DEBUG nova.network.neutron [req-969c825b-079e-4316-880f-c98fd9001028 req-2d9f002c-aa78-45c8-a967-e116b17e0737 service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Refreshing network info cache for port 74c83fd2-34a8-49e4-bebc-c0e8e494bf82 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:39:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:57 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG nova.network.neutron [req-969c825b-079e-4316-880f-c98fd9001028 req-2d9f002c-aa78-45c8-a967-e116b17e0737 service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Updated VIF entry in instance network info cache for port 74c83fd2-34a8-49e4-bebc-c0e8e494bf82. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG nova.network.neutron [req-969c825b-079e-4316-880f-c98fd9001028 req-2d9f002c-aa78-45c8-a967-e116b17e0737 service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Updating instance_info_cache with network_info: [{"id": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "address": "fa:16:3e:46:15:1c", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c83fd2-34", "ovs_interfaceid": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-969c825b-079e-4316-880f-c98fd9001028 req-2d9f002c-aa78-45c8-a967-e116b17e0737 service nova] Releasing lock "refresh_cache-43cbd3c1-4c94-41f4-9d7c-c531af640cea" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:39:58 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Instance destroyed successfully.
Aug 22 03:39:58 user nova-compute[73469]: DEBUG nova.objects.instance [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lazy-loading 'resources' on Instance uuid 43cbd3c1-4c94-41f4-9d7c-c531af640cea {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:38:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-872722932',display_name='tempest-TestVolumeBootPattern-server-872722932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-872722932',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyXJlUIljrr/X6pCzTVMN6wtxEVyqHosXjh8Bb+rOY+cvXhCH956AGTGPXRAXpA5TdDrTYNYOqLaI+VzWwIfiH3E8kMOPz3Dv0BSa0v5eRTC5A60kbA4/zvvaIssE+pwQ==',key_name='tempest-TestVolumeBootPattern-1529823206',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:38:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9878ef4b06740e9af1fc5aff14417ab',ramdisk_id='',reservation_id='r-hwwku98q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1927887073',owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:38:19Z,user_data=None,user_id='8c2b396a267549f4b7911646251a4094',uuid=43cbd3c1-4c94-41f4-9d7c-c531af640cea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "address": "fa:16:3e:46:15:1c", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c83fd2-34", "ovs_interfaceid": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converting VIF {"id": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "address": "fa:16:3e:46:15:1c", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c83fd2-34", "ovs_interfaceid": "74c83fd2-34a8-49e4-bebc-c0e8e494bf82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:15:1c,bridge_name='br-int',has_traffic_filtering=True,id=74c83fd2-34a8-49e4-bebc-c0e8e494bf82,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c83fd2-34') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_vif [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:15:1c,bridge_name='br-int',has_traffic_filtering=True,id=74c83fd2-34a8-49e4-bebc-c0e8e494bf82,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c83fd2-34') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74c83fd2-34, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:39:58 user nova-compute[73469]: INFO os_vif [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:15:1c,bridge_name='br-int',has_traffic_filtering=True,id=74c83fd2-34a8-49e4-bebc-c0e8e494bf82,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c83fd2-34')
Aug 22 03:39:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuzrCgce', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:39:58 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f88957-97c5-4941-ad50-12ea36cdac75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e341ccaf-9a4d-4f00-b027-bd97aa6b25d3]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)
Aug 22 03:39:58 user nova-compute[73469]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f (non-flash)
Aug 22 03:39:58 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)
Aug 22 03:39:58 user nova-compute[73469]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f (non-flash)
Aug 22 03:39:58 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7980545090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f'): ({'sdc'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Removing single pathed devices sdc {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[743dfc98-64cb-4618-8f18-595d47fddf9c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f289b7e6-0cf6-4a8d-9a6a-7c386e67904b]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Flushing IO for device /dev/sdc {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d4a778-79da-457a-a9fa-7f6b042f2782]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66b6686-9221-4fc9-8aba-5a12111d3e63]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] SCSI volumes sdc have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6c4cf56f-6ea00d4479c11e93', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6c4cf56f', '/dev/disk/by-id/scsi-23665613030643434') {{(pid=84378) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4ab526-c286-4d56-b3e2-d81c73bdc46f]: (4, None) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4562a4-160c-4cb2-9b97-a313dedbd56e]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbee054-58db-460d-9d1c-0062969e1870]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f, portal: 172.16.0.220,3260]
Aug 22 03:39:58 user nova-compute[73469]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f, portal: 172.16.0.220,3260] successful.
Aug 22 03:39:58 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5b3ab-d87e-4aef-ad4d-a2cc431c099f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[afef07ed-8df9-4507-baae-01651cedcccf]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] <== disconnect_volume: return (294ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:39:58 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Deleting instance files /opt/stack/data/nova/instances/43cbd3c1-4c94-41f4-9d7c-c531af640cea_del
Aug 22 03:39:58 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Deletion of /opt/stack/data/nova/instances/43cbd3c1-4c94-41f4-9d7c-c531af640cea_del complete
Aug 22 03:39:58 user nova-compute[73469]: INFO nova.compute.manager [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 22 03:39:58 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:39:58 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:39:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:39:59 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:39:59 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Took 0.56 seconds to deallocate network for instance.
Aug 22 03:39:59 user nova-compute[73469]: DEBUG nova.compute.manager [req-0b664fc9-0a8e-49e0-bfb5-7af311314a71 req-b8d47d0b-1353-4546-81a2-37d79e08d95f service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Received event network-vif-deleted-74c83fd2-34a8-49e4-bebc-c0e8e494bf82 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:39:59 user nova-compute[73469]: INFO nova.compute.manager [req-0b664fc9-0a8e-49e0-bfb5-7af311314a71 req-b8d47d0b-1353-4546-81a2-37d79e08d95f service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Neutron deleted interface 74c83fd2-34a8-49e4-bebc-c0e8e494bf82; detaching it from the instance and deleting it from the info cache
Aug 22 03:39:59 user nova-compute[73469]: DEBUG nova.network.neutron [req-0b664fc9-0a8e-49e0-bfb5-7af311314a71 req-b8d47d0b-1353-4546-81a2-37d79e08d95f service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:39:59 user nova-compute[73469]: DEBUG nova.compute.manager [req-0b664fc9-0a8e-49e0-bfb5-7af311314a71 req-b8d47d0b-1353-4546-81a2-37d79e08d95f service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Detach interface failed, port_id=74c83fd2-34a8-49e4-bebc-c0e8e494bf82, reason: Instance 43cbd3c1-4c94-41f4-9d7c-c531af640cea could not be found. {{(pid=73469) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 22 03:39:59 user nova-compute[73469]: DEBUG nova.compute.manager [req-dadb3c8d-b167-4b5b-93af-6866fb4d9d47 req-0331a71c-750d-41dd-be4f-467b8ace30aa service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Received event network-vif-unplugged-74c83fd2-34a8-49e4-bebc-c0e8e494bf82 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:39:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dadb3c8d-b167-4b5b-93af-6866fb4d9d47 req-0331a71c-750d-41dd-be4f-467b8ace30aa service nova] Acquiring lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:39:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dadb3c8d-b167-4b5b-93af-6866fb4d9d47 req-0331a71c-750d-41dd-be4f-467b8ace30aa service nova] Lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:39:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dadb3c8d-b167-4b5b-93af-6866fb4d9d47 req-0331a71c-750d-41dd-be4f-467b8ace30aa service nova] Lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:39:59 user nova-compute[73469]: DEBUG nova.compute.manager [req-dadb3c8d-b167-4b5b-93af-6866fb4d9d47 req-0331a71c-750d-41dd-be4f-467b8ace30aa service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] No waiting events found dispatching network-vif-unplugged-74c83fd2-34a8-49e4-bebc-c0e8e494bf82 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:39:59 user nova-compute[73469]: DEBUG nova.compute.manager [req-dadb3c8d-b167-4b5b-93af-6866fb4d9d47 req-0331a71c-750d-41dd-be4f-467b8ace30aa service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Received event network-vif-unplugged-74c83fd2-34a8-49e4-bebc-c0e8e494bf82 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:39:59 user nova-compute[73469]: DEBUG nova.compute.manager [req-dadb3c8d-b167-4b5b-93af-6866fb4d9d47 req-0331a71c-750d-41dd-be4f-467b8ace30aa service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Received event network-vif-plugged-74c83fd2-34a8-49e4-bebc-c0e8e494bf82 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:39:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dadb3c8d-b167-4b5b-93af-6866fb4d9d47 req-0331a71c-750d-41dd-be4f-467b8ace30aa service nova] Acquiring lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:39:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dadb3c8d-b167-4b5b-93af-6866fb4d9d47 req-0331a71c-750d-41dd-be4f-467b8ace30aa service nova] Lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:39:59 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-dadb3c8d-b167-4b5b-93af-6866fb4d9d47 req-0331a71c-750d-41dd-be4f-467b8ace30aa service nova] Lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:39:59 user nova-compute[73469]: DEBUG nova.compute.manager [req-dadb3c8d-b167-4b5b-93af-6866fb4d9d47 req-0331a71c-750d-41dd-be4f-467b8ace30aa service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] No waiting events found dispatching network-vif-plugged-74c83fd2-34a8-49e4-bebc-c0e8e494bf82 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:39:59 user nova-compute[73469]: WARNING nova.compute.manager [req-dadb3c8d-b167-4b5b-93af-6866fb4d9d47 req-0331a71c-750d-41dd-be4f-467b8ace30aa service nova] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Received unexpected event network-vif-plugged-74c83fd2-34a8-49e4-bebc-c0e8e494bf82 for instance with vm_state active and task_state deleting.
Aug 22 03:40:00 user nova-compute[73469]: INFO nova.compute.manager [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Took 0.78 seconds to detach 1 volumes for instance.
Aug 22 03:40:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:40:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:40:00 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:40:00 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:40:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:40:00 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Deleted allocations for instance 43cbd3c1-4c94-41f4-9d7c-c531af640cea
Aug 22 03:40:00 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-f68d4c1f-1410-4ac6-87dc-f9c0b3cc84a1 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "43cbd3c1-4c94-41f4-9d7c-c531af640cea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.818s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:40:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:40:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:40:13 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692675598.2596252, 43cbd3c1-4c94-41f4-9d7c-c531af640cea => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:40:13 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] VM Stopped (Lifecycle Event)
Aug 22 03:40:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-40320dc2-1bbe-4f5f-b83c-92f8f79d7614 None None] [instance: 43cbd3c1-4c94-41f4-9d7c-c531af640cea] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:40:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:40:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:40:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:40:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:40:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:40:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:40:14 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:40:18 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:40:18 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:40:18 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:40:18 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Didn't find any instances for network info cache update. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 22 03:40:18 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:40:19 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:40:21 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:40:21 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:40:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:40:22 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:40:22 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:40:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:40:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:40:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:40:22 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:40:22 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73469) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 22 03:40:23 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:40:23 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:40:23 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8773MB free_disk=25.108638763427734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f7f8aeca-fe0b-4aa5-a614-294ffb285689 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing inventories for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Updating ProviderTree inventory for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Updating inventory in ProviderTree for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing aggregate associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, aggregates: None {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing trait associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:40:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:40:25 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:40:28 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:40:33 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:40:38 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:40:43 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:40:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:40:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:40:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:40:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:40:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:40:48 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:40:53 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:40:58 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:41:03 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:41:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:41:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:41:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-a89cfe9e-b348-4b60-92c0-3403304ad570 req-4d0e69af-93cd-4059-a916-3dc7a02b56fa service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Received event network-changed-a608dce2-1e56-44d3-bf7b-64071a603010 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:41:08 user nova-compute[73469]: DEBUG nova.compute.manager [req-a89cfe9e-b348-4b60-92c0-3403304ad570 req-4d0e69af-93cd-4059-a916-3dc7a02b56fa service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Refreshing instance network info cache due to event network-changed-a608dce2-1e56-44d3-bf7b-64071a603010. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:41:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a89cfe9e-b348-4b60-92c0-3403304ad570 req-4d0e69af-93cd-4059-a916-3dc7a02b56fa service nova] Acquiring lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:41:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a89cfe9e-b348-4b60-92c0-3403304ad570 req-4d0e69af-93cd-4059-a916-3dc7a02b56fa service nova] Acquired lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:41:08 user nova-compute[73469]: DEBUG nova.network.neutron [req-a89cfe9e-b348-4b60-92c0-3403304ad570 req-4d0e69af-93cd-4059-a916-3dc7a02b56fa service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Refreshing network info cache for port a608dce2-1e56-44d3-bf7b-64071a603010 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:41:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:41:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:41:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:41:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:41:08 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:41:08 user nova-compute[73469]: INFO nova.compute.manager [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Terminating instance
Aug 22 03:41:08 user nova-compute[73469]: DEBUG nova.compute.manager [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:41:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG nova.network.neutron [req-a89cfe9e-b348-4b60-92c0-3403304ad570 req-4d0e69af-93cd-4059-a916-3dc7a02b56fa service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Updated VIF entry in instance network info cache for port a608dce2-1e56-44d3-bf7b-64071a603010. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG nova.network.neutron [req-a89cfe9e-b348-4b60-92c0-3403304ad570 req-4d0e69af-93cd-4059-a916-3dc7a02b56fa service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Updating instance_info_cache with network_info: [{"id": "a608dce2-1e56-44d3-bf7b-64071a603010", "address": "fa:16:3e:63:9e:fa", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa608dce2-1e", "ovs_interfaceid": "a608dce2-1e56-44d3-bf7b-64071a603010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-a89cfe9e-b348-4b60-92c0-3403304ad570 req-4d0e69af-93cd-4059-a916-3dc7a02b56fa service nova] Releasing lock "refresh_cache-f7f8aeca-fe0b-4aa5-a614-294ffb285689" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG nova.compute.manager [req-5f4c7074-6481-48a0-8807-ea49ff343758 req-ce620cfe-95cc-4f11-8483-ac51537eb20d service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Received event network-vif-unplugged-a608dce2-1e56-44d3-bf7b-64071a603010 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5f4c7074-6481-48a0-8807-ea49ff343758 req-ce620cfe-95cc-4f11-8483-ac51537eb20d service nova] Acquiring lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5f4c7074-6481-48a0-8807-ea49ff343758 req-ce620cfe-95cc-4f11-8483-ac51537eb20d service nova] Lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-5f4c7074-6481-48a0-8807-ea49ff343758 req-ce620cfe-95cc-4f11-8483-ac51537eb20d service nova] Lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG nova.compute.manager [req-5f4c7074-6481-48a0-8807-ea49ff343758 req-ce620cfe-95cc-4f11-8483-ac51537eb20d service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] No waiting events found dispatching network-vif-unplugged-a608dce2-1e56-44d3-bf7b-64071a603010 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG nova.compute.manager [req-5f4c7074-6481-48a0-8807-ea49ff343758 req-ce620cfe-95cc-4f11-8483-ac51537eb20d service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Received event network-vif-unplugged-a608dce2-1e56-44d3-bf7b-64071a603010 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:41:09 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Instance destroyed successfully.
Aug 22 03:41:09 user nova-compute[73469]: DEBUG nova.objects.instance [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lazy-loading 'resources' on Instance uuid f7f8aeca-fe0b-4aa5-a614-294ffb285689 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:35:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-291471319',display_name='tempest-TestVolumeBootPattern-server-291471319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-291471319',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyXJlUIljrr/X6pCzTVMN6wtxEVyqHosXjh8Bb+rOY+cvXhCH956AGTGPXRAXpA5TdDrTYNYOqLaI+VzWwIfiH3E8kMOPz3Dv0BSa0v5eRTC5A60kbA4/zvvaIssE+pwQ==',key_name='tempest-TestVolumeBootPattern-1529823206',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:36:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9878ef4b06740e9af1fc5aff14417ab',ramdisk_id='',reservation_id='r-vpu6gfkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1927887073',owner_user_name='tempest-TestVolumeBootPattern-1927887073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:36:14Z,user_data=None,user_id='8c2b396a267549f4b7911646251a4094',uuid=f7f8aeca-fe0b-4aa5-a614-294ffb285689,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a608dce2-1e56-44d3-bf7b-64071a603010", "address": "fa:16:3e:63:9e:fa", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa608dce2-1e", "ovs_interfaceid": "a608dce2-1e56-44d3-bf7b-64071a603010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converting VIF {"id": "a608dce2-1e56-44d3-bf7b-64071a603010", "address": "fa:16:3e:63:9e:fa", "network": {"id": "99786141-4461-4016-b715-45eeb79c22a8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-741778595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9878ef4b06740e9af1fc5aff14417ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa608dce2-1e", "ovs_interfaceid": "a608dce2-1e56-44d3-bf7b-64071a603010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:9e:fa,bridge_name='br-int',has_traffic_filtering=True,id=a608dce2-1e56-44d3-bf7b-64071a603010,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa608dce2-1e') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG os_vif [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:9e:fa,bridge_name='br-int',has_traffic_filtering=True,id=a608dce2-1e56-44d3-bf7b-64071a603010,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa608dce2-1e') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa608dce2-1e, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:41:09 user nova-compute[73469]: INFO os_vif [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:9e:fa,bridge_name='br-int',has_traffic_filtering=True,id=a608dce2-1e56-44d3-bf7b-64071a603010,network=Network(99786141-4461-4016-b715-45eeb79c22a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa608dce2-1e')
Aug 22 03:41:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhCISELw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:41:09 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:41:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e74b1e-afdb-463a-8f1e-1a722095607d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[693eb17b-a5a5-490c-b122-e0f6780dafdd]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)
Aug 22 03:41:09 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 (non-flash)
Aug 22 03:41:09 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a4139630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[69161107-5edb-4be7-a9ff-351790144897]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7615433f-d665-4627-beb9-666256f44abb]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[031b9f29-c7da-4e2a-a5e3-803b67334421]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[68317bcf-ce15-4cd1-a7e8-fb1dab05175e]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a5150c-f25c-4eb3-b24d-d858cf8fe2c5]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.034s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[11962bbe-1109-434c-9491-77015b7e7b65]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28, portal: 172.16.0.220,3260]
Aug 22 03:41:09 user nova-compute[73469]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28, portal: 172.16.0.220,3260] successful.
Aug 22 03:41:09 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92257668-86b5-4869-9fbb-02f3fb8f1d28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb78ead-66b9-4de3-80c4-462da7d98d47]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.243s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] <== disconnect_volume: return (244ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:41:09 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:41:09 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Deleting instance files /opt/stack/data/nova/instances/f7f8aeca-fe0b-4aa5-a614-294ffb285689_del
Aug 22 03:41:09 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Deletion of /opt/stack/data/nova/instances/f7f8aeca-fe0b-4aa5-a614-294ffb285689_del complete
Aug 22 03:41:10 user nova-compute[73469]: INFO nova.compute.manager [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 22 03:41:10 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:41:10 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:41:10 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:41:10 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:41:10 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Took 0.53 seconds to deallocate network for instance.
Aug 22 03:41:10 user nova-compute[73469]: DEBUG nova.compute.manager [req-0fa1b9a2-0b14-4b9b-86e7-fff8d59f7cf1 req-dd089721-fa31-4048-9309-ff858c99efeb service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Received event network-vif-deleted-a608dce2-1e56-44d3-bf7b-64071a603010 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:41:11 user nova-compute[73469]: INFO nova.compute.manager [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Took 0.76 seconds to detach 1 volumes for instance.
Aug 22 03:41:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:41:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:41:11 user nova-compute[73469]: DEBUG nova.compute.manager [req-cd371f0a-2acd-49a1-a48a-05c51ff9e0e1 req-2fdbb24d-bfd4-491e-882c-9fabca14f919 service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Received event network-vif-plugged-a608dce2-1e56-44d3-bf7b-64071a603010 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:41:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cd371f0a-2acd-49a1-a48a-05c51ff9e0e1 req-2fdbb24d-bfd4-491e-882c-9fabca14f919 service nova] Acquiring lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:41:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cd371f0a-2acd-49a1-a48a-05c51ff9e0e1 req-2fdbb24d-bfd4-491e-882c-9fabca14f919 service nova] Lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:41:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-cd371f0a-2acd-49a1-a48a-05c51ff9e0e1 req-2fdbb24d-bfd4-491e-882c-9fabca14f919 service nova] Lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:41:11 user nova-compute[73469]: DEBUG nova.compute.manager [req-cd371f0a-2acd-49a1-a48a-05c51ff9e0e1 req-2fdbb24d-bfd4-491e-882c-9fabca14f919 service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] No waiting events found dispatching network-vif-plugged-a608dce2-1e56-44d3-bf7b-64071a603010 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:41:11 user nova-compute[73469]: WARNING nova.compute.manager [req-cd371f0a-2acd-49a1-a48a-05c51ff9e0e1 req-2fdbb24d-bfd4-491e-882c-9fabca14f919 service nova] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Received unexpected event network-vif-plugged-a608dce2-1e56-44d3-bf7b-64071a603010 for instance with vm_state active and task_state deleting.
Aug 22 03:41:11 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:41:11 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:41:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:41:11 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Deleted allocations for instance f7f8aeca-fe0b-4aa5-a614-294ffb285689
Aug 22 03:41:11 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-48f21b82-6dbb-4e02-bd70-098ba44de155 tempest-TestVolumeBootPattern-1927887073 tempest-TestVolumeBootPattern-1927887073-project-member] Lock "f7f8aeca-fe0b-4aa5-a614-294ffb285689" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.820s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:41:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:41:15 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:41:18 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:41:19 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:41:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:41:20 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:41:20 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:41:20 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:41:20 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Didn't find any instances for network info cache update. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 22 03:41:20 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:41:21 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:41:22 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:41:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:41:23 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:41:24 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:41:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:41:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:41:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:41:24 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:41:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:41:24 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692675669.6747136, f7f8aeca-fe0b-4aa5-a614-294ffb285689 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:41:24 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] VM Stopped (Lifecycle Event)
Aug 22 03:41:24 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:41:24 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:41:24 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8906MB free_disk=25.107685089111328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:41:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:41:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:41:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-8fc58e9f-ca13-49f7-b6ec-5f9d41ed544f None None] [instance: f7f8aeca-fe0b-4aa5-a614-294ffb285689] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:41:24 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:41:24 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:41:24 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:41:24 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:41:25 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:41:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:41:27 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:41:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:41:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:41:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:41:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:41:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:41:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:41:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:12 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:15 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:42:18 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:42:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:20 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:42:21 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:22 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:42:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:42:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:42:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Didn't find any instances for network info cache update. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 22 03:42:22 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:42:22 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:42:23 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:42:23 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:42:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:24 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:42:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:42:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:42:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:42:24 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:42:24 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:42:24 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:42:24 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8926MB free_disk=25.105815887451172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:42:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:42:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:42:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:24 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:42:24 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:42:24 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:42:24 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:42:24 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:42:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:42:25 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:27 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:42:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:42:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:42:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Starting instance... {{(pid=73469) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 22 03:42:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:42:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:42:32 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73469) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 22 03:42:32 user nova-compute[73469]: INFO nova.compute.claims [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Claim successful on node user
Aug 22 03:42:32 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:42:32 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:42:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.177s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:42:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Start building networks asynchronously for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 22 03:42:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Allocating IP information in the background. {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 22 03:42:32 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] allocate_for_instance() {{(pid=73469) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 22 03:42:32 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 22 03:42:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Start building block device mappings for instance. {{(pid=73469) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 22 03:42:32 user nova-compute[73469]: DEBUG nova.policy [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '647e364e3e3741be8e4fe1147be0e1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7dfd9509814f1590f608be91963091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73469) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 22 03:42:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Start spawning the instance on the hypervisor. {{(pid=73469) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 22 03:42:32 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Creating instance directory {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 22 03:42:32 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Creating image(s)
Aug 22 03:42:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "/opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:42:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "/opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:42:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "/opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:42:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.179s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "27334ffc5b443608f49049e639053f2a9cc58bbc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.180s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk 1073741824 {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc,backing_fmt=raw /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk 1073741824" returned: 0 in 0.061s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "27334ffc5b443608f49049e639053f2a9cc58bbc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27334ffc5b443608f49049e639053f2a9cc58bbc --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk. size=1073741824 {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Successfully created port: 84cea14f-ce54-4963-9780-22222a629ed8 {{(pid=73469) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG nova.virt.disk.api [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Cannot resize image /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk to a smaller size. {{(pid=73469) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG nova.objects.instance [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lazy-loading 'migration_context' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Created local disks {{(pid=73469) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Ensure instance console log exists: /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/console.log {{(pid=73469) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:42:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Successfully updated port: 84cea14f-ce54-4963-9780-22222a629ed8 {{(pid=73469) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquired lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Building network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-9b89ede0-7bb8-45ff-abad-80137e9ccba8 req-7f008bb7-930f-4651-88e5-5179e4d50078 service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Received event network-changed-84cea14f-ce54-4963-9780-22222a629ed8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.compute.manager [req-9b89ede0-7bb8-45ff-abad-80137e9ccba8 req-7f008bb7-930f-4651-88e5-5179e4d50078 service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Refreshing instance network info cache due to event network-changed-84cea14f-ce54-4963-9780-22222a629ed8. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9b89ede0-7bb8-45ff-abad-80137e9ccba8 req-7f008bb7-930f-4651-88e5-5179e4d50078 service nova] Acquiring lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Instance cache missing network info. {{(pid=73469) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.network.neutron [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updating instance_info_cache with network_info: [{"id": "84cea14f-ce54-4963-9780-22222a629ed8", "address": "fa:16:3e:86:88:33", "network": {"id": "517d5945-86ef-47c8-b258-f12e64cfcfaf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-126195591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7dfd9509814f1590f608be91963091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cea14f-ce", "ovs_interfaceid": "84cea14f-ce54-4963-9780-22222a629ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Releasing lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Instance network_info: |[{"id": "84cea14f-ce54-4963-9780-22222a629ed8", "address": "fa:16:3e:86:88:33", "network": {"id": "517d5945-86ef-47c8-b258-f12e64cfcfaf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-126195591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7dfd9509814f1590f608be91963091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cea14f-ce", "ovs_interfaceid": "84cea14f-ce54-4963-9780-22222a629ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73469) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9b89ede0-7bb8-45ff-abad-80137e9ccba8 req-7f008bb7-930f-4651-88e5-5179e4d50078 service nova] Acquired lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.network.neutron [req-9b89ede0-7bb8-45ff-abad-80137e9ccba8 req-7f008bb7-930f-4651-88e5-5179e4d50078 service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Refreshing network info cache for port 84cea14f-ce54-4963-9780-22222a629ed8 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Start _get_guest_xml network_info=[{"id": "84cea14f-ce54-4963-9780-22222a629ed8", "address": "fa:16:3e:86:88:33", "network": {"id": "517d5945-86ef-47c8-b258-f12e64cfcfaf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-126195591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7dfd9509814f1590f608be91963091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cea14f-ce", "ovs_interfaceid": "84cea14f-ce54-4963-9780-22222a629ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a2a344d0-c924-4f6a-b6e6-23be8c2d6ded'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 22 03:42:34 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:42:34 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] CPU controller missing on host. {{(pid=73469) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.host [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] CPU controller found on host. {{(pid=73469) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73469) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-22T02:48:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-22T02:48:58Z,direct_url=<?>,disk_format='qcow2',id=a2a344d0-c924-4f6a-b6e6-23be8c2d6ded,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c3ce6b6b36b4531a48d91ae3d6ed128',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-22T02:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Flavor limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Image limits 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Flavor pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Image pref 0:0:0 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73469) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Got 1 possible topologies {{(pid=73469) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.hardware [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73469) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-809660707',display_name='tempest-SnapshotDataIntegrityTests-server-809660707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-809660707',id=52,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYheovmxUh1nD2wsGpzOSG3odpTyayja1ExTK2Am/xS1+RQV5lrpKn2JAa9BVySYiD9hTJOiaq+GGfKO1WtT+8LU2O/IkMUhrSubyYhg5CeIbtLtHKzhVoUKyt9IjDuQg==',key_name='tempest-keypair-2055205814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce7dfd9509814f1590f608be91963091',ramdisk_id='',reservation_id='r-7z3u1ayq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2037707076',owner_user_name='tempest-SnapshotDataIntegrityTests-2037707076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:42:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='647e364e3e3741be8e4fe1147be0e1fc',uuid=f589227e-36da-4c1f-a7a2-24e127334878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84cea14f-ce54-4963-9780-22222a629ed8", "address": "fa:16:3e:86:88:33", "network": {"id": "517d5945-86ef-47c8-b258-f12e64cfcfaf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-126195591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7dfd9509814f1590f608be91963091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cea14f-ce", "ovs_interfaceid": "84cea14f-ce54-4963-9780-22222a629ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73469) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Converting VIF {"id": "84cea14f-ce54-4963-9780-22222a629ed8", "address": "fa:16:3e:86:88:33", "network": {"id": "517d5945-86ef-47c8-b258-f12e64cfcfaf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-126195591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7dfd9509814f1590f608be91963091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cea14f-ce", "ovs_interfaceid": "84cea14f-ce54-4963-9780-22222a629ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:88:33,bridge_name='br-int',has_traffic_filtering=True,id=84cea14f-ce54-4963-9780-22222a629ed8,network=Network(517d5945-86ef-47c8-b258-f12e64cfcfaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cea14f-ce') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.objects.instance [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lazy-loading 'pci_devices' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] End _get_guest_xml xml=<domain type="kvm">
Aug 22 03:42:34 user nova-compute[73469]:   <uuid>f589227e-36da-4c1f-a7a2-24e127334878</uuid>
Aug 22 03:42:34 user nova-compute[73469]:   <name>instance-00000034</name>
Aug 22 03:42:34 user nova-compute[73469]:   <memory>524288</memory>
Aug 22 03:42:34 user nova-compute[73469]:   <vcpu>1</vcpu>
Aug 22 03:42:34 user nova-compute[73469]:   <metadata>
Aug 22 03:42:34 user nova-compute[73469]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 22 03:42:34 user nova-compute[73469]:       <nova:package version="0.0.0"/>
Aug 22 03:42:34 user nova-compute[73469]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-809660707</nova:name>
Aug 22 03:42:34 user nova-compute[73469]:       <nova:creationTime>2023-08-22 03:42:34</nova:creationTime>
Aug 22 03:42:34 user nova-compute[73469]:       <nova:flavor name="m1.tiny">
Aug 22 03:42:34 user nova-compute[73469]:         <nova:memory>512</nova:memory>
Aug 22 03:42:34 user nova-compute[73469]:         <nova:disk>1</nova:disk>
Aug 22 03:42:34 user nova-compute[73469]:         <nova:swap>0</nova:swap>
Aug 22 03:42:34 user nova-compute[73469]:         <nova:ephemeral>0</nova:ephemeral>
Aug 22 03:42:34 user nova-compute[73469]:         <nova:vcpus>1</nova:vcpus>
Aug 22 03:42:34 user nova-compute[73469]:       </nova:flavor>
Aug 22 03:42:34 user nova-compute[73469]:       <nova:owner>
Aug 22 03:42:34 user nova-compute[73469]:         <nova:user uuid="647e364e3e3741be8e4fe1147be0e1fc">tempest-SnapshotDataIntegrityTests-2037707076-project-member</nova:user>
Aug 22 03:42:34 user nova-compute[73469]:         <nova:project uuid="ce7dfd9509814f1590f608be91963091">tempest-SnapshotDataIntegrityTests-2037707076</nova:project>
Aug 22 03:42:34 user nova-compute[73469]:       </nova:owner>
Aug 22 03:42:34 user nova-compute[73469]:       <nova:root type="image" uuid="a2a344d0-c924-4f6a-b6e6-23be8c2d6ded"/>
Aug 22 03:42:34 user nova-compute[73469]:       <nova:ports>
Aug 22 03:42:34 user nova-compute[73469]:         <nova:port uuid="84cea14f-ce54-4963-9780-22222a629ed8">
Aug 22 03:42:34 user nova-compute[73469]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 22 03:42:34 user nova-compute[73469]:         </nova:port>
Aug 22 03:42:34 user nova-compute[73469]:       </nova:ports>
Aug 22 03:42:34 user nova-compute[73469]:     </nova:instance>
Aug 22 03:42:34 user nova-compute[73469]:   </metadata>
Aug 22 03:42:34 user nova-compute[73469]:   <sysinfo type="smbios">
Aug 22 03:42:34 user nova-compute[73469]:     <system>
Aug 22 03:42:34 user nova-compute[73469]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 22 03:42:34 user nova-compute[73469]:       <entry name="product">OpenStack Nova</entry>
Aug 22 03:42:34 user nova-compute[73469]:       <entry name="version">0.0.0</entry>
Aug 22 03:42:34 user nova-compute[73469]:       <entry name="serial">f589227e-36da-4c1f-a7a2-24e127334878</entry>
Aug 22 03:42:34 user nova-compute[73469]:       <entry name="uuid">f589227e-36da-4c1f-a7a2-24e127334878</entry>
Aug 22 03:42:34 user nova-compute[73469]:       <entry name="family">Virtual Machine</entry>
Aug 22 03:42:34 user nova-compute[73469]:     </system>
Aug 22 03:42:34 user nova-compute[73469]:   </sysinfo>
Aug 22 03:42:34 user nova-compute[73469]:   <os>
Aug 22 03:42:34 user nova-compute[73469]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 22 03:42:34 user nova-compute[73469]:     <boot dev="hd"/>
Aug 22 03:42:34 user nova-compute[73469]:     <smbios mode="sysinfo"/>
Aug 22 03:42:34 user nova-compute[73469]:   </os>
Aug 22 03:42:34 user nova-compute[73469]:   <features>
Aug 22 03:42:34 user nova-compute[73469]:     <acpi/>
Aug 22 03:42:34 user nova-compute[73469]:     <apic/>
Aug 22 03:42:34 user nova-compute[73469]:     <vmcoreinfo/>
Aug 22 03:42:34 user nova-compute[73469]:   </features>
Aug 22 03:42:34 user nova-compute[73469]:   <clock offset="utc">
Aug 22 03:42:34 user nova-compute[73469]:     <timer name="pit" tickpolicy="delay"/>
Aug 22 03:42:34 user nova-compute[73469]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 22 03:42:34 user nova-compute[73469]:     <timer name="hpet" present="no"/>
Aug 22 03:42:34 user nova-compute[73469]:   </clock>
Aug 22 03:42:34 user nova-compute[73469]:   <cpu mode="custom" match="exact">
Aug 22 03:42:34 user nova-compute[73469]:     <model>Nehalem</model>
Aug 22 03:42:34 user nova-compute[73469]:     <topology sockets="1" cores="1" threads="1"/>
Aug 22 03:42:34 user nova-compute[73469]:   </cpu>
Aug 22 03:42:34 user nova-compute[73469]:   <devices>
Aug 22 03:42:34 user nova-compute[73469]:     <disk type="file" device="disk">
Aug 22 03:42:34 user nova-compute[73469]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 22 03:42:34 user nova-compute[73469]:       <source file="/opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk"/>
Aug 22 03:42:34 user nova-compute[73469]:       <target dev="vda" bus="virtio"/>
Aug 22 03:42:34 user nova-compute[73469]:     </disk>
Aug 22 03:42:34 user nova-compute[73469]:     <interface type="ethernet">
Aug 22 03:42:34 user nova-compute[73469]:       <mac address="fa:16:3e:86:88:33"/>
Aug 22 03:42:34 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:42:34 user nova-compute[73469]:       <mtu size="1442"/>
Aug 22 03:42:34 user nova-compute[73469]:       <target dev="tap84cea14f-ce"/>
Aug 22 03:42:34 user nova-compute[73469]:     </interface>
Aug 22 03:42:34 user nova-compute[73469]:     <serial type="pty">
Aug 22 03:42:34 user nova-compute[73469]:       <log file="/opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/console.log" append="off"/>
Aug 22 03:42:34 user nova-compute[73469]:     </serial>
Aug 22 03:42:34 user nova-compute[73469]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 22 03:42:34 user nova-compute[73469]:     <video>
Aug 22 03:42:34 user nova-compute[73469]:       <model type="virtio"/>
Aug 22 03:42:34 user nova-compute[73469]:     </video>
Aug 22 03:42:34 user nova-compute[73469]:     <rng model="virtio">
Aug 22 03:42:34 user nova-compute[73469]:       <backend model="random">/dev/urandom</backend>
Aug 22 03:42:34 user nova-compute[73469]:     </rng>
Aug 22 03:42:34 user nova-compute[73469]:     <controller type="usb" index="0" model="none"/>
Aug 22 03:42:34 user nova-compute[73469]:     <memballoon model="virtio">
Aug 22 03:42:34 user nova-compute[73469]:       <stats period="10"/>
Aug 22 03:42:34 user nova-compute[73469]:     </memballoon>
Aug 22 03:42:34 user nova-compute[73469]:   </devices>
Aug 22 03:42:34 user nova-compute[73469]: </domain>
Aug 22 03:42:34 user nova-compute[73469]:  {{(pid=73469) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-809660707',display_name='tempest-SnapshotDataIntegrityTests-server-809660707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-809660707',id=52,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYheovmxUh1nD2wsGpzOSG3odpTyayja1ExTK2Am/xS1+RQV5lrpKn2JAa9BVySYiD9hTJOiaq+GGfKO1WtT+8LU2O/IkMUhrSubyYhg5CeIbtLtHKzhVoUKyt9IjDuQg==',key_name='tempest-keypair-2055205814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce7dfd9509814f1590f608be91963091',ramdisk_id='',reservation_id='r-7z3u1ayq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2037707076',owner_user_name='tempest-SnapshotDataIntegrityTests-2037707076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-22T03:42:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='647e364e3e3741be8e4fe1147be0e1fc',uuid=f589227e-36da-4c1f-a7a2-24e127334878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84cea14f-ce54-4963-9780-22222a629ed8", "address": "fa:16:3e:86:88:33", "network": {"id": "517d5945-86ef-47c8-b258-f12e64cfcfaf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-126195591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7dfd9509814f1590f608be91963091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cea14f-ce", "ovs_interfaceid": "84cea14f-ce54-4963-9780-22222a629ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Converting VIF {"id": "84cea14f-ce54-4963-9780-22222a629ed8", "address": "fa:16:3e:86:88:33", "network": {"id": "517d5945-86ef-47c8-b258-f12e64cfcfaf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-126195591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7dfd9509814f1590f608be91963091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cea14f-ce", "ovs_interfaceid": "84cea14f-ce54-4963-9780-22222a629ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:88:33,bridge_name='br-int',has_traffic_filtering=True,id=84cea14f-ce54-4963-9780-22222a629ed8,network=Network(517d5945-86ef-47c8-b258-f12e64cfcfaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cea14f-ce') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG os_vif [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:88:33,bridge_name='br-int',has_traffic_filtering=True,id=84cea14f-ce54-4963-9780-22222a629ed8,network=Network(517d5945-86ef-47c8-b258-f12e64cfcfaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cea14f-ce') {{(pid=73469) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84cea14f-ce, may_exist=True, interface_attrs={}) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84cea14f-ce, col_values=(('external_ids', {'iface-id': '84cea14f-ce54-4963-9780-22222a629ed8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:88:33', 'vm-uuid': 'f589227e-36da-4c1f-a7a2-24e127334878'}),), if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:34 user nova-compute[73469]: INFO os_vif [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:88:33,bridge_name='br-int',has_traffic_filtering=True,id=84cea14f-ce54-4963-9780-22222a629ed8,network=Network(517d5945-86ef-47c8-b258-f12e64cfcfaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cea14f-ce')
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:42:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] No VIF found with MAC fa:16:3e:86:88:33, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:42:35 user nova-compute[73469]: DEBUG nova.network.neutron [req-9b89ede0-7bb8-45ff-abad-80137e9ccba8 req-7f008bb7-930f-4651-88e5-5179e4d50078 service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updated VIF entry in instance network info cache for port 84cea14f-ce54-4963-9780-22222a629ed8. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:42:35 user nova-compute[73469]: DEBUG nova.network.neutron [req-9b89ede0-7bb8-45ff-abad-80137e9ccba8 req-7f008bb7-930f-4651-88e5-5179e4d50078 service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updating instance_info_cache with network_info: [{"id": "84cea14f-ce54-4963-9780-22222a629ed8", "address": "fa:16:3e:86:88:33", "network": {"id": "517d5945-86ef-47c8-b258-f12e64cfcfaf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-126195591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7dfd9509814f1590f608be91963091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cea14f-ce", "ovs_interfaceid": "84cea14f-ce54-4963-9780-22222a629ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:42:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-9b89ede0-7bb8-45ff-abad-80137e9ccba8 req-7f008bb7-930f-4651-88e5-5179e4d50078 service nova] Releasing lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:42:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-0508a989-61ea-4bd4-ad73-d807c805a341 req-9f8d2a53-0c83-47cb-98a7-99a060052d26 service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Received event network-vif-plugged-84cea14f-ce54-4963-9780-22222a629ed8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:42:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0508a989-61ea-4bd4-ad73-d807c805a341 req-9f8d2a53-0c83-47cb-98a7-99a060052d26 service nova] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:42:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0508a989-61ea-4bd4-ad73-d807c805a341 req-9f8d2a53-0c83-47cb-98a7-99a060052d26 service nova] Lock "f589227e-36da-4c1f-a7a2-24e127334878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:42:36 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-0508a989-61ea-4bd4-ad73-d807c805a341 req-9f8d2a53-0c83-47cb-98a7-99a060052d26 service nova] Lock "f589227e-36da-4c1f-a7a2-24e127334878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:42:36 user nova-compute[73469]: DEBUG nova.compute.manager [req-0508a989-61ea-4bd4-ad73-d807c805a341 req-9f8d2a53-0c83-47cb-98a7-99a060052d26 service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] No waiting events found dispatching network-vif-plugged-84cea14f-ce54-4963-9780-22222a629ed8 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:42:36 user nova-compute[73469]: WARNING nova.compute.manager [req-0508a989-61ea-4bd4-ad73-d807c805a341 req-9f8d2a53-0c83-47cb-98a7-99a060052d26 service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Received unexpected event network-vif-plugged-84cea14f-ce54-4963-9780-22222a629ed8 for instance with vm_state building and task_state spawning.
Aug 22 03:42:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:36 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:38 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692675758.325375, f589227e-36da-4c1f-a7a2-24e127334878 => Resumed> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:42:38 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] VM Resumed (Lifecycle Event)
Aug 22 03:42:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Instance event wait completed in 0 seconds for  {{(pid=73469) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 22 03:42:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Guest created on hypervisor {{(pid=73469) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 22 03:42:38 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Instance spawned successfully.
Aug 22 03:42:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 22 03:42:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-f379c6a8-8fd3-4f8c-b3cc-7d22ccef5060 req-39d7354a-7e88-4f89-a1dd-56b22fa3e49d service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Received event network-vif-plugged-84cea14f-ce54-4963-9780-22222a629ed8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:42:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f379c6a8-8fd3-4f8c-b3cc-7d22ccef5060 req-39d7354a-7e88-4f89-a1dd-56b22fa3e49d service nova] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:42:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f379c6a8-8fd3-4f8c-b3cc-7d22ccef5060 req-39d7354a-7e88-4f89-a1dd-56b22fa3e49d service nova] Lock "f589227e-36da-4c1f-a7a2-24e127334878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:42:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f379c6a8-8fd3-4f8c-b3cc-7d22ccef5060 req-39d7354a-7e88-4f89-a1dd-56b22fa3e49d service nova] Lock "f589227e-36da-4c1f-a7a2-24e127334878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:42:38 user nova-compute[73469]: DEBUG nova.compute.manager [req-f379c6a8-8fd3-4f8c-b3cc-7d22ccef5060 req-39d7354a-7e88-4f89-a1dd-56b22fa3e49d service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] No waiting events found dispatching network-vif-plugged-84cea14f-ce54-4963-9780-22222a629ed8 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:42:38 user nova-compute[73469]: WARNING nova.compute.manager [req-f379c6a8-8fd3-4f8c-b3cc-7d22ccef5060 req-39d7354a-7e88-4f89-a1dd-56b22fa3e49d service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Received unexpected event network-vif-plugged-84cea14f-ce54-4963-9780-22222a629ed8 for instance with vm_state building and task_state spawning.
Aug 22 03:42:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:42:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:42:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Found default for hw_cdrom_bus of ide {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:42:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Found default for hw_disk_bus of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:42:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Found default for hw_input_bus of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:42:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Found default for hw_pointer_model of None {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:42:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Found default for hw_video_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:42:38 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Found default for hw_vif_model of virtio {{(pid=73469) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 22 03:42:38 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:42:38 user nova-compute[73469]: DEBUG nova.virt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Emitting event <LifecycleEvent: 1692675758.3330998, f589227e-36da-4c1f-a7a2-24e127334878 => Started> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:42:38 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] VM Started (Lifecycle Event)
Aug 22 03:42:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:42:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73469) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 22 03:42:38 user nova-compute[73469]: INFO nova.compute.manager [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 22 03:42:38 user nova-compute[73469]: INFO nova.compute.manager [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Took 5.57 seconds to spawn the instance on the hypervisor.
Aug 22 03:42:38 user nova-compute[73469]: DEBUG nova.compute.manager [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:42:38 user nova-compute[73469]: INFO nova.compute.manager [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Took 6.35 seconds to build instance.
Aug 22 03:42:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-9ec97756-fbd7-44db-b161-5b0a08978447 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.442s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:42:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:42:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:43:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:43:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:43:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:43:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:43:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:43:15 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:43:18 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:43:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:43:22 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:43:23 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:43:23 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:43:24 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:43:24 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:43:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:43:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:43:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:43:24 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:43:24 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:43:24 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:43:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:43:25 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updating instance_info_cache with network_info: [{"id": "84cea14f-ce54-4963-9780-22222a629ed8", "address": "fa:16:3e:86:88:33", "network": {"id": "517d5945-86ef-47c8-b258-f12e64cfcfaf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-126195591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7dfd9509814f1590f608be91963091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cea14f-ce", "ovs_interfaceid": "84cea14f-ce54-4963-9780-22222a629ed8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:43:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:43:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:43:25 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:43:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:43:26 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:43:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:43:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:43:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:43:26 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:43:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:43:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:43:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:43:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:43:27 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:43:27 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:43:27 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8744MB free_disk=25.07585906982422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:43:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:43:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:43:27 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f589227e-36da-4c1f-a7a2-24e127334878 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:43:27 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:43:27 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:43:27 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:43:27 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:43:27 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:43:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:43:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:43:31 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:43:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:43:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:43:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:43:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:43:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:43:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:44:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:44:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:44:11 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:44:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:44:16 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:44:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:44:20 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:44:21 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:44:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 22 03:44:21 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] There are 0 instances to clean {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 22 03:44:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-f2ce7138-6664-4692-8ddb-7f9c56409f7a req-fb1d8130-cec8-4dd9-b6b7-b533fc9ee9b1 service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Received event network-changed-84cea14f-ce54-4963-9780-22222a629ed8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:44:23 user nova-compute[73469]: DEBUG nova.compute.manager [req-f2ce7138-6664-4692-8ddb-7f9c56409f7a req-fb1d8130-cec8-4dd9-b6b7-b533fc9ee9b1 service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Refreshing instance network info cache due to event network-changed-84cea14f-ce54-4963-9780-22222a629ed8. {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 22 03:44:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f2ce7138-6664-4692-8ddb-7f9c56409f7a req-fb1d8130-cec8-4dd9-b6b7-b533fc9ee9b1 service nova] Acquiring lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:44:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f2ce7138-6664-4692-8ddb-7f9c56409f7a req-fb1d8130-cec8-4dd9-b6b7-b533fc9ee9b1 service nova] Acquired lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:44:23 user nova-compute[73469]: DEBUG nova.network.neutron [req-f2ce7138-6664-4692-8ddb-7f9c56409f7a req-fb1d8130-cec8-4dd9-b6b7-b533fc9ee9b1 service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Refreshing network info cache for port 84cea14f-ce54-4963-9780-22222a629ed8 {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 22 03:44:23 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:44:23 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:44:23 user nova-compute[73469]: DEBUG nova.network.neutron [req-f2ce7138-6664-4692-8ddb-7f9c56409f7a req-fb1d8130-cec8-4dd9-b6b7-b533fc9ee9b1 service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updated VIF entry in instance network info cache for port 84cea14f-ce54-4963-9780-22222a629ed8. {{(pid=73469) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 22 03:44:23 user nova-compute[73469]: DEBUG nova.network.neutron [req-f2ce7138-6664-4692-8ddb-7f9c56409f7a req-fb1d8130-cec8-4dd9-b6b7-b533fc9ee9b1 service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updating instance_info_cache with network_info: [{"id": "84cea14f-ce54-4963-9780-22222a629ed8", "address": "fa:16:3e:86:88:33", "network": {"id": "517d5945-86ef-47c8-b258-f12e64cfcfaf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-126195591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7dfd9509814f1590f608be91963091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cea14f-ce", "ovs_interfaceid": "84cea14f-ce54-4963-9780-22222a629ed8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:44:23 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-f2ce7138-6664-4692-8ddb-7f9c56409f7a req-fb1d8130-cec8-4dd9-b6b7-b533fc9ee9b1 service nova] Releasing lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:44:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:44:24 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:44:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:44:24 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:44:24 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 22 03:44:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:44:25 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:44:25 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:44:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:44:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:44:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:44:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:44:25 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:44:25 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:44:26 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updating instance_info_cache with network_info: [{"id": "84cea14f-ce54-4963-9780-22222a629ed8", "address": "fa:16:3e:86:88:33", "network": {"id": "517d5945-86ef-47c8-b258-f12e64cfcfaf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-126195591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7dfd9509814f1590f608be91963091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cea14f-ce", "ovs_interfaceid": "84cea14f-ce54-4963-9780-22222a629ed8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:44:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:44:26 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:44:26 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:44:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:44:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:44:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:44:26 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:44:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:44:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:44:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:44:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:44:27 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:44:27 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:44:27 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=25.07518768310547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:44:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:44:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:44:27 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f589227e-36da-4c1f-a7a2-24e127334878 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:44:27 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:44:27 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:44:27 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:44:27 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:44:27 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:44:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:44:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:44:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:44:28 user nova-compute[73469]: DEBUG nova.objects.instance [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lazy-loading 'flavor' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:44:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:44:29 user nova-compute[73469]: INFO nova.compute.manager [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Attaching volume cc98388b-7c7c-4570-a915-c4e4001048f3 to /dev/vdb
Aug 22 03:44:29 user nova-compute[73469]: DEBUG os_brick.utils [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[df00b018-c8d0-4f41-b9f3-3daaa369f57e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a555cd87-d8ee-4427-bf25-85c4f1cf63b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d99437-3ad7-4352-8c35-24eea364bf9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d604a430-8325-49e8-932c-22871e916331]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:44:29 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:44:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c560609-ab1a-42c0-b5f5-f77c56a58527]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG os_brick.utils [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updating existing volume attachment record: 4d23a2ea-2fcd-4273-bfe3-a796aa679371 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:44:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:44:33 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:44:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:44:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xRlhCvrb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:44:39 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:44:39 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:44:39 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e93e0ca-f149-4c7a-981d-4994e1ab13c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:44:39 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[610836e1-a243-49b9-a7e2-9f2ceec57db7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3] added
Aug 22 03:44:39 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b95079-568d-4b06-a964-bb9ab427aa89]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5259e3af-69c3-4a18-98cc-89143586f28a]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xRlhCvrb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xRlhCvrb" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b5bd82-cb47-4a18-8435-fa0bf35f1022]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xRlhCvrb'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[779c468a-54c6-4b28-b869-61b306a4f73f]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f119cf66-ccf5-43f2-9bf3-dc1e8cb7cd26]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:44:39 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:44:39 user nova-compute[73469]:  {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:44:39 user nova-compute[73469]: WARNING os_brick.initiator.connectors.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 22 03:44:39 user nova-compute[73469]: 
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[979d704e-02c0-4221-9ae9-631d7c9bdc75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3, portal: 172.16.0.220,3260]
Aug 22 03:44:39 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3, portal: 172.16.0.220,3260] successful.
Aug 22 03:44:39 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a745fc79-65ac-4151-b33a-83811b4f78bd]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b77a60-28df-4541-8fb1-45e0777be6fb]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 (non-flash)
Aug 22 03:44:39 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 (non-flash)
Aug 22 03:44:39 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7836b1a1-6204-4960-ac28-14c3c0c4ada3]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:44:39 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xRlhCvrb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:44:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:44:40 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23963636537373837', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:44:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963636537373837', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:44:40 user nova-compute[73469]: DEBUG nova.objects.instance [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lazy-loading 'flavor' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:44:40 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:44:40 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:44:40 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:44:40 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:44:40 user nova-compute[73469]:   <serial>cc98388b-7c7c-4570-a915-c4e4001048f3</serial>
Aug 22 03:44:40 user nova-compute[73469]: </disk>
Aug 22 03:44:40 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:44:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:44:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:44:41 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] No VIF found with MAC fa:16:3e:86:88:33, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:44:41 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-021349bb-81e8-4f63-8b32-149d9ebf942c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.549s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:44:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:44:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:44:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:44:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:44:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:44:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:45:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:45:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:45:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:45:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:45:10 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:45:10 user nova-compute[73469]: INFO nova.compute.manager [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Detaching volume cc98388b-7c7c-4570-a915-c4e4001048f3
Aug 22 03:45:10 user nova-compute[73469]: INFO nova.virt.block_device [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Attempting to driver detach volume cc98388b-7c7c-4570-a915-c4e4001048f3 from mountpoint /dev/vdb
Aug 22 03:45:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Attempting to detach device vdb from instance f589227e-36da-4c1f-a7a2-24e127334878 from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:45:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:45:10 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:45:10 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:45:10 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:45:10 user nova-compute[73469]:   <serial>cc98388b-7c7c-4570-a915-c4e4001048f3</serial>
Aug 22 03:45:10 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:45:10 user nova-compute[73469]: </disk>
Aug 22 03:45:10 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:45:10 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Successfully detached device vdb from instance f589227e-36da-4c1f-a7a2-24e127334878 from the persistent domain config.
Aug 22 03:45:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f589227e-36da-4c1f-a7a2-24e127334878 from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:45:10 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:45:10 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:45:10 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:45:10 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:45:10 user nova-compute[73469]:   <serial>cc98388b-7c7c-4570-a915-c4e4001048f3</serial>
Aug 22 03:45:10 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:45:10 user nova-compute[73469]: </disk>
Aug 22 03:45:10 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692675911.0051684, f589227e-36da-4c1f-a7a2-24e127334878 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:45:11 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Successfully detached device vdb from instance f589227e-36da-4c1f-a7a2-24e127334878 from the live domain config.
Aug 22 03:45:11 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xRlhCvrb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:45:11 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:45:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19c7ee7-d066-4924-bfc5-282cd62de80f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0e507a-eb8c-4acc-b5c1-46ae10dca180]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 (non-flash)
Aug 22 03:45:11 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 (non-flash)
Aug 22 03:45:11 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79805c15a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[94392cc0-af72-421c-84f1-697e2c19c969]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a068b08-2efe-4f54-baaf-336002355395]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f1750f-33b3-45c4-ba34-fea8281727c8]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[827421b9-ef32-464f-9376-041c27dadf57]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07de395-c468-4165-9954-b7c937cd6d68]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7cdd3e-c44a-417d-a074-ffe1b33381e9]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3, portal: 172.16.0.220,3260]
Aug 22 03:45:11 user nova-compute[73469]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3, portal: 172.16.0.220,3260] successful.
Aug 22 03:45:11 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc98388b-7c7c-4570-a915-c4e4001048f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a246cdf1-9a79-4ed8-ba87-81c206afcd29]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] <== disconnect_volume: return (263ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:45:11 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:45:12 user nova-compute[73469]: DEBUG nova.objects.instance [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lazy-loading 'flavor' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:45:12 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-65527156-3537-4149-b753-04ad4bb54b7d tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.588s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:45:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:45:16 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:45:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:45:22 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:45:23 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:45:24 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:45:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:45:25 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:45:25 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:45:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:45:25 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:45:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:45:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:45:25 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:45:25 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:45:26 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updating instance_info_cache with network_info: [{"id": "84cea14f-ce54-4963-9780-22222a629ed8", "address": "fa:16:3e:86:88:33", "network": {"id": "517d5945-86ef-47c8-b258-f12e64cfcfaf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-126195591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7dfd9509814f1590f608be91963091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cea14f-ce", "ovs_interfaceid": "84cea14f-ce54-4963-9780-22222a629ed8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:45:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:45:26 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:45:26 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:45:26 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:45:26 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:45:26 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:45:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:45:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:45:26 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:45:26 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:45:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:45:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:45:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:45:26 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:45:27 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:45:27 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:45:27 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8777MB free_disk=25.073863983154297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:45:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:45:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:45:27 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f589227e-36da-4c1f-a7a2-24e127334878 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:45:27 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:45:27 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:45:27 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing inventories for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 22 03:45:27 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Updating ProviderTree inventory for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 22 03:45:27 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Updating inventory in ProviderTree for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 22 03:45:27 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing aggregate associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, aggregates: None {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 22 03:45:27 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing trait associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 22 03:45:27 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:45:27 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:45:27 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:45:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:45:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:45:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:45:35 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:45:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:45:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:45:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:45:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:45:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lazy-loading 'flavor' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:46:04 user nova-compute[73469]: INFO nova.compute.manager [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Attaching volume 58dba4ba-551b-4815-bc64-52aaa82f6a30 to /dev/vdb
Aug 22 03:46:04 user nova-compute[73469]: DEBUG os_brick.utils [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ba470d-29fa-4ee9-b58c-5666a4b22ea6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[979bd48e-4fe5-491e-be17-7e13cdfda937]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[36206b64-fd0b-4b3d-a58d-57422fb10ae6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7102569-4e36-43e7-ad47-3477c49973a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:46:04 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:46:04 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06518a7-ab30-48c2-8281-fa6948a59f33]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG os_brick.utils [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:46:04 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updating existing volume attachment record: 69404d9b-9bc1-442e-b6d3-728bd33cb015 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:46:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:46:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:46:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:46:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGYzVMEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:46:15 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:46:15 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:46:15 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c621451f-4b35-4a82-b977-865c62d3267b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:46:15 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0525c2ff-f9df-4dd3-b723-a0f2501ef103]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30] added
Aug 22 03:46:15 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24caa68-9bda-4af9-9dbf-a601085ef26b]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b9e140-12e2-4485-be8a-ca81ca047781]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OGYzVMEK {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OGYzVMEK" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb18b1f8-e787-4414-b144-16816f8fc3db]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OGYzVMEK'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[525911b7-28e3-4aad-b262-9dd7567f0bc3]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[782aa066-5a67-4acc-85f3-ebdc06284ea0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:46:15 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:46:15 user nova-compute[73469]:  {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:46:15 user nova-compute[73469]: WARNING os_brick.initiator.connectors.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 22 03:46:15 user nova-compute[73469]: 
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1130e1-6543-45d3-945b-9713cd452e6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30, portal: 172.16.0.220,3260]
Aug 22 03:46:15 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30, portal: 172.16.0.220,3260] successful.
Aug 22 03:46:15 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce265415-f0ca-4381-8bfc-45b3c9f05eab]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad96301-53b9-41f2-b9d6-19ec4c8603a1]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 (non-flash)
Aug 22 03:46:15 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 (non-flash)
Aug 22 03:46:15 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d018b4-9ed7-4e0a-993f-1918c174dbe2]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:46:15 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGYzVMEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:46:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:46:16 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26264656536386332', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:46:16 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264656536386332', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:46:16 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lazy-loading 'flavor' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:46:16 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:46:16 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:46:16 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:46:16 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:46:16 user nova-compute[73469]:   <serial>58dba4ba-551b-4815-bc64-52aaa82f6a30</serial>
Aug 22 03:46:16 user nova-compute[73469]: </disk>
Aug 22 03:46:16 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:46:16 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:46:16 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:46:16 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] No VIF found with MAC fa:16:3e:86:88:33, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:46:17 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e66f747-af4a-478e-a35f-65802f7134a2 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.225s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:46:18 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:46:19 user nova-compute[73469]: INFO nova.compute.manager [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Detaching volume 58dba4ba-551b-4815-bc64-52aaa82f6a30
Aug 22 03:46:19 user nova-compute[73469]: INFO nova.virt.block_device [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Attempting to driver detach volume 58dba4ba-551b-4815-bc64-52aaa82f6a30 from mountpoint /dev/vdb
Aug 22 03:46:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Attempting to detach device vdb from instance f589227e-36da-4c1f-a7a2-24e127334878 from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:46:19 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:46:19 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:46:19 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:46:19 user nova-compute[73469]:   <serial>58dba4ba-551b-4815-bc64-52aaa82f6a30</serial>
Aug 22 03:46:19 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:46:19 user nova-compute[73469]: </disk>
Aug 22 03:46:19 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:46:19 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Successfully detached device vdb from instance f589227e-36da-4c1f-a7a2-24e127334878 from the persistent domain config.
Aug 22 03:46:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f589227e-36da-4c1f-a7a2-24e127334878 from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:46:19 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:46:19 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:46:19 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:46:19 user nova-compute[73469]:   <serial>58dba4ba-551b-4815-bc64-52aaa82f6a30</serial>
Aug 22 03:46:19 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:46:19 user nova-compute[73469]: </disk>
Aug 22 03:46:19 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692675979.6646008, f589227e-36da-4c1f-a7a2-24e127334878 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:46:19 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Successfully detached device vdb from instance f589227e-36da-4c1f-a7a2-24e127334878 from the live domain config.
Aug 22 03:46:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGYzVMEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:46:19 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:46:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe893feb-cab5-40eb-82c2-d866cdb8bf0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f326b110-12e7-454f-b87a-dd09e9591270]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 (non-flash)
Aug 22 03:46:19 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 (non-flash)
Aug 22 03:46:19 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79805c0dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5078d9f4-7ad3-453f-b8b7-242a33f4d555]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e067cb-80bb-435d-b179-b8a682e17537]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a9ef9f-cc51-4d5e-98fc-577fcfc9c3a0]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d09a396-7337-43e6-8c76-39ea1c643ce9]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf3454c-40ea-47a2-a182-dff26e9ff370]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4287b0-1b17-4dfe-8f46-32e7e9b143d8]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30, portal: 172.16.0.220,3260]
Aug 22 03:46:19 user nova-compute[73469]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30, portal: 172.16.0.220,3260] successful.
Aug 22 03:46:19 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dba4ba-551b-4815-bc64-52aaa82f6a30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaded736-84b3-4e83-b1f6-b2f3c434b3f0]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] <== disconnect_volume: return (263ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:46:19 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:46:20 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lazy-loading 'flavor' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:46:20 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ba7b531e-03f7-4d8c-8698-86406360bf60 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.634s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:46:23 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:46:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:46:25 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:46:26 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:46:27 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:46:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:46:27 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:46:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:46:27 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:46:27 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:46:27 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:46:28 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updating instance_info_cache with network_info: [{"id": "84cea14f-ce54-4963-9780-22222a629ed8", "address": "fa:16:3e:86:88:33", "network": {"id": "517d5945-86ef-47c8-b258-f12e64cfcfaf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-126195591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7dfd9509814f1590f608be91963091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cea14f-ce", "ovs_interfaceid": "84cea14f-ce54-4963-9780-22222a629ed8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:46:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:46:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:46:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:46:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:46:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:46:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:46:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:46:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:46:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:46:28 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:46:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:46:28 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:46:29 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:46:29 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:46:29 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8775MB free_disk=25.07284164428711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:46:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:46:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:46:29 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f589227e-36da-4c1f-a7a2-24e127334878 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:46:29 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:46:29 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:46:29 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:46:29 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:46:29 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:46:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:46:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:46:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:46:35 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:46:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:46:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:46:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:46:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:46:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:47:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:47:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG nova.objects.instance [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lazy-loading 'flavor' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:47:13 user nova-compute[73469]: INFO nova.compute.manager [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Attaching volume b473e012-fdc0-46b7-98b1-ec0aa16b35d1 to /dev/vdb
Aug 22 03:47:13 user nova-compute[73469]: DEBUG os_brick.utils [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[24773dba-e449-4640-9fed-78585ea3f2dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bced79-9be8-40b7-91ad-84b615a1ccc6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[813b6961-c900-44bd-a7e5-7e142a3c4e82]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[3910288f-9634-4f09-9427-780568a2647b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:47:13 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:47:13 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7859ba24-36f3-4b40-a47f-028c2acf5943]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG os_brick.utils [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:47:13 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updating existing volume attachment record: 4d7b5998-1220-4abd-afeb-0c3f429a155d {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:47:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:47:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:47:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:47:20 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:47:23 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWnFABcu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:47:24 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:47:24 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:47:24 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3989b6-716b-4141-acae-7efa7e28a266]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:47:24 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[855f77ea-1f67-4ca2-ac57-27fcf1a9c695]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1] added
Aug 22 03:47:24 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc6ac68-2f61-4d99-9e60-9e7b8f857da8]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f7ef08-0b89-4995-bd80-94a95be06522]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWnFABcu {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWnFABcu" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6bf976-f604-4e0e-a906-1053b34aa309]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IWnFABcu'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a89f28e-f7b1-4ec7-93f1-f89a4b4939b1]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8961f9e4-332c-4681-80f0-5ddcd8d4c1e2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:47:24 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:47:24 user nova-compute[73469]:  {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:47:24 user nova-compute[73469]: WARNING os_brick.initiator.connectors.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 22 03:47:24 user nova-compute[73469]: 
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c2af14-f052-48a7-b411-668e212dcee9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1, portal: 172.16.0.220,3260]
Aug 22 03:47:24 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1, portal: 172.16.0.220,3260] successful.
Aug 22 03:47:24 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[d161278a-4b86-4253-a22b-4fc3d9be89d9]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[158a751b-d9f7-4486-86f6-6ad6f6460ce2]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 (non-flash)
Aug 22 03:47:24 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 (non-flash)
Aug 22 03:47:24 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c427bcf0-9778-4f23-aa15-d608b2195030]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:47:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:47:25 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:47:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWnFABcu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:47:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:47:25 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23136633736636162', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:47:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136633736636162', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:47:25 user nova-compute[73469]: DEBUG nova.objects.instance [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lazy-loading 'flavor' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:47:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:47:25 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:47:25 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:47:25 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:47:25 user nova-compute[73469]:   <serial>b473e012-fdc0-46b7-98b1-ec0aa16b35d1</serial>
Aug 22 03:47:25 user nova-compute[73469]: </disk>
Aug 22 03:47:25 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:47:25 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:47:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:47:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:47:25 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] No VIF found with MAC fa:16:3e:86:88:33, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:47:25 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-d22b6167-ab83-427e-9b1a-131dfcac997c tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.287s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:47:26 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:47:26 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:47:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:47:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:47:28 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:47:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:47:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:47:28 user nova-compute[73469]: INFO nova.compute.manager [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Detaching volume b473e012-fdc0-46b7-98b1-ec0aa16b35d1
Aug 22 03:47:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:47:28 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:47:28 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:47:28 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:47:28 user nova-compute[73469]: INFO nova.virt.block_device [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Attempting to driver detach volume b473e012-fdc0-46b7-98b1-ec0aa16b35d1 from mountpoint /dev/vdb
Aug 22 03:47:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Attempting to detach device vdb from instance f589227e-36da-4c1f-a7a2-24e127334878 from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:47:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:47:28 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:47:28 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:47:28 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:47:28 user nova-compute[73469]:   <serial>b473e012-fdc0-46b7-98b1-ec0aa16b35d1</serial>
Aug 22 03:47:28 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:47:28 user nova-compute[73469]: </disk>
Aug 22 03:47:28 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:47:28 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Successfully detached device vdb from instance f589227e-36da-4c1f-a7a2-24e127334878 from the persistent domain config.
Aug 22 03:47:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f589227e-36da-4c1f-a7a2-24e127334878 from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:47:28 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:47:28 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:47:28 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:47:28 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:47:28 user nova-compute[73469]:   <serial>b473e012-fdc0-46b7-98b1-ec0aa16b35d1</serial>
Aug 22 03:47:28 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:47:28 user nova-compute[73469]: </disk>
Aug 22 03:47:28 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updating instance_info_cache with network_info: [{"id": "84cea14f-ce54-4963-9780-22222a629ed8", "address": "fa:16:3e:86:88:33", "network": {"id": "517d5945-86ef-47c8-b258-f12e64cfcfaf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-126195591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7dfd9509814f1590f608be91963091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cea14f-ce", "ovs_interfaceid": "84cea14f-ce54-4963-9780-22222a629ed8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692676049.0907204, f589227e-36da-4c1f-a7a2-24e127334878 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:47:29 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Successfully detached device vdb from instance f589227e-36da-4c1f-a7a2-24e127334878 from the live domain config.
Aug 22 03:47:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWnFABcu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:47:29 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:47:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7f11ad-082e-485f-a64e-73d5df7ad43a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c51661f-6d26-4c20-800f-a837f2e71a1e]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 (non-flash)
Aug 22 03:47:29 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 (non-flash)
Aug 22 03:47:29 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79805c39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c7f115-bceb-46de-911b-3b896ae6931f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0195c2-222e-405f-9803-c91fa7b82e69]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7be1031-f701-4e7f-be30-8246e54c3afc]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e033e4c-0ea1-4476-843f-7578e7a225fd]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a4d5cb-739b-4fec-a80b-923db23a4579]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[899dddff-9454-4aa1-8afc-541195192d98]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1, portal: 172.16.0.220,3260]
Aug 22 03:47:29 user nova-compute[73469]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1, portal: 172.16.0.220,3260] successful.
Aug 22 03:47:29 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b473e012-fdc0-46b7-98b1-ec0aa16b35d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b955cbb7-9a28-4d4f-a46c-c23b1d23b583]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] <== disconnect_volume: return (290ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:47:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:47:30 user nova-compute[73469]: DEBUG nova.objects.instance [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lazy-loading 'flavor' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:47:30 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:47:30 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:47:30 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8748MB free_disk=25.071819305419922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:47:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:47:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:47:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-37ce19bd-d047-4394-b376-ddf0879512bc tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.819s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:47:30 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f589227e-36da-4c1f-a7a2-24e127334878 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:47:30 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:47:30 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:47:30 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:47:30 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:47:30 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:47:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:47:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:47:36 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:47:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:47:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:47:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:47:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:47:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:48:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:48:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:48:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:48:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lazy-loading 'flavor' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:48:22 user nova-compute[73469]: INFO nova.compute.manager [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Attaching volume 4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 to /dev/vdb
Aug 22 03:48:22 user nova-compute[73469]: DEBUG os_brick.utils [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a343062-7e9d-4788-90ab-5dc34d87990a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:891f97f3ceaa\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c73e5b-411a-48c0-8041-22287a6899a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa5e8e5-7cba-477f-a79e-220c911344d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4574317-15a8-403e-9218-c38ad7553e4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Running cmd (subprocess): nvme version {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] 'nvme version' failed. Not Retrying. {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] nvme not present on system {{(pid=73469) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 22 03:48:22 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:23 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 22 03:48:23 user nova-compute[73469]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 22 03:48:23 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca5ae79-8a13-495d-988d-3499645656e4]: (4, '') {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:23 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73469) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 22 03:48:23 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 22 03:48:23 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.lightos [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] LIGHTOS: no hostnqn found. {{(pid=73469) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 22 03:48:23 user nova-compute[73469]: DEBUG os_brick.utils [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:891f97f3ceaa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:48:23 user nova-compute[73469]: DEBUG nova.virt.block_device [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updating existing volume attachment record: e8f5895a-1011-49a2-b550-5ed585804125 {{(pid=73469) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 22 03:48:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:48:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:48:25 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:48:27 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:48:27 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:48:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:48:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:48:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:48:30 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:48:30 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:48:30 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:48:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:48:30 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:48:30 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:48:30 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:48:31 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updating instance_info_cache with network_info: [{"id": "84cea14f-ce54-4963-9780-22222a629ed8", "address": "fa:16:3e:86:88:33", "network": {"id": "517d5945-86ef-47c8-b258-f12e64cfcfaf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-126195591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7dfd9509814f1590f608be91963091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cea14f-ce", "ovs_interfaceid": "84cea14f-ce54-4963-9780-22222a629ed8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:48:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:48:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:48:31 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:48:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:48:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:48:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:48:31 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:48:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:31 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:32 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:48:32 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:48:32 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8773MB free_disk=25.071006774902344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:48:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:48:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:48:32 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f589227e-36da-4c1f-a7a2-24e127334878 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:48:32 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:48:32 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:48:32 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:48:32 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:48:32 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:48:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:48:32 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:48:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Calling os-brick to attach iSCSI Volume {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQsTzueX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:48:33 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:48:33 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:48:33 user nova-compute[73469]: INFO os_brick.initiator.connectors.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ad37e3-7a81-4f94-98f1-87ae441b12c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 22 03:48:33 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd06f71-67e8-4eb4-bdb8-256c0e37bfb5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2] added\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2] added
Aug 22 03:48:33 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1a70da-55ae-4154-b180-d453ef8c64a8]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb5d76b-8f1c-4e02-a388-ac1f467612bb]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQsTzueX {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQsTzueX" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[bced033d-fe93-4df5-9e14-eb3398d41679]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kQsTzueX'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1d4f53-6035-4f68-9122-55ea4da49a60]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[83026d04-47d8-4c44-8835-02e881ce256e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:48:33 user nova-compute[73469]:  {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 22 03:48:33 user nova-compute[73469]:  {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:48:33 user nova-compute[73469]: WARNING os_brick.initiator.connectors.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 22 03:48:33 user nova-compute[73469]: 
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --login {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c148a22f-e6d4-4879-ba00-077c0d151012]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2, portal: 172.16.0.220,3260]
Aug 22 03:48:33 user nova-compute[73469]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2, portal: 172.16.0.220,3260] successful.
Aug 22 03:48:33 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e175ed0-ef62-48dc-b466-6172fa6a8ff4]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[059d3907-cdd5-4d94-8471-a880354857b0]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 (non-flash)
Aug 22 03:48:33 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 (non-flash)
Aug 22 03:48:33 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Connected to 172.16.0.220:3260 {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=73469) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73469) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[600e3e33-8d43-488c-8c1a-767ea3c98f64]: (4, ('- - 0', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:33 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:48:34 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73469) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 22 03:48:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQsTzueX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73469) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 22 03:48:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:48:34 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '23439663266386131', 'path': '/dev/sdb'} {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:48:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439663266386131', 'path': '/dev/sdb'} {{(pid=73469) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 22 03:48:34 user nova-compute[73469]: DEBUG nova.objects.instance [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lazy-loading 'flavor' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:48:34 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] attach device xml: <disk type="block" device="disk">
Aug 22 03:48:34 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:48:34 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:48:34 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:48:34 user nova-compute[73469]:   <serial>4b784ffd-6c04-4364-8ba1-ecf6a74a55e2</serial>
Aug 22 03:48:34 user nova-compute[73469]: </disk>
Aug 22 03:48:34 user nova-compute[73469]:  {{(pid=73469) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 22 03:48:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:48:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] No BDM found with device name vda, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:48:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73469) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 22 03:48:35 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] No VIF found with MAC fa:16:3e:86:88:33, not building metadata {{(pid=73469) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 22 03:48:35 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-ba830419-74b6-4553-a670-c44e6dbd2309 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.379s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:48:37 user nova-compute[73469]: INFO nova.compute.manager [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Detaching volume 4b784ffd-6c04-4364-8ba1-ecf6a74a55e2
Aug 22 03:48:37 user nova-compute[73469]: INFO nova.virt.block_device [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Attempting to driver detach volume 4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 from mountpoint /dev/vdb
Aug 22 03:48:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Attempting to detach device vdb from instance f589227e-36da-4c1f-a7a2-24e127334878 from the persistent domain config. {{(pid=73469) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:48:37 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:48:37 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:48:37 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:48:37 user nova-compute[73469]:   <serial>4b784ffd-6c04-4364-8ba1-ecf6a74a55e2</serial>
Aug 22 03:48:37 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:48:37 user nova-compute[73469]: </disk>
Aug 22 03:48:37 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:48:37 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Successfully detached device vdb from instance f589227e-36da-4c1f-a7a2-24e127334878 from the persistent domain config.
Aug 22 03:48:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f589227e-36da-4c1f-a7a2-24e127334878 from the live domain config. {{(pid=73469) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.guest [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] detach device xml: <disk type="block" device="disk">
Aug 22 03:48:37 user nova-compute[73469]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 22 03:48:37 user nova-compute[73469]:   <source dev="/dev/sdb"/>
Aug 22 03:48:37 user nova-compute[73469]:   <target dev="vdb" bus="virtio"/>
Aug 22 03:48:37 user nova-compute[73469]:   <serial>4b784ffd-6c04-4364-8ba1-ecf6a74a55e2</serial>
Aug 22 03:48:37 user nova-compute[73469]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 22 03:48:37 user nova-compute[73469]: </disk>
Aug 22 03:48:37 user nova-compute[73469]:  {{(pid=73469) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-1db47959-2b2f-4261-a4b9-982eb13ab0aa None None] Received event <DeviceRemovedEvent: 1692676117.7011845, f589227e-36da-4c1f-a7a2-24e127334878 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73469) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.driver [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 22 03:48:37 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Successfully detached device vdb from instance f589227e-36da-4c1f-a7a2-24e127334878 from the live domain config.
Aug 22 03:48:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] calling os-brick to detach iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79a46b0220>, {'target_iqns': ['iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQsTzueX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 22 03:48:37 user nova-compute[73469]: WARNING os_brick.initiator.connectors.base [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 22 03:48:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2', 0)] {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[48107ca0-0c97-44c2-922a-b849598d6f8f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[9411be51-6769-4d41-8c91-ddac8ed2d2d3]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 (non-flash)\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 (non-flash)
Aug 22 03:48:37 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 (non-flash)
Aug 22 03:48:37 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79a415c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2'): ({'sdb'}, set())}) {{(pid=73469) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Removing single pathed devices sdb {{(pid=73469) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd4a6b0-ff40-466c-9bda-ae182c8bffb0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b56ab4-ff84-40c6-8aee-746d593d8a87]: (4, ('ok\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Flushing IO for device /dev/sdb {{(pid=73469) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[27438bf5-e0bf-4865-8462-674d93f7e6ea]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73469) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0ece58-ad04-4724-bc20-3e48c8a2eb8b]: (4, ('1', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG os_brick.initiator.linuxscsi [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] SCSI volumes sdb have been removed. {{(pid=73469) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2')] {{(pid=73469) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fa2967-394a-4d17-9f27-42d867e2c127]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --logout {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[06786117-098b-49e7-b3ee-66cba6aff314]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2, portal: 172.16.0.220,3260]
Aug 22 03:48:37 user nova-compute[73469]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2, portal: 172.16.0.220,3260] successful.
Aug 22 03:48:37 user nova-compute[73469]:  stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --op delete {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b784ffd-6c04-4364-8ba1-ecf6a74a55e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d8c1ee-290f-467a-8864-26c54eda2cd2]: (4, ('', '')) {{(pid=84378) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73469) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.base [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG os_brick.initiator.connectors.iscsi [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] <== disconnect_volume: return (271ms) None {{(pid=73469) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 22 03:48:37 user nova-compute[73469]: DEBUG nova.virt.libvirt.volume.iscsi [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Disconnected iSCSI Volume {{(pid=73469) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 22 03:48:38 user nova-compute[73469]: DEBUG nova.objects.instance [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lazy-loading 'flavor' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:48:38 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-080bb9a6-a545-451b-bcd2-7b7f0873ead6 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.591s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:48:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:48:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:48:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:48:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:48:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:48:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:49:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:49:06 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:49:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:49:11 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:49:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:49:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:49:24 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:49:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:49:25 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:49:26 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:49:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:49:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:49:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:49:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 22 03:49:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] There are 0 instances to clean {{(pid=73469) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 22 03:49:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:49:30 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:49:31 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:49:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:49:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:49:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 22 03:49:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquired lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 22 03:49:31 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Forcefully refreshing network info cache for instance {{(pid=73469) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 22 03:49:31 user nova-compute[73469]: DEBUG nova.objects.instance [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lazy-loading 'info_cache' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:49:32 user nova-compute[73469]: DEBUG nova.network.neutron [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updating instance_info_cache with network_info: [{"id": "84cea14f-ce54-4963-9780-22222a629ed8", "address": "fa:16:3e:86:88:33", "network": {"id": "517d5945-86ef-47c8-b258-f12e64cfcfaf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-126195591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7dfd9509814f1590f608be91963091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cea14f-ce", "ovs_interfaceid": "84cea14f-ce54-4963-9780-22222a629ed8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:49:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Releasing lock "refresh_cache-f589227e-36da-4c1f-a7a2-24e127334878" {{(pid=73469) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 22 03:49:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updated the network info_cache for instance {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 22 03:49:32 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:49:32 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:49:32 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:49:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:49:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:49:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:49:32 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:49:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:49:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:49:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 22 03:49:32 user nova-compute[73469]: DEBUG oslo_concurrency.processutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73469) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 22 03:49:33 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:49:33 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:49:33 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8773MB free_disk=25.070178985595703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:49:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:49:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:49:33 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Instance f589227e-36da-4c1f-a7a2-24e127334878 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73469) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 22 03:49:33 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:49:33 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:49:33 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:49:33 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:49:33 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:49:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:49:33 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:49:33 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73469) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 22 03:49:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:49:39 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:49:40 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:49:45 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:49:50 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:49:55 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:49:58 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:49:58 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Triggering sync for uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 22 03:49:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:49:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "f589227e-36da-4c1f-a7a2-24e127334878" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:49:58 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "f589227e-36da-4c1f-a7a2-24e127334878" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:50:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:50:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:50:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:50:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:50:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:50:00 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:50:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:50:10 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:50:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:50:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:50:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:50:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:50:13 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:50:13 user nova-compute[73469]: INFO nova.compute.manager [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Terminating instance
Aug 22 03:50:13 user nova-compute[73469]: DEBUG nova.compute.manager [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Start destroying the instance on the hypervisor. {{(pid=73469) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 22 03:50:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:50:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:50:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:50:13 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:50:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-ab694db6-62e4-43ff-b81c-0f63156de291 req-5135eb27-f39b-4f70-b543-4a92888bafcb service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Received event network-vif-unplugged-84cea14f-ce54-4963-9780-22222a629ed8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:50:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ab694db6-62e4-43ff-b81c-0f63156de291 req-5135eb27-f39b-4f70-b543-4a92888bafcb service nova] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:50:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ab694db6-62e4-43ff-b81c-0f63156de291 req-5135eb27-f39b-4f70-b543-4a92888bafcb service nova] Lock "f589227e-36da-4c1f-a7a2-24e127334878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:50:14 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-ab694db6-62e4-43ff-b81c-0f63156de291 req-5135eb27-f39b-4f70-b543-4a92888bafcb service nova] Lock "f589227e-36da-4c1f-a7a2-24e127334878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:50:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-ab694db6-62e4-43ff-b81c-0f63156de291 req-5135eb27-f39b-4f70-b543-4a92888bafcb service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] No waiting events found dispatching network-vif-unplugged-84cea14f-ce54-4963-9780-22222a629ed8 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:50:14 user nova-compute[73469]: DEBUG nova.compute.manager [req-ab694db6-62e4-43ff-b81c-0f63156de291 req-5135eb27-f39b-4f70-b543-4a92888bafcb service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Received event network-vif-unplugged-84cea14f-ce54-4963-9780-22222a629ed8 for instance with task_state deleting. {{(pid=73469) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 22 03:50:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:50:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:50:14 user nova-compute[73469]: INFO nova.virt.libvirt.driver [-] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Instance destroyed successfully.
Aug 22 03:50:14 user nova-compute[73469]: DEBUG nova.objects.instance [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lazy-loading 'resources' on Instance uuid f589227e-36da-4c1f-a7a2-24e127334878 {{(pid=73469) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 22 03:50:14 user nova-compute[73469]: DEBUG nova.virt.libvirt.vif [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-22T03:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-809660707',display_name='tempest-SnapshotDataIntegrityTests-server-809660707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-809660707',id=52,image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYheovmxUh1nD2wsGpzOSG3odpTyayja1ExTK2Am/xS1+RQV5lrpKn2JAa9BVySYiD9hTJOiaq+GGfKO1WtT+8LU2O/IkMUhrSubyYhg5CeIbtLtHKzhVoUKyt9IjDuQg==',key_name='tempest-keypair-2055205814',keypairs=<?>,launch_index=0,launched_at=2023-08-22T03:42:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce7dfd9509814f1590f608be91963091',ramdisk_id='',reservation_id='r-7z3u1ayq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a2a344d0-c924-4f6a-b6e6-23be8c2d6ded',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2037707076',owner_user_name='tempest-SnapshotDataIntegrityTests-2037707076-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-22T03:42:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='647e364e3e3741be8e4fe1147be0e1fc',uuid=f589227e-36da-4c1f-a7a2-24e127334878,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84cea14f-ce54-4963-9780-22222a629ed8", "address": "fa:16:3e:86:88:33", "network": {"id": "517d5945-86ef-47c8-b258-f12e64cfcfaf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-126195591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7dfd9509814f1590f608be91963091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cea14f-ce", "ovs_interfaceid": "84cea14f-ce54-4963-9780-22222a629ed8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 22 03:50:14 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Converting VIF {"id": "84cea14f-ce54-4963-9780-22222a629ed8", "address": "fa:16:3e:86:88:33", "network": {"id": "517d5945-86ef-47c8-b258-f12e64cfcfaf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-126195591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7dfd9509814f1590f608be91963091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84cea14f-ce", "ovs_interfaceid": "84cea14f-ce54-4963-9780-22222a629ed8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 22 03:50:14 user nova-compute[73469]: DEBUG nova.network.os_vif_util [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:88:33,bridge_name='br-int',has_traffic_filtering=True,id=84cea14f-ce54-4963-9780-22222a629ed8,network=Network(517d5945-86ef-47c8-b258-f12e64cfcfaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cea14f-ce') {{(pid=73469) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 22 03:50:14 user nova-compute[73469]: DEBUG os_vif [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:88:33,bridge_name='br-int',has_traffic_filtering=True,id=84cea14f-ce54-4963-9780-22222a629ed8,network=Network(517d5945-86ef-47c8-b258-f12e64cfcfaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cea14f-ce') {{(pid=73469) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 22 03:50:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:50:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84cea14f-ce, bridge=br-int, if_exists=True) {{(pid=73469) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 22 03:50:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:50:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:50:14 user nova-compute[73469]: INFO os_vif [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:88:33,bridge_name='br-int',has_traffic_filtering=True,id=84cea14f-ce54-4963-9780-22222a629ed8,network=Network(517d5945-86ef-47c8-b258-f12e64cfcfaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84cea14f-ce')
Aug 22 03:50:14 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Deleting instance files /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878_del
Aug 22 03:50:14 user nova-compute[73469]: INFO nova.virt.libvirt.driver [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Deletion of /opt/stack/data/nova/instances/f589227e-36da-4c1f-a7a2-24e127334878_del complete
Aug 22 03:50:14 user nova-compute[73469]: INFO nova.compute.manager [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 22 03:50:14 user nova-compute[73469]: DEBUG oslo.service.loopingcall [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73469) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 22 03:50:14 user nova-compute[73469]: DEBUG nova.compute.manager [-] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Deallocating network for instance {{(pid=73469) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 22 03:50:14 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: f589227e-36da-4c1f-a7a2-24e127334878] deallocate_for_instance() {{(pid=73469) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 22 03:50:15 user nova-compute[73469]: DEBUG nova.network.neutron [-] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Updating instance_info_cache with network_info: [] {{(pid=73469) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 22 03:50:15 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Took 1.15 seconds to deallocate network for instance.
Aug 22 03:50:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:50:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:50:15 user nova-compute[73469]: DEBUG nova.compute.manager [req-beda1881-cf33-4b12-813c-9a08aec472eb req-a02ad4f1-7117-466e-8cc0-704ea03b2690 service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Received event network-vif-deleted-84cea14f-ce54-4963-9780-22222a629ed8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:50:15 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:50:15 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:50:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:50:15 user nova-compute[73469]: INFO nova.scheduler.client.report [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Deleted allocations for instance f589227e-36da-4c1f-a7a2-24e127334878
Aug 22 03:50:15 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-5e2953dd-8486-486f-971a-f7c577d2b829 tempest-SnapshotDataIntegrityTests-2037707076 tempest-SnapshotDataIntegrityTests-2037707076-project-member] Lock "f589227e-36da-4c1f-a7a2-24e127334878" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.326s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:50:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-b7f1c928-7a74-4e94-b3bb-36d378f60083 req-74d869f8-64f9-4650-ae23-1b08f338b25f service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Received event network-vif-plugged-84cea14f-ce54-4963-9780-22222a629ed8 {{(pid=73469) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 22 03:50:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b7f1c928-7a74-4e94-b3bb-36d378f60083 req-74d869f8-64f9-4650-ae23-1b08f338b25f service nova] Acquiring lock "f589227e-36da-4c1f-a7a2-24e127334878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:50:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b7f1c928-7a74-4e94-b3bb-36d378f60083 req-74d869f8-64f9-4650-ae23-1b08f338b25f service nova] Lock "f589227e-36da-4c1f-a7a2-24e127334878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:50:16 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [req-b7f1c928-7a74-4e94-b3bb-36d378f60083 req-74d869f8-64f9-4650-ae23-1b08f338b25f service nova] Lock "f589227e-36da-4c1f-a7a2-24e127334878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:50:16 user nova-compute[73469]: DEBUG nova.compute.manager [req-b7f1c928-7a74-4e94-b3bb-36d378f60083 req-74d869f8-64f9-4650-ae23-1b08f338b25f service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] No waiting events found dispatching network-vif-plugged-84cea14f-ce54-4963-9780-22222a629ed8 {{(pid=73469) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 22 03:50:16 user nova-compute[73469]: WARNING nova.compute.manager [req-b7f1c928-7a74-4e94-b3bb-36d378f60083 req-74d869f8-64f9-4650-ae23-1b08f338b25f service nova] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Received unexpected event network-vif-plugged-84cea14f-ce54-4963-9780-22222a629ed8 for instance with vm_state deleted and task_state None.
Aug 22 03:50:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:50:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:50:24 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:50:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:50:29 user nova-compute[73469]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692676214.3689716, f589227e-36da-4c1f-a7a2-24e127334878 => Stopped> {{(pid=73469) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 22 03:50:29 user nova-compute[73469]: INFO nova.compute.manager [-] [instance: f589227e-36da-4c1f-a7a2-24e127334878] VM Stopped (Lifecycle Event)
Aug 22 03:50:29 user nova-compute[73469]: DEBUG nova.compute.manager [None req-89d0efc3-7794-4264-aa38-3858b3613a54 None None] [instance: f589227e-36da-4c1f-a7a2-24e127334878] Checking state {{(pid=73469) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 22 03:50:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:50:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:50:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:50:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:50:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:50:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:50:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:50:30 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:50:31 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:50:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:50:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:50:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Didn't find any instances for network info cache update. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 22 03:50:31 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:50:31 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:50:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:50:31 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:50:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:50:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:50:31 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:50:31 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:50:32 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:50:32 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:50:32 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=8918MB free_disk=25.09728240966797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:50:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:50:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:50:32 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:50:32 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:50:32 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing inventories for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 22 03:50:32 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Updating ProviderTree inventory for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 22 03:50:32 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Updating inventory in ProviderTree for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 22 03:50:32 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing aggregate associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, aggregates: None {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 22 03:50:32 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Refreshing trait associations for resource provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE {{(pid=73469) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 22 03:50:32 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:50:32 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:50:32 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:50:32 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:50:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:50:39 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:50:40 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:50:44 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:50:49 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:50:54 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:50:59 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:51:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:51:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:51:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:51:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:51:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:51:04 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:51:05 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:51:08 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:51:09 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:51:11 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:51:14 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:51:19 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:51:24 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:51:25 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:51:28 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:51:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:51:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:51:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:51:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:51:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:51:29 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:51:29 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:51:31 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:51:31 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:51:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Starting heal instance info cache {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 22 03:51:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Rebuilding the list of instances to heal {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 22 03:51:31 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Didn't find any instances for network info cache update. {{(pid=73469) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 22 03:51:32 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:51:32 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:51:33 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:51:33 user nova-compute[73469]: DEBUG nova.compute.manager [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73469) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 22 03:51:33 user nova-compute[73469]: DEBUG oslo_service.periodic_task [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73469) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 22 03:51:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:51:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:51:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:51:33 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Auditing locally available compute resources for user (node: user) {{(pid=73469) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 22 03:51:33 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:51:33 user nova-compute[73469]: WARNING nova.virt.libvirt.driver [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 22 03:51:33 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Hypervisor/Node resource view: name=user free_ram=9054MB free_disk=25.060096740722656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73469) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 22 03:51:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 22 03:51:33 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 22 03:51:34 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 22 03:51:34 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73469) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 22 03:51:34 user nova-compute[73469]: DEBUG nova.compute.provider_tree [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed in ProviderTree for provider: 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c {{(pid=73469) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 22 03:51:34 user nova-compute[73469]: DEBUG nova.scheduler.client.report [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Inventory has not changed for provider 4f1b9997-ae7b-40a3-a07d-cbfb8fb89a9c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73469) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 22 03:51:34 user nova-compute[73469]: DEBUG nova.compute.resource_tracker [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Compute_service record updated for user:user {{(pid=73469) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 22 03:51:34 user nova-compute[73469]: DEBUG oslo_concurrency.lockutils [None req-1e7bf27f-cfda-4113-a382-248931f82810 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=73469) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 22 03:51:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 22 03:51:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 22 03:51:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73469) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 22 03:51:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:51:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73469) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 22 03:51:34 user nova-compute[73469]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73469) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}